Company Overview

Mazenet solution is a prominent player in the IT service industry with a workforce of 201-500 employees. Our company, headquartered in Chennai, provides innovative solutions in various IT domains. With a strong presence in the market, Mazenet solution is dedicated to delivering high-quality services and fostering a positive workplace for our employees. For more information, visit our website.

Job Overview

We are seeking a passionate and experienced Azure Databricks Engineer to join our dynamic team. This is a mid-level, full-time position with the flexibility to work in Bangalore Urban, Chennai, Hyderabad, Mumbai, or Delhi. The ideal candidate should have a minimum of 4 years of relevant work experience in the field of data engineering and cloud computing.

Qualifications and Skills

• Proven experience of at least 4 years working with the Azure Cloud Platform.
• Solid expertise in Databricks and Apache Spark, including experience with Spark SQL and the Delta Lake framework.
• Strong proficiency in Python programming for data engineering and data science applications.
• In-depth understanding of ETL processes and data transformation techniques for large datasets.
• Hands-on experience with SQL for data querying, manipulation, and optimization.
• Experience with building and managing data pipelines on cloud platforms.
• Knowledge of best practices for data security and data governance in cloud environments.
• Excellent analytical skills with the ability to troubleshoot complex data issues and devise effective solutions.

Roles and Responsibilities

• Design, develop, and maintain scalable data engineering pipelines using Azure Databricks and Apache Spark.
• Collaborate with data scientists and analysts to integrate data processing solutions into business workflows.
• Implement ETL processes to ingest, transform, and load large volumes of data from various sources.
• Optimize and monitor data pipelines to ensure high performance and reliability.
• Develop and enforce data quality standards and protocols.
• Leverage Python and SQL to perform data preprocessing, analysis, and visualization tasks.
• Stay updated with the latest advancements in Azure cloud technologies and Databricks features.
• Provide technical support and guidance to junior team members and other stakeholders as needed.