Location Ahmedabad

WFO all 5 days

- Please share only senior profiles with 8 to 12 years of experience.

- There will be 3 to 4 rounds of interviews.

Designation: Lead Azure Data Engineer 

Experience: 8 -12 Years 

Working Days: 5 Days

Notice Period: Immediate or 15 days maximum.

Job Description:

As discussed, they must possess the following skills:

• Good communication skills both written and verbal in English.
• Knowledge of Kimball SCD Type 1 and Type 2 and when to use it.
• Expert in building data pipelines on azure data factory, Azure data bricks. Should have the ability to write complex SQL queries.
• Experience in writing Python & pyspark code. Good to have experience in creating the pipeline to read the data from the Streaming sources (Kafka).
• Knowledge on change data capture.
• Good experience in ADB.
• Azure Data Factory –
• Parametrization and reusable linked services, datasets, and pipelines
• Self-hosted IRs
• Databricks –
• DELTA LIVE Tables with time travel experience
• Structured LIVE streaming with DELTA LIVE Tables
• Knowledge of Optimization and partition best practices.
• Knowledge of how to use the Unity Catalog and its benefits.
• Mounting Technique.
• Streaming Data
• KAFKA, KAFKA Connectors (Debezium MYSQL)
• Ideally knowledge of Confluent Kafka.
• Event hubs, service bus, Azure Function.