![company logo](/_next/image?url=https%3A%2F%2Fd1qx7guo221nxn.cloudfront.net%2Fkiashsolutions%2Flogo_4EO3Ljrx.png&w=128&q=75)
Lead Azure Data Engineer
![company logo](/_next/image?url=https%3A%2F%2Fd1qx7guo221nxn.cloudfront.net%2Fkiashsolutions%2Flogo_4EO3Ljrx.png&w=128&q=75)
Lead Azure Data Engineer 11
Applications
11
Applications
Ahmedabad
Full-Time
Senior: 8 to 12 years
₹ 10L - ₹ 20L (Per Year)
Posted on Jul 22 2024
About the Job
Skills
Azure Data Factory
Python
Pyspark
Azure Databricks
Azure Synapse Analytics
SCD type1
Kafka
Location Ahmedabad
WFO all 5 days
- Please share only senior profiles with 8 to 12 years of experience.
- There will be 3 to 4 rounds of interviews.
Designation: Lead Azure Data Engineer
Experience: 8 -12 Years
Working Days: 5 Days
Notice Period: Immediate or 15 days maximum.
Job Description:
As discussed, they must possess the following skills:
- Good communication skills both written and verbal in English.
- Knowledge of Kimball SCD Type 1 and Type 2 and when to use it.
- Expert in building data pipelines on azure data factory, Azure data bricks. Should have the ability to write complex SQL queries.
- Experience in writing Python & pyspark code. Good to have experience in creating the pipeline to read the data from the Streaming sources (Kafka).
- Knowledge on change data capture.
- Good experience in ADB.
- Azure Data Factory –
- Parametrization and reusable linked services, datasets, and pipelines
- Self-hosted IRs
- Databricks –
- DELTA LIVE Tables with time travel experience
- Structured LIVE streaming with DELTA LIVE Tables
- Knowledge of Optimization and partition best practices.
- Knowledge of how to use the Unity Catalog and its benefits.
- Mounting Technique.
- Streaming Data
- KAFKA, KAFKA Connectors (Debezium MYSQL)
- Ideally knowledge of Confluent Kafka.
- Event hubs, service bus, Azure Function.
About the company
We are a staffing expert company with options to hire on C2H, Contract or Perm positions. We offer our clients to achieve their business goals with successfully outsourcing the business processes and functionalities.
Our ability to offer high quality services in quick time makes us sustainable among the competitors. We believe in giving custom-fit, flexible and high quality solutions by deeply ...Show More
We are a staffing expert company with options to hire on C2H, Contract or Perm positions. We offer our clients to achieve their business goals with successfully outsourcing the business processes and functionalities.
Our ability to offer high quality services in quick time makes us sustainable among the competitors. We believe in giving custom-fit, flexible and high quality solutions by deeply understanding the requirements.
Mission- To Challenge Our Limits In Serving Our Valued Clients With The Finest Resources.
We prioritize ethics more than everything else and create an environment where our employees are innovative and thrive success.
Vision- An Inevitable Connecting Link Between The âWantsâ And The âNeedsâ.
We measure our success only by the value we deliver to our clients.
The Quality of Staffing services.
To focus on Nurturing our core values to shape our business.
To let our work define our character. ...Show Less
Industry
Staffing and Recruiting
Company Size
2-10 Employees
Headquarter
Bangalore