company logo

Senior Data Engineer

Salem
Hosur
Bangalore
Chennai
Dharmapuri
Virudhunagar
Full-Time
Senior: 7 to 10 years
12L - 16L (Per Year)
Posted on Jul 10 2024

About the Job

Skills

Big Data Technologies
Data Modeling
ETL Processes
Data Warehousing
SQL
Python
Data Pipeline Development
Cloud Platforms

Hi,



We are hiring Senior Data Engineer for our client a dynamic and innovative company specializing in cutting-edge AI/ML solutions.


Role: Senior Data Engineer  

Years of experience:6-9 years 

Budget: 12 LPA(Minimum)-15 LPA(Maximum) 

Notice Period - 30days



 Senior Data Engineer to join our team. The ideal candidate will have 6+ years of experience in data engineering, with strong proficiency in Python, Databricks, and working on Snowflake. This role involves working on covert raw material to extract valuable information for business insights.

 

Role & responsibilities

     

   

Work with architects and leads for solutions to meet functional and non-functional requirements.

Must have excellent coding skills either Python or Scala, preferably Python.

Must have at least 5+ years of experience in the Data Engineering domain with a total of 7+ years.

Must have implemented at least 2 projects end-to-end in Databricks.

Must have at least 2+ years of experience on Databricks which consists of various components such as Delta lake,dbConnect, db API 2.0, and Databricks workflows orchestration.

Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.

Must have good understanding to create complex data pipeline.

Must have extensive knowledge of Spark and Hive data processing framework.

Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases

Good to have if worked on migration project to build Unified data platform.

Good to have knowledge of DBT.

Good to have knowledge of docker and Kubernete

About the company

At Almighty HRD Consultants, we understand the critical importance of hiring the right individuals to drive organizational success. With an extensive network of top-notch professionals and a deep understanding of industry dynamics, we are committed to connecting our clients with the most suitable candidates who possess the skills, qualifications, and cultural fit required to excel in their roles. ...Show More

Industry

Staffing and Recruiting

Company Size

2-10 Employees

Headquarter

Coimbatore South, Tamil N...

Other open jobs from Almighty HRD Consultants