Job title - Data Engineering Lead

Exp - 6 to 8 years

Job Location: Coimbatore / Hyderabad

Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you!

We are searching for a Data Engineering Lead to join our growing team. In this role, you will play a key part in designing, developing, and maintaining our data pipelines. You will work closely with data scientists, analysts, and business stakeholders to ensure our data infrastructure meets the ever-evolving needs of the organization.

Responsibilities:

• Design, develop, and maintain scalable data pipelines using technologies like Python and SQL.
• Develop and implement data quality checks and monitoring processes to ensure data integrity.
• Build and automate data ingestion processes from various sources (databases, APIs, etc.) to Snowflake.
• Utilize cloud platforms (AWS, Azure, GCP) to build and manage data infrastructure.
• Leverage Infrastructure as Code (IaC) tools like Terraform to provision and manage cloud resources.
• Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions.
• Version control code using Git and collaborate with the team through code reviews.
• Document data pipelines and processes for future reference and knowledge sharing.

Qualifications:

• 6 years of experience in data engineering or a related field.
• Proven experience in designing, developing, and deploying data pipelines.
• Hands on experience with Snowflake, Data Bricks, Python or Pyspark and SQL.
• Should have experience working in Data Build Tool (DBT) with snowflake is required
• Experience with data warehousing and data modeling concepts.
• Experience working with cloud platforms (AWS, Azure, GCP) is a plus.
• Working knowledge of Terraform and Infrastructure as Code (IaC) principles.
• Experience with Git for version control.
• Excellent communication and collaboration skills.
• Ability to work independently and as part of a team.
• Should have experience in lead the data engineer team.
• Knowledge and Experience toward Architectural and design is added advantage.
• Strong problem-solving and analytical skills.

Bonus Points:

• Experience with data orchestration tools (Airflow, Luigi, etc.).
• Experience with data visualization tools (Tableau, Power BI, etc.)