Senior Data Engineer

Coimbatore
Hyderabad
Full-Time
Mid-Level: 3.5 to 8 years
Posted on Oct 03 2024

About the Job

Skills

Python
Data Warehousing
Data Pipeline Development
SQL
Azure Databricks
PySpark
Snowflake Cloud

Job title - Senior Data Engineer

Exp - 6 to 8 years

Job Location: Coimbatore / Hyderabad


Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you!


We are searching for a Senior Data Engineer to join our growing team. In this role, you will play a key part in designing, developing, and maintaining our data pipelines. You will work closely with data scientists, analysts, and business stakeholders to ensure our data infrastructure meets the ever-evolving needs of the organization.


Responsibilities:

  • Design, develop, and maintain scalable data pipelines using technologies like Python and SQL.
  • Develop and implement data quality checks and monitoring processes to ensure data integrity.
  • Build and automate data ingestion processes from various sources (databases, APIs, etc.) to Snowflake.
  • Utilize cloud platforms (AWS, Azure, GCP) to build and manage data infrastructure.
  • Leverage Infrastructure as Code (IaC) tools like Terraform to provision and manage cloud resources.
  • Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions.
  • Version control code using Git and collaborate with the team through code reviews.
  • Document data pipelines and processes for future reference and knowledge sharing.


Qualifications:

  • 5+ years of experience in data engineering or a related field.
  • Proven experience in designing, developing, and deploying data pipelines.
  • Hands on experience with Snowflake or Data Bricks, Python or Pyspark and SQL
  • Should have experience working in Data Build Tool (DBT).
  • Experience with data warehousing and data modeling concepts.
  • Experience working with cloud platforms (AWS, Azure, GCP) is a plus.
  • Working knowledge of Terraform and Infrastructure as Code (IaC) principles.
  • Experience with Git for version control.
  • Excellent communication and collaboration skills.
  • Should have experience in leading the data team.
  • Ability to work independently and as part of a team.
  • Strong problem-solving and analytical skills.


Bonus Points:

  • Experience with data orchestration tools (Airflow, Luigi, etc.).
  • Experience with data visualization tools (Tableau, Power BI, etc.)

About the company

At the core of QBrainX's foundation is a mission to empower and fortify organizations across diverse domains, guiding them to achieve excellence in their respective fields. We drive modernization through innovative digital engineering, leveraging robust ecosystems like ServiceNow, ITSM, ITOM, GRC, CSM, and business management. Consistently pushing industry boundaries, we automate business processe ...Show More

Industry

IT Services and IT Consul...

Company Size

201-500 Employees

Headquarter

Troy, Michigan

Other open jobs from QBrainX Inc