Data Engineer

Bengaluru
Remote
Mid-Level: 4 to 6 years
21L - 39L (Per Year)
Posted on Oct 21 2024

About the Job

Skills

Python
ETL
kafka
SQL
Data Modeling
Big Data Technologies
Data Pipeline Development

We are looking for a skilled Data Engineer who will be responsible for designing, developing,

and maintaining our data infrastructure, data assets on AWS cloud platform. The ideal

candidate should have a strong background in data architecture, along with hands-on

experience in building scalable and reliable data pipelines..


Data Engineer – Duties & Responsibilities


 Design and implement scalable data pipelines to process and transform large volumes of

data using AWS services such as Glue, Kafka, S3, EMR, Athena.

 Collaborate with cross-functional teams including data scientists, analysts, and software

engineers to understand data requirements and deliver solutions that meet business

needs.

 Optimize data workflows for performance, reliability, and cost-efficiency on AWS cloud

platform. Performance Tune ETL Pipelines, database queries.

 Develop and maintain ETL processes to ensure data quality and integrity throughout the

data lifecycle.

 Implement best practices for data security, access control, and compliance in

accordance with industry standards and regulations.

 Continuously monitor and troubleshoot data pipelines to identify and resolve issues in a

timely manner.

 Stay updated with the latest AWS services and technologies and evaluate their potential


for improving our data infrastructure.

 Document data architecture, design decisions, and technical specifications for reference

and knowledge sharing.

Data Engineer – Experience & Qualifications:

 Design and implement scalable data pipelines to process and transform large volumes of

data using AWS services such as Glue, Kafka, S3, EMR, Athena.

 Collaborate with cross-functional teams including data scientists, analysts, and software

engineers to understand data requirements and deliver solutions that meet business

needs.

 Optimize data workflows for performance, reliability, and cost-efficiency on AWS cloud

platform. Performance Tune ETL Pipelines, database queries.

 Develop and maintain ETL processes to ensure data quality and integrity throughout the

data lifecycle.

 Implement best practices for data security, access control, and compliance in

accordance with industry standards and regulations.

 Continuously monitor and troubleshoot data pipelines to identify and resolve issues in a

timely manner.

 Stay updated with the latest AWS services and technologies and evaluate their potential

for improving our data infrastructure.

 Document data architecture, design decisions, and technical specifications for reference

and knowledge sharing.


Data Engineer – Educational Qualifications & Skills

 Bachelor& or Master& degree in Computer Science Engineering, or related field.

 Proven experience as a Data Engineer or similar role, with at least 5 years of experience

in building and maintaining data infrastructure on AWS cloud platform.

 Strong proficiency in AWS services such as Glue, Redshift, Lambda, Athena, S3,

QuickSight etc.

 Experience with big data technologies such as Hadoop, Spark, Kafka, etc.

 In-depth knowledge of data architecture principles, data modelling, and database

design.


 Hands-on experience with SQL, Python, and any other programming languages for data

manipulation and scripting.

 Familiarity with DevOps practices and tools for CI/CD, infrastructure as code, and

automated deployment.

 Knowledge of machine learning concepts and techniques for data analysis and

predictive modelling.

 Excellent problem-solving skills and attention to detail, with a focus on delivering high-

quality solutions.

 Ability to work effectively in a fast-paced environment with tight deadlines and changing

priorities.

 Strong communication and collaboration skills, with the ability to work effectively in a

cross-functional team environment

About the company

A2Z Hire is a company that offers event setup and chair rentals for events like cocktail parties. They have a range of bar chairs and bar stools, and also offer other chairs to make guests comfortable. A2Z Hire can be contacted for a free quotation.

Industry

Staffing and Recruiting

Company Size

2-10 Employees

Headquarter

Hyderabad

Other open jobs from A2ZHIRE