Data Engineer

Bengaluru
Remote
Mid-Level: 4 to 6 years
21L - 39L (Per Year)
Posted on Oct 21 2024

Not Accepting Applications

About the Job

Skills

Python
ETL
kafka
SQL
Data Modeling
Big Data Technologies
Data Pipeline Development

We are looking for a skilled Data Engineer who will be responsible for designing, developing,

and maintaining our data infrastructure, data assets on AWS cloud platform. The ideal

candidate should have a strong background in data architecture, along with hands-on

experience in building scalable and reliable data pipelines..


Data Engineer – Duties & Responsibilities


 Design and implement scalable data pipelines to process and transform large volumes of

data using AWS services such as Glue, Kafka, S3, EMR, Athena.

 Collaborate with cross-functional teams including data scientists, analysts, and software

engineers to understand data requirements and deliver solutions that meet business

needs.

 Optimize data workflows for performance, reliability, and cost-efficiency on AWS cloud

platform. Performance Tune ETL Pipelines, database queries.

 Develop and maintain ETL processes to ensure data quality and integrity throughout the

data lifecycle.

 Implement best practices for data security, access control, and compliance in

accordance with industry standards and regulations.

 Continuously monitor and troubleshoot data pipelines to identify and resolve issues in a

timely manner.

 Stay updated with the latest AWS services and technologies and evaluate their potential


for improving our data infrastructure.

 Document data architecture, design decisions, and technical specifications for reference

and knowledge sharing.

Data Engineer – Experience & Qualifications:

 Design and implement scalable data pipelines to process and transform large volumes of

data using AWS services such as Glue, Kafka, S3, EMR, Athena.

 Collaborate with cross-functional teams including data scientists, analysts, and software

engineers to understand data requirements and deliver solutions that meet business

needs.

 Optimize data workflows for performance, reliability, and cost-efficiency on AWS cloud

platform. Performance Tune ETL Pipelines, database queries.

 Develop and maintain ETL processes to ensure data quality and integrity throughout the

data lifecycle.

 Implement best practices for data security, access control, and compliance in

accordance with industry standards and regulations.

 Continuously monitor and troubleshoot data pipelines to identify and resolve issues in a

timely manner.

 Stay updated with the latest AWS services and technologies and evaluate their potential

for improving our data infrastructure.

 Document data architecture, design decisions, and technical specifications for reference

and knowledge sharing.


Data Engineer – Educational Qualifications & Skills

 Bachelor& or Master& degree in Computer Science Engineering, or related field.

 Proven experience as a Data Engineer or similar role, with at least 5 years of experience

in building and maintaining data infrastructure on AWS cloud platform.

 Strong proficiency in AWS services such as Glue, Redshift, Lambda, Athena, S3,

QuickSight etc.

 Experience with big data technologies such as Hadoop, Spark, Kafka, etc.

 In-depth knowledge of data architecture principles, data modelling, and database

design.


 Hands-on experience with SQL, Python, and any other programming languages for data

manipulation and scripting.

 Familiarity with DevOps practices and tools for CI/CD, infrastructure as code, and

automated deployment.

 Knowledge of machine learning concepts and techniques for data analysis and

predictive modelling.

 Excellent problem-solving skills and attention to detail, with a focus on delivering high-

quality solutions.

 Ability to work effectively in a fast-paced environment with tight deadlines and changing

priorities.

 Strong communication and collaboration skills, with the ability to work effectively in a

cross-functional team environment

About the company

A2Z Hire is a company that offers event setup and chair rentals for events like cocktail parties. They have a range of bar chairs and bar stools, and also offer other chairs to make guests comfortable. A2Z Hire can be contacted for a free quotation.

Industry

Staffing and Recruiting

Company Size

2-10 Employees

Headquarter

Hyderabad

Other open jobs from A2ZHIRE