company logo

AVP - Data Engineering (Python)

Bangalore Urban
Bangalore
Full-Time
Senior: 8 to 12 years
Posted on Nov 07 2024

About the Job

Skills

Python
Data Quality
Automation Developer
DQ
ETL
DATA ENGINEER

Job Description:

We are seeking a highly skilled, detail-oriented, and motivated Python DQ Automation Developer to

join our team. The ideal candidate will be responsible for designing, developing, and maintaining data

quality automation solutions using Python. This role requires a deep understanding of data quality

principles, proficiency in Python, and experience with data processing and analysis.

Key Responsibilities:

Design, develop, and implement data quality automation processes and solutions to identify,

measure, and improve data quality.

Write and optimize Python scripts and applications to support data quality initiatives.

Use Python libraries such as Pandas, NumPy, and PySpark for data manipulation and

processing.

Develop and enhance ETL processes to ensure accurate and timely data integration and

transformation.

Analyze data sets to identify data quality issues, trends, and anomalies, providing insights and

recommendations for improvement. Support manual DQ efforts as required.

Develop and execute test plans to validate the effectiveness of data quality solutions.

Maintain comprehensive documentation of data quality processes, procedures, and standards.

Work closely with data analysts, data engineers, DQ testers and other team members and

stakeholders to understand data requirements and deliver high-quality data solutions.

Required Skills:

Proficiency in Python and related libraries (Pandas, NumPy, PySpark, pyTest).

Experience with data quality tools and frameworks.

Strong understanding of ETL processes and data integration.

Familiarity with data governance and data management principles.

Excellent analytical and problem-solving skills with a keen attention to detail.

Strong verbal and written communication skills, with the ability to explain technical concepts to

non-technical stakeholders.

Ability to work effectively both independently and as part of a team.

Qualifications:

Bachelor’s degree in computer science or Information Technology. Advanced degree is a plus.

Minimum of 7 years of experience in data quality automation and Python Development.Proven experience with Python libraries for data processsing and analysis.

About the company

Covenant is a premier Executive Search and Recruitment Firm with 350+ Full-Time Recruitment Specialists with a proven track record of strong delivery across the globe. We are specialists in the arena of Human Capital unmatched in all metrics Head Hunting, Turnaround Time, Unceasing Availability, Cost-Effectiveness, Steadfast Quality of Service - provided by a team of Principal Consultants and Ana ...Show More

Industry

Management Consulting

Company Size

201-500 Employees

Headquarter

Chennai, Tamilnadu

Other open jobs from Covenant Consultants