company logo

Data Engineering

Bangalore Urban
Full-Time
Senior: 7 to 10 years
Posted on Nov 07 2024

About the Job

Skills

Python Programming
Data quality
Automation
ETL
python
Data quality automation developer
Data engineer

Job Description:

We are seeking a highly skilled, detail-oriented, and motivated Python DQ Automation Developer to

join our team. The ideal candidate will be responsible for designing, developing, and maintaining data

quality automation solutions using Python. This role requires a deep understanding of data quality

principles, proficiency in Python, and experience with data processing and analysis.

Key Responsibilities:

 Design, develop, and implement data quality automation processes and solutions to identify,

measure, and improve data quality.

 Write and optimize Python scripts and applications to support data quality initiatives.

 Use Python libraries such as Pandas, NumPy, and PySpark for data manipulation and

processing.

 Develop and enhance ETL processes to ensure accurate and timely data integration and

transformation.

 Analyze data sets to identify data quality issues, trends, and anomalies, providing insights and

recommendations for improvement. Support manual DQ efforts as required.

 Develop and execute test plans to validate the effectiveness of data quality solutions.

 Maintain comprehensive documentation of data quality processes, procedures, and standards.

 Work closely with data analysts, data engineers, DQ testers and other team members and

stakeholders to understand data requirements and deliver high-quality data solutions.

Required Skills:

 Proficiency in Python and related libraries (Pandas, NumPy, PySpark, pyTest).

 Experience with data quality tools and frameworks.

 Strong understanding of ETL processes and data integration.

 Familiarity with data governance and data management principles.

 Excellent analytical and problem-solving skills with a keen attention to detail.

 Strong verbal and written communication skills, with the ability to explain technical concepts to

non-technical stakeholders.

 Ability to work effectively both independently and as part of a team.

Qualifications:

 Bachelor’s degree in computer science or Information Technology. Advanced degree is a plus.

 Minimum of 7 years of experience in data quality automation and Python Development.

About the company

Covenant is a premier Executive Search and Recruitment Firm with 350+ Full-Time Recruitment Specialists with a proven track record of strong delivery across the globe. We are specialists in the arena of Human Capital unmatched in all metrics Head Hunting, Turnaround Time, Unceasing Availability, Cost-Effectiveness, Steadfast Quality of Service - provided by a team of Principal Consultants and Ana ...Show More

Industry

Management Consulting

Company Size

201-500 Employees

Headquarter

Chennai, Tamilnadu

Other open jobs from Covenant Consultants