Senior Data Engineer
Senior Data Engineer
Bangalore
Full-Time
Mid-Level: 5 to 8 years
Posted on Sep 20 2024
About the Job
Skills
IDQ Tool
Data Modeling
Data Warehousing
SQL
Python
Data Pipeline Development
Cloud Platforms
Extract, Transform, Load (ETL)
Roles and Responsibilities
- Conduct data analysis and profiling using Informatica Data Quality (IDQ) tool to understand the structure, quality, and integrity of the data.
- Collaborate with the data migration manager with project planning and status reporting on data profiling and cleansing activities. Overall adhere to the AX data clean up ways of working.
- Collaborate with business stakeholders and data owners to interpret profiling results and understand data requirements and objectives.
- Develop data quality rules & standards based on business requirements and industry best practices.
- Document data quality processes, rules and standards for future reference and training purposes. Create and maintain source to target mappings.
- Create DQ scorecard and reports to track and monitor data quality metrics over time.
- Should have experience in Azure Synapse.
Create & Executing Data Cleansing Rules
- Develop and maintain quality mappings, DQ rules, and workflow within informatica data quality environment.
- Perform data profiling, cleansing, standardization, and matching using Informatica data quality transformations and functionalities.
- Troubleshoot & resolve issues related to the tool.
- Collaborate with Informatica SME to implement automated data quality checks and validations within data pipelines and workflows.
Testing
- Develop and execute test plans and test cases to validate effectiveness of data quality rules and cleansing processes.
- Conduct data validation and verification activities to ensure data quality improvements meet requirements.
- Identify and address data quality issues and anomalies through root cause analysis and troubleshooting.
- Prepare and present test results including defects and resolution status.
Rollout
- Monitor data quality metrics and trends to identify areas for improvement and optimization.
- Prepare weekly status reports on data quality activities status, continuously communicate with the data migration manager arising risks, issues, and contingency plan.
- Work with the Informatica SME for troubleshooting technical issues related to using informatica data quality effectively for data profiling and cleansing purposes.
Desired Candidate Profile
Experience: 5 - 8 years
Location: Bangalore
Qualification: BE / M-Tech Engineering, BCA/ MCA, Any data related field
Schedule: Day Shift, Monday to Friday
Workplace Type: On-site (Work from Office)
Notice Period: Immediate
About the company
Nextbrain started its amazing journey in 2016 with a small team as an enterprise software development company. Since then, we have been offering end-to-end digital solutions across all business verticals worldwide. We have a great reputation of providing unique and customized business solutions tailored to meet the specific business needs. We have extended our remarkable services to more than 150 ...Show More
Nextbrain started its amazing journey in 2016 with a small team as an enterprise software development company. Since then, we have been offering end-to-end digital solutions across all business verticals worldwide. We have a great reputation of providing unique and customized business solutions tailored to meet the specific business needs. We have extended our remarkable services to more than 150 projects for start-ups, small, and Enterprise businesses globally. ...Show Less
Industry
Information Technology & ...
Company Size
51-200 Employees
Headquarter
Bangalore
Other open jobs from Nextbrain Technologies Pvt Ltd