Company Overview

Covenant Consultants is a leading executive search and recruitment firm renowned for its efficient and cost-effective services. With over 350 full-time recruitment specialists, we possess unmatched expertise in headhunting and timely deliveries for our diverse clients across the globe. Guided by our principles of integrity, excellence, and quality, we are dedicated to meeting the varied needs of our clients, candidates, and employees in the management consulting industry.

Job Overview

We are seeking a Senior Data Engineer to join our team in Bangalore. As a data-driven organization, we are looking for a professional with a maximum of 10 years of relevant work experience in data engineering. The ideal candidate will work full-time, utilizing advanced cloud platforms and big data technologies to support our data infrastructure. If you have a strong foundation in AWS, Big Data, Scala, Spark, and PySpark, you could be the perfect addition to our dynamic team.

Qualifications and Skills

• Proficiency in working with cloud platforms such as AWS to design and manage scalable data infrastructure.
• Extensive experience with big data technologies and frameworks including Scala, Spark, and PySpark.
• Solid understanding and hands-on experience in data modeling, ETL processes, and data warehousing.
• Ability to code and script using programming languages or frameworks related to data engineering.
• Strong problem-solving skills and the ability to troubleshoot complex data processing issues efficiently.
• Excellent collaboration and communication skills to work effectively with cross-functional teams.
• Experience with data pipeline and workflow management tools for seamless data flow and processing.
• Ability to analyze and optimize data processes for performance, reliability, and efficiency.

Roles and Responsibilities

• Design, develop, and maintain scalable data pipelines and systems for large-scale data processing.
• Collaborate with data scientists and other stakeholders to ensure alignment in data-related strategies and execution.
• Implement best practices for data management, including data quality and validation techniques.
• Monitor data pipeline performance and optimize configurations for efficiency and reliability.
• Work with IT and development teams to integrate data solutions with existing infrastructure.
• Ensure security and compliance of the data systems in accordance with company standards.
• Stay updated with the latest trends and technologies in data engineering, applying them where necessary.
• Provide technical expertise and mentorship to junior data engineers and team members.