Company Overview

Career Mantra is a leading educational advisory company founded in 2008, aimed at simplifying course and college selection for undergraduate and postgraduate students in India and abroad. With a comprehensive database of over 1,500 institutions and 25,000 courses, we assist students in making informed decisions about their educational futures. Headquartered in Gwalior, we provide personalized user experiences and host seminars to connect aspirants with expert guidance and support.

Job Overview

We are seeking a Senior Integration Engineer to join our team on a remote, contract basis. Based in Pune, you will play a crucial role in the integration and enhancement of our educational platforms. You will leverage your expertise to ensure seamless data integration, supporting our mission of providing reliable information to aspiring students worldwide.

Qualifications and Skills

• Expertise in Python, Hadoop, and Pyspark (Mandatory skill) for developing robust integration solutions.
• Strong experience in machine learning to develop and refine educational data models.
• Proficiency in Python programming is essential to deliver efficient and scalable integration solutions.
• Solid knowledge of predictive modeling techniques to enhance data-driven decision-making processes.
• Experience in SQL for database management and data extraction to ensure data consistency and integrity.
• Ability to engage in data mining to extract insightful patterns and trends from large datasets.
• Strong problem-solving skills to troubleshoot and resolve complex integration challenges efficiently.
• Excellent communication skills to collaborate effectively with cross-functional teams and stakeholders.

Roles and Responsibilities

• Design and implement scalable data pipelines using Python, PySpark, and Big Data tools.
• Optimize data processing performance in AWS.
• Collaborate with business teams to deliver reliable data solutions.
• Develop and maintain ETL processes using tools like Airflow, Azkaban, and AWS Glue.
• Troubleshoot and ensure data integrity across data pipelines.
• Mentor junior team members and promote best practices.