Company Overview

VidPro Consultancy Services is one of the top staffing consultancy firms in Bangalore. We provide manpower solutions to both IT and non-IT sectors, sourcing top talent for startups across India. Our mission is to enhance talent and skills in support of our clients' business objectives. Our vision is to become a preferred search partner for all staffing needs.

Job Overview

We are seeking a talented Senior Databricks Engineer to join our team at VidPro Consultancy Services. As a Senior Databricks Engineer, you will be responsible for developing, implementing, and maintaining scalable data pipelines and analytics solutions using Databricks. This is a full-time position based in Bengaluru, Karnataka, India, with a mid-level experience requirement of 4 to 6 years.

Qualifications and Skills

• 4 to 6 years of experience as a Data Engineer or similar role, preferably with hands-on experience in Databricks
• Strong knowledge of SQL, Python, and ETL processes
• Experience with big data technologies and tools, such as Hadoop, Spark, and Kafka
• Familiarity with cloud platforms, such as AWS or Azure
• Good understanding of data warehousing concepts and data modeling
• Ability to analyze and optimize complex SQL queries
• Excellent problem-solving and troubleshooting skills
• Strong communication and collaboration skills
• Ability to work independently and in a team environment
• Bachelor's degree in Computer Science or a related field

Roles and Responsibilities

• Design, develop, and maintain scalable data pipelines and analytics solutions using Databricks
• Collaborate with cross-functional teams to gather and understand data requirements
• Implement data ETL processes to extract, transform, and load data from various sources
• Ensure data quality and reliability by performing data validation and testing
• Optimize and fine-tune data pipelines for maximum performance and efficiency
• Troubleshoot and resolve any issues related to data pipelines and analytics solutions
• Stay up-to-date with industry trends and best practices in data engineering and analytics
• Mentor junior team members and provide technical guidance and support