Job Overview

We are looking for a talented Big Data Engineer to join our team in Bengaluru. This is a mid-level, full-time position requiring a minimum of 4 years to a maximum of 6 years of relevant work experience. As a Big Data Engineer at Telescopp, you will be responsible for developing, testing, and maintaining big data solutions to support our client's business needs.

Qualifications and Skills

• Experience in Pyspark, SQL,Cloud data warehouse like Azure Synapse,databricks.
• Experience working with structured and unstructured data.
• Extensive knowledge of Data Warehousing concepts, strategies, methodologies.
• Experience in ETL/Pipeline Development using tools such as Azure Databricks and Azure Data Factory with development expertise on batch and real-time data integration.
• Experience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements.
• Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server.
• Experience with Orchestration tools, Azure DevOps, and GitHub.
• Must be team oriented with strong communication, collaboration, prioritization, and adaptability skill.

Roles and Responsibilities

• Design, build, and maintain scalable big data infrastructure and pipelines.
• Develop and optimize ETL processes to ensure efficient and accurate data movement.
• Collaborate with data scientists and analysts to support their data needs.
• Implement and manage data warehousing solutions to support reporting and analytics.
• Ensure data quality, consistency, and integrity across all data sources and destinations.
• Monitor and troubleshoot data processing workflows, ensuring high performance and availability.
• Contribute to the development and maintenance of best practices for data architecture and engineering.
• Stay up-to-date with the latest industry trends and technologies in big data and machine learning.