Walk-In Interview | Lead Data Engineer|16th Mar'24
Walk-In Interview | Lead Data Engineer|16th Mar'247
Applications
7
Applications
Not Accepting Applications
About the Job
Skills
Walk-In Interview| Lead Data Engineer | Gurgaon |16th March'2024
Big Data COE – Data Engineer
Job Description:
This role is for a Data Engineer with solid development experience who will focus on creating robust data pipelines and enhancing existing ETL processes. You will be an integral part of development team examining requirements and designing optimal solutions. The role is for a self-motivated individual with knowledge of Hadoop ecosystem and various Hadoop tools/services. The candidate will perform hands-on activities including design, documentation, development and test of new functionality.
Responsibilities:
- Design, build, and maintain robust data pipelines and ETL processes to support data integration, transformation, and storage.
- Develop and implement data architecture solutions using technologies such as Kafka, Hadoop, Hive, PySpark, and Cloudera.
- Optimize and tune data pipelines for performance, reliability, and scalability.
- Collaborate with data scientists, analysts, and software engineers to understand data requirements and deliver actionable insights.
- Work closely with infrastructure teams to manage on-premises data infrastructure and ensure high availability and security.
- Implement best practices for data governance, data quality, and data security.
- Evaluate and recommend new technologies, tools, and frameworks to enhance data engineering capabilities.
- Provide technical leadership and mentorship to junior members of the data engineering team.
Qualifications:
- Bachelor’s or master’s degree in computer science, Engineering, or related field.
- 5+ years of experience in data engineering roles with a focus on building data pipelines and data infrastructure.
- Extensive hands-on experience with Kafka, Hadoop, Hive, PySpark, and Cloudera.
- Proficiency in Python programming language for data manipulation, scripting, and automation.
- Strong understanding of distributed systems, data modelling, and database concepts.
- Experience working with on-premises data infrastructure and cloud platforms (e.g., AWS, Azure, GCP).
- Streaming experience – Spark streaming, Flink.
- Extensive hands-on experience on coding – Java/Scala/Python
- Need to have experience on Linux/Scripting
- Strong understanding of Data Modelling
- Excellent problem-solving skills and ability to troubleshoot complex data issues.
- Strong communication and collaboration skills with the ability to work effectively in cross-functional teams.
- Proven track record of delivering high-quality solutions on time and within budget.
Office Address -
Unitech Commercial Tower 1, Sector 45, Gurgaon https://maps.app.goo.gl/2js38aCM5BsAuGQ9A (Previously HSBC Bank Office)
About the company
Industry
Media & Telecommunication...
Company Size
51-200 Employees
Headquarter
Navi Mumbai, Maharashtra
Other open jobs from Jio Platforms Limited