Data Engineer for Pune & Hyderabad
Data Engineer for Pune & Hyderabad76
Applications
76
Applications
Pune
Contract
Senior: 7 to 10 years
Posted on Jan 25 2024
Not Accepting Applications
About the Job
Skills
Java
Scala
Pyspark
Apache
Unix/Linux
Ansible
Company Overview
Optical Arc Pvt. Ltd. is a full-service company of custom software development, mobile application development, database management systems, data visualization, ALM, PLM, and website development. With a focus on helping businesses grow and succeed, we offer end-to-end solutions tailored to our clients' unique needs. Join us on LinkedIn for industry insights, company updates, and career opportunities.
Location: Pune / Hyd (hybrid two days a week)
- Minimum 5+ years of experience.
- Scala development and design using Scala 2.10+ or Java development and design using Java 1.8+.
- Experience with most of the following technologies (Apache Hadoop, Scala, Apache Spark, PySpark, Spark streaming, YARN, Kafka, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services).
- Sound knowledge on working Unix/Linux Platform
- Hands-on experience building data pipelines using Hadoop components - Hive, Spark, Spark SQL,PySpark.
- Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirement management in JIRA.
- Understanding of big data modelling techniques using relational and non-relational techniques
- Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects;
About the company
We are a full-service Company of Custom Software Development ,Mobile Application,Database Management System(DBMS),Data Visualisation,ALM,PLM,Website Development that helps businesses grow and succeed. From Custom Software development to Web and Mobile App Development, we provide end-to-end solutions tailored to your unique needs. Join us on LinkedIn for industry insights, company updates, and car ...Show More
We are a full-service Company of Custom Software Development ,Mobile Application,Database Management System(DBMS),Data Visualisation,ALM,PLM,Website Development that helps businesses grow and succeed. From Custom Software development to Web and Mobile App Development, we provide end-to-end solutions tailored to your unique needs. Join us on LinkedIn for industry insights, company updates, and career opportunities. #digitalmarketing #softwaredevelopment #innovation ...Show Less
Industry
IT Services
Company Size
11-50 Employees
Headquarter
Pune , Maharashtra