Data Engineer
Data Engineer13
Applications
13
Applications
About the Job
Skills
About Us:
KrtrimaIQ Cognitive Solutions is a leader in AI and Big Data technologies, providing innovative solutions that enable businesses to harness the power of data. We are on a mission to transform enterprises through advanced data-driven technologies, and we are looking for a skilled Scala Developer with expertise in Kafka and Big Data to join our dynamic team.
Job Summary:
We are seeking an experienced Scala Developer with a strong background in Kafka and Big Data technologies. The ideal candidate will have extensive experience in designing and implementing scalable data solutions, with a focus on performance and reliability. You will work closely with our data engineering and AI teams to build and maintain high-performance data pipelines and applications.
Key Responsibilities:
- Develop and maintain scalable applications using Scala and related technologies.
- Design, implement, and manage data pipelines utilizing Kafka and other Big Data tools.
- Collaborate with cross-functional teams to define, design, and ship new features.
- Optimize application performance, ensuring high throughput and low latency.
- Monitor and troubleshoot data processing workflows, ensuring data integrity and reliability.
- Participate in code reviews, provide feedback, and improve code quality.
- Stay up to date with the latest trends and best practices in Big Data and functional programming.
Required Skills:
- Strong proficiency in Scala with at least 4+ years of hands-on experience.
- Extensive experience with Kafka: stream processing, Kafka Connect, Kafka Streams, etc.
- Solid understanding of Big Data technologies including Hadoop, Spark, HDFS, and Hive.
- Proficiency in SQL and NoSQL databases.
- Experience with ETL pipelines and data integration workflows.
- Familiarity with data warehousing concepts and cloud platforms (AWS, GCP, Azure).
- Knowledge of containerization (Docker) and orchestration tools (Kubernetes) is a plus.
- Excellent problem-solving skills and a proactive attitude.
Qualifications:
- Bachelor’s or master’s degree in computer science, Engineering, or a related field.
- 4+ years of experience in Scala development, with a focus on Big Data and Kafka.
- Proven track record of building and managing scalable, reliable data systems.
- Strong communication skills and ability to work in a collaborative environment.
Why Join Us:
- Work on cutting-edge technologies in the AI and Big Data domain.
- Be part of a fast-growing company with opportunities for career advancement.
- Enjoy a flexible work environment with a hybrid work model.
- Collaborate with a team of passionate, skilled professionals.
About the company
Industry
IT Services and IT Consul...
Company Size
51-200 Employees
Headquarter
Bengaluru, Karnataka
Other open jobs from krtrimaIQ Cognitive Solutions