We are seeking a highly skilled and motivated Big Data QA Engineer with expertise in automation testing using Java or Python programming languages. The ideal candidate should possess a strong background in data validation, data verification, PySpark, pipeline monitoring, software testing fundamentals, STLC (Software Testing Life Cycle), MongoDB, and database testing. Key Responsibilities: Automation Testing: ● Develop and maintain automated test scripts using Java or Python for Big Data applications. ● Implement test automation frameworks and tools to enhance the efficiency and effectiveness of the testing process. Data Validation and Verification: ● Design and execute test cases to validate and verify large datasets, ensuring data accuracy and integrity. ● Identify and report data discrepancies or anomalies. Pipeline Monitoring: ● Monitor and evaluate data pipelines for performance, reliability, and scalability. ● Implement strategies for identifying and resolving issues in data processing pipelines. Software Testing Fundamentals: ● Apply sound software testing principles and methodologies to ensure high-quality deliverables. ● Collaborate with development and product teams to understand requirements and design comprehensive test plans. STLC (Software Testing Life Cycle): ● Manage and execute test cycles throughout the SDLC. ● Collaborate with cross-functional teams to ensure comprehensive test coverage. MongoDB and Database Testing: ● Conduct testing of MongoDB databases and other data storage systems. ● Develop and execute SQL queries for database testing purposes.