Responsibilities:
Testing & Validation: Design, develop, and execute test plans and test cases for our Hadoop data ingestion pipelines.
Data Integrity: Ensure the completeness, correctness, and timeliness of data ingested into Hadoop. Validate source to target data mapping and transformations.
Performance Testing: Evaluate the performance and scalability of our data ingestion processes and recommend improvements.
Collaboration: Work closely with data engineers, data scientists, and other stakeholders to understand the data requirements and provide feedback on data quality issues.
Debugging: Troubleshoot and identify root causes of any data discrepancies or failures in the data ingestion process.
Documentation: Maintain thorough documentation of testing processes, results, and recommendations.
The ideal candidate will be responsible for ensuring the quality and reliability of data pipelines and will play a crucial role in our data-driven decision-making processes.
Requirements:
Candidates are required to have these mandatory skills:
5+ years of experience in ETL testing with a focus on Hadoop-based systems.
Familiarity with Hadoop ecosystem tools like HDFS, Hive, Spark, Kafka, etc.
Proven experience with data validation, reconciliation, and performance testing tools.
Seasoned tester with a strong background in Hadoop data ingestion and ETL testing.
Knowledge of SQL and querying large datasets.
Strong analytical and problem-solving skills.
Excellent written and verbal communication skills.
--
You must verify your mobile number to apply to this job.