Job Description: We are seeking a skilled and experienced Big Data Quality Assurance (QA) Engineer to join our team. As a Big Data QA Engineer you will play a critical role in ensuring the accuracy reliability and performance of our big data solutions. You will collaborate closely with our development and data science teams to design and execute comprehensive test plans identify and document defects and ensure the overall quality of our big data applications.
Responsibilities:
- Design develop and execute test plans and test cases for big data applications including those involving machine learning algorithms
Perform manual and automated testing of data pipelines ETL processes and data analytics algorithms
Develop and maintain test data sets for various testing scenarios including machine learning models
Analyze and document defects and work closely with development teams to resolve issues
Identify opportunities for test automation and contribute to the development of automated test scripts
Collaborate with crossfunctional teams to ensure the overall quality of big data solutions
Stay uptodate with industry best practices and emerging technologies in big data testing and machine learning
Requirements:
- Bachelors degree in Computer Science Engineering or a related field
3 years of experience in software quality assurance with a focus on big data testing and exposure to machine learning projects
Handson experience with big data technologies such as Hadoop Spark and Kafka
Strong understanding of data modeling ETL processes and data warehousing concepts
Experience with SQL and scripting languages such as Python or Java
Proven track record of designing and executing test plans for complex data applications including those involving machine learning models
Excellent analytical and problemsolving skills
Strong communication and collaboration skills with the ability to work effectively in a crossfunctional team environment
Experience with test automation tools such as Selenium or JUnit is a plus
Knowledge of cloud platforms such as AWS or Azure is a plus