Job Title: Quality Engineer Data (ETL Testing)
Experience: 14 years
Immediate Joiners Preferred
Job Description:
We are seeking a highly skilled and motivated Quality Engineer specializing in Data Testing with expertise in ETL processes SQL NoSQL Python PySpark and Azure. The ideal candidate will have a strong understanding of data management software testing methodologies and data engineering principles along with the ability to ensure the accuracy and quality of data across various platforms.
Key Responsibilities:
- Data Management:
- Strong understanding of data management principles.
- Proficiency in working with different types of databases (SQL NoSQL) and data formats (CSV JSON XML).
- ETL (Extract Transform Load):
- Experience with ETL processes to extract data from various sources transform it according to business rules and load it into target systems.
- Knowledge of ETL tools is beneficial.
- Programming Skills:
- Proficiency in programming languages commonly used in data engineering such as Python Java or Scala with Spark.
- Knowledge of scripting languages like Bash or PowerShell for automation tasks.
- SQL:
- Strong SQL skills for querying and manipulating data in relational databases.
- Ability to write complex SQL queries optimize query performance and understand database indexing.
- Testing Principles:
- Understanding of software testing principles and methodologies (e.g. Agile Scrum).
- Experience in test planning test case design and test execution strategies.
- Data Visualization:
- Ability to visualize data using tools such as Tableau Power BI or matplotlib in Python.
- Present test results and insights clearly to stakeholders.
- Version Control Systems:
- Proficiency in using version control systems like Git for managing code and test data artifacts.
- Knowledge of branching strategies and collaborative development workflows.
- Automation Tools:
- Experience with automation tools and frameworks for test data provisioning and management.
- Familiarity with CI/CD pipelines for automated testing preferably on Azure DevOps.
- Knowledge of Azure Databricks utilizing Python and Spark.
- Domain Knowledge:
- Familiarity with the retail domain or industry to design relevant test scenarios and ensure data accuracy according to domainspecific requirements.
- Communication and Collaboration:
- Effective communication skills to collaborate with crossfunctional teams including developers QA engineers and business stakeholders.
- Ability to articulate technical concepts to nontechnical audiences.
- ProblemSolving Skills:
- Strong analytical and problemsolving abilities to identify and resolve datarelated issues efficiently.
- Propose effective solutions to enhance data quality and streamline processes.
- Test Management Tools:
- Working knowledge of JIRA or similar test management tools.
Qualifications:
- 14 years of relevant experience in data testing ETL or data engineering.
- Strong proficiency in SQL Python NoSQL databases and Azure technologies.
- Knowledge of ETL tools data visualization automation frameworks and CI/CD pipelines.
- Experience with Azure Databricks and PySpark is a must.
- Immediate joiners preferred.
Why Join Us:
- Opportunity to work on cuttingedge technologies in data engineering and testing.
- Collaborative environment with crossfunctional teams.
- Competitive compensation and benefits.
etl,data management,test management,data visualization,python,nosql,automation,version control,automation tools,sql,azure,framework,pyspark