Sr Data Engineer

Title .. Sr Data Engineer

Location . Remote

Job Type Contract/Fulltime .. Contract

Client .. Bitwiseglobal

Job Description:

Qualifications

Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.

Proven experience as a Software Engineer, with a focus on ETL and data quality.

Proficiency in MS Azure, Databricks, and Python for ETL processes.

Strong problem-solving skills and the ability to work independently.

Excellent communication skills to collaborate with diverse teams and stakeholders.

Experience with automated testing and quality assurance methodologies This is mandatory

Knowledge of data modeling, data warehousing, and database systems is a plus.

Key Responsibilities

Lead quality initiatives within the ETL project, defining quality standards, best practices, and testing methodologies.

Continuously improve ETL processes for efficiency, scalability, and reliability, optimizing data flows, and transformations.

Independently identify and resolve complex technical issues related to data quality, performance, and data pipeline failures.

Work closely with data engineers, data scientists, and other stakeholders to understand requirements and ensure data integrity.

Develop and maintain automated testing scripts and procedures to validate data accuracy and pipeline functionality.

Create and maintain comprehensive documentation for ETL processes, configurations, and quality control procedures.

Excellent communication and presentation skills to effectively communicate information to customers and to all levels within the organization.