Senior DataBricks Engineer ETL with Python

Who we are:

Artmac Soft is a technology consulting and serviceoriented IT company dedicated to providing innovative technology solutions and services to the Customers.

Job Description:

Job Title : Senior DataBricks Engineer ( ETL ) with Python

Job Type : C2C/W2/1099

Experience : 8 to 15 years

Location : Boston Massachusetts

Responsibilities:

• 8 years of experience in ETL data engineering on Databricks.
• Proficiency in the design and build of data pipelines for sourcing staging and publishing data using Databricks in Azure or AWS.
• Strong ETL development skills and experience with data integration tools.
• Knowledge of data modeling data warehousing and data transformation techniques.
• Familiarity with data quality and data governance principles.
• Strong problemsolving and troubleshooting skills.
• Excellent communication and teamwork skills with the ability to collaborate with technical and nontechnical stakeholders.
• Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and storage solutions to ensure optimal performance.
• Documentation: Create and maintain comprehensive documentation for data pipelines architecture and best practices.
• Collaboration: Collaborate with crossfunctional teams including data scientists and analysts to understand data requirements and deliver highquality data solutions.
• Automation: Implement automation processes and best practices to streamline data workflows and reduce manual interventions.