Sr Azure Data Bricks Engineer

Eastern Analytics Inc.is seeking a talented Senior Azure Databricks Data Engineer to join our expanding Analytics consulting team. As a Senior Data Engineer you will work closely with the Project Lead Business Partners and Stakeholders to translate business requirements into scalable highperformance pipelines models and transformations.

Candidates should be experienced in a range of Azure technologies including Azure Data Factory (ADF) Databricks Python SQL and more.

Position Details:

Location:Remote (Candidates residing in the Continental U.S. only)

Duration:Contract 9/12 months with potential for extension

Responsibilities:

In this role you will be responsible for:

Collaborating with Stakeholders and the Analytics team to analyze business requirements and estimate development efforts.

Designing and implementing efficient pipelines using Azure Data Factory and transformations using Databricks SQL and PySpark/Python

Developing complex ETL processes using Databricks/SQL/PySpark to transform and process large datasets.

Create pipelines for data ingestion from various sources including web APIs ADLS DB connections etc.

Utilizing Azure Data Factory to orchestrate schedule and manage data workflows.

Collaborating with the Data Engineering team to ensure data quality accuracy and availability.

Conducting testing troubleshooting and performance tuning of pipelines and transformations.

Ensuring the timely and successful delivery of data solutions.

Qualifications:

6 years of experience as a Data Engineer with a strong focus on ADF Databricks SQL and PySpark.

Proficiency in SQL/Python for data transformation manipulation and efficient data pipelines.

Solid understanding of database management systems ETL frameworks and data warehousing concepts.

Experience with Azure services such as Data Factory SQL Database Key Vault and Databricks on Azure.

Handson experience with Azure Databricks data modeling medallion layers

Expertise in relational databases (Microsoft SQL Server MySQL Oracle) SQL development and data transformations on large datasets.

Working knowledge of diverse data sources including Finance/Sales/Marketing others

Strong data modeling skills.

Excellent verbal and written communication skills.

Legal work authorization in the U.S. without the need for sponsorship.

Preferred Skills:

Experience working with Big Data sources and processing.

Knowledge of Data Build Tool (DBT) for advanced data transformation and analytics.

*At this time we cannot sponsor applicants for work visas.