Senior Azure Databricks Data Engineer

Eastern Analytics, Inc. is seeking a talented Senior Azure Databricks Data Engineer to join our expanding Analytics consulting team. As a Senior Data Engineer, you will work closely with the Project Lead, Business Partners, and Stakeholders to translate business requirements into scalable, high-performance pipelines, models, and transformations. 

Candidates should be experienced in a range of Azure technologies, including Azure Data Factory (ADF), Databricks Python, SQL and more. 

Position Details: 

Location: Remote (Candidates residing in the Continental U.S. only) 

Duration: Contract - 6-9 months with potential for extension 

Responsibilities: 

In this role, you will be responsible for: 

• Collaborating with Stakeholders and the Analytics team to analyze business requirements and estimate development efforts. 

• Designing and implementing efficient pipelines using Azure Data Factory and transformations using Databricks SQL and PySpark/Python 

• Developing complex ETL processes using Databricks/SQL/PySpark to transform and process large datasets. 

• Create pipelines for data ingestion from various sources, including web APIs, ADLS, DB connections etc. 

• Utilizing Azure Data Factory to orchestrate, schedule, and manage data workflows. 

• Collaborating with the Data Engineering team to ensure data quality, accuracy, and availability. 

• Conducting testing, troubleshooting, and performance tuning of pipelines and transformations. 

• Ensuring the timely and successful delivery of data solutions. 

Qualifications: 

• 6+ years of experience as a Data Engineer with a strong focus on ADF, Databricks SQL, and PySpark. 

• Proficiency in SQL/Python for data transformation, manipulation, and efficient data pipelines. 

• Solid understanding of database management systems, ETL frameworks, and data warehousing concepts. 

• Experience with Azure services such as Data Factory, SQL Database, Key Vault, and Databricks on Azure. 

• Hands-on experience with Azure Databricks data modeling + medallion layers 

• Expertise in relational databases (Microsoft SQL Server, MySQL, Oracle), SQL development, and data transformations on large datasets. 

• Working knowledge of diverse data sources including Finance/Sales/Marketing others 

• Strong data modeling skills. 

• Excellent verbal and written communication skills. 

• Legal work authorization in the U.S. without the need for sponsorship. 

Preferred Skills: 

• Experience working with Big Data sources and processing. 

• Knowledge of Data Build Tool (DBT) for advanced data transformation and analytics. 

Eastern Analytics, Inc. is an equal-opportunity employer and promotes an environment of Diversity, Equity, and Inclusion. 

We provide our team members with competitive pay and benefits of health and dental insurance, 401(k) retirement savings paid vacations, paid personal and sick time, and paid holidays. 

Don’t meet every single requirement? Know that we are dedicated to building a diverse and inclusive team. So, if you’re excited about this role but your past experience doesn’t align perfectly with the job description, we encourage you to apply anyway. 

*At this time, we cannot sponsor applicants for work visas.