Job Title: Data Engineering
Location: Seattle WA
Duration: 8 months
Term: Contract
Job Description:
Experience Desired: 10 Years.
Qualification:
- Develop optimize and maintain data pipelines using Azure Data Factory (ADF) DBT Labs Snowflake and Databricks.
- Develop reusable jobs and configurationbased integration framework to optimize development and scalability.
- Manage data ingestion for structured and unstructured data (landing/lake house: ADLS Sources: ADLS Salesforce Sharepoint Documents Libraries Partner Data: DHS IHME WASDE etc.).
- Implement and optimize ELT processes sourcetotarget mapping and transformation logic in DBT Labs Azure Data Factory Databricks Notebook Snow SQL etc.
- Collaborate with data scientists analysts data engineers report developers and infrastructure engineers for endtoend support.
- Codevelop CI/CD best practices automation and pipelines with Infrastructure engineers for code deployments using GitHub Actions.
- Bring in automation from sourcetotarget mappings to data pipelines and data lineage in Collibra.
Key Skills:
Azure Data Factory (ADF) DBT Labs SnowflakeDatabricks SQL