Senior Data Engineer

This is a remote position.

Mavent Analytics has been engaged by our client to find their next senior data engineer.

This role is remote anywhere in the US (preference for the Midwest). The role will require travelling to our clients headquarters near Des Moines IA every 10 weeks. Travel accommodation will be covered by our client.

Your Mission

• Lead development and maturity of data engineering and DataOps; identify and evaluate current process gaps prioritize improvements and incrementally build an efficient and stable environment
  
• Guide on/offshore team members in adoption of data engineering best practices for Azure cloud and design automation of data pipelines and CI/CD approaches
  
• Independently set up the Azure / Databricks environment including configuration of tools and security
  
• Leverage Synapse to drive data integration and transformation across many disparate systems
  
• Collaborate with data and solution architects to implement Microsoft Azure cloud data engineering best practices
  
• Partner with finance S&OP and marketing stakeholders to understand use cases and align data engineering approaches that efficiently and accurately support enterprise reporting and analytics BI and data science initiatives
  
• Work closely with existing team members to understand and manage data engineering operational and transactional data needs while providing support to end user analytical needs
  
• Operate on Agile / product teams as the primary data engineer building data pipelines and supporting analytics and data science needs
  

Whats in it for you

• Opportunity to drive and influence data engineering modernization approaches
  
• The leader you would report to in this role is collaborative and technically sound; he is highly supportive of personal and professional goals
  
• Our client has a strong culture and values system they walk the talk and are fully invested in their people
  
• Privately held organization with strong support and investment into the business without the redtape of many corporate environments
  
• Multibilliondollar company planning to double revenue over the next five years; operates like a mature startup environment
  

Required education and experience

• BS degree in Computer science software engineering data engineering or related analytical or STEM field
  
• 5 years of progressive industry data engineering experience able to contribute at the architecture level but willing to provide daytoday operational support
  
• Expertise in Microsoft Azure cloud technologies including Synapse Databricks and Delta Lake with proficiency in SQL Python Spark Agile
  
• Experience participating in modernization of data engineering environments; must have experience setting up multiple instances of Azure / Databricks
  
• Exposure to building CI/CD operating practices
  
• Depth in building data pipelines from disparate systems that feed Databricks tables
  
• Demonstrated experience collaborating with other team members to develop data engineering approaches; develop data models and data pipelines that support a variety of data products
  
• Expertise in setting up and building data pipelines in Azure / Databricks; experience supporting both operational reporting needs and data science ML/AI initiatives
  
• Depth and breadth of experience in Microsoft Azure cloud platform and ecosystem
  
• Troubleshooting existing data pipelines with little to no direction; must be resourceful and able to plan and execute projects independently
  
• Must have strong business and technical acumen with exceptional problem solving skills
  
• Mentoring and coaching experience of less experienced data engineers in Microsoft Azure data engineering best practices
  
• Competency in developing testdriven development approaches that improve overall data quality and integrity
  

Preferred education and experience

• MBA or MS degree
  
• Exposure to R Scala CI/CD MLOps PowerBI Informatica for MDM Prophecy graph data Salesforce manufacturing IoT SAFe Agile
  
• Experience supporting data needs for finance S&OP and marketing leaders
  

*Mavent Analytics and our client engages in ways that embrace diversity of race ethnicity culture gender identity age sex disability and experience

Requirements

• BS degree in Computer science software engineering data engineering or related analytical or STEM field
  
• 5 years of progressive industry data engineering experience able to contribute at the architecture level but willing to provide daytoday operational support
  
• Expertise in Microsoft Azure cloud technologies including Synapse Databricks and Delta Lake with proficiency in SQL Python Spark Agile
  
• Experience participating in modernization of data engineering environments; must have experience setting up multiple instances of Azure / Databricks
  
• Exposure to building CI/CD operating practices
  
• Depth in building data pipelines from disparate systems that feed Databricks tables
  
• Demonstrated experience collaborating with other team members to develop data engineering approaches; develop data models and data pipelines that support a variety of data products
  
• Expertise in setting up and building data pipelines in Azure / Databricks; experience supporting both operational reporting needs and data science ML/AI initiatives
  
• Depth and breadth of experience in Microsoft Azure cloud platform and ecosystem
  
• Troubleshooting existing data pipelines with little to no direction; must be resourceful and able to plan and execute projects independently
  
• Must have strong business and technical acumen with exceptional problem solving skills
  
• Mentoring and coaching experience of less experienced data engineers in Microsoft Azure data engineering best practices
  
• Competency in developing testdriven development approaches that improve overall data quality and integrity
  

Benefits