Role: Data Engineer/Architect
Duration: 9 months
Location: Scottsdale AZ office potentially 2 3 days in the other remote.
Key Responsibilities: - Performs validation on incoming data files resolves data quality issues and coordinates preventative corrective actions with the appropriate vendors or internal teams when errors are present.
- Designs programmatic methods (automation) to ingest clean process test and serve data to the business. The BI Engineer designs and implements methods for improving data processing accuracy and reporting.
- Investigates and diagrams data processes identifies opportunities for improvement recommends and engineers a solution within Azure (Data Factory ETL Notebooks (Python & SQL) One Lake and deployment pipeline semantic layer design).
- Works closely with the business to understand informational needs and to model consumption layer data.
- Takes a continuous learners approach to maintaining industry knowledge and technical skillset.
- Journals work assignments for the benefit of team knowledge management.
- Upholds data governance by journaling all data asset information within Microsoft Purview (Azure).
- Assists with executing and delivery of operational reporting as needed.
Position Requirements: |
- A curious data collector obsessed with data quality and reliability.
- An enthusiastic initiativetaker and team player who can work collaboratively.
- A strong analytical and organized problemsolver.
- A patient communicator who enjoys data modelling and analysis.
- Experienced professional who prototypes and designs creative BI solutions.
- Understands the critical role of documentation and journaling work performed.
Qualifications: - Bachelors degree in Statistics Data Analytics Business Intelligence or a STEM related field; related work experience can be substituted for educational requirement.
- Clear understanding of Azure database design and physical database structures.
- 5 years in ETL design using Azure Data Factory Spark notebooks (Python & SQL are essential).
- 5 years of prior experience preferably within the insurance industry.
- 5 years writing complex SQL queries for SQL Server
- Experience with Microsoft Fabric is preferred.
- Prior experience in Microsoft Azure cloudbased data warehouse implementations is preferred.
- Experience detailing business process and data flow process diagrams in MS Visio identifying opportunities and recommending solutions for opportunities identified.
|