Job Title: Azure Data Engineer
Direct Client - QBE Commercial Insurance
Location: Remote
Required Experience:
Azure Data Engineer with Enterprise Data warehouse/Datamart and ETL background is a Must.
Strong Python (DataFrame, APIs, Batch processing, Data pipelines) and SQL knowledge.
Experience in Azure platform including Azure Data Lake, Data Bricks, Delta Lake (Bronze, Silver, Gold), Data Factory, Azure SQL Database
Understanding of Data modeling for Enterprise Data Warehouse ecosystems
Knowledge in Spark, and PySpark preferable.
Familiarity working in a data lake environment, leveraging data streaming, and developing data pipelines driven by events/queues
Knowledge in the Insurance domain.
Working knowledge on different file formats such as JSON, Parquet, CSV, etc.
Familiarity with data encryption, data masking
Database experience in SQL Server is preferable
Preferred experience in NoSQL databases like MongoDB
Team player, reliable, self-motivated, and self-disciplined
Capable of executing on multiple projects simultaneously within a fast-paced environment working with cross-functional teams
Qualifications:
Bachelor's degree in Information Science, Computer Science, Mathematics, Statistics or a quantitative discipline in science, business, or social science.