Job Title: Azure Cloud Engineer
Location: Phoenix AZOnsite
Duration: / Term: 6 months Contract
Job Description:
- Develop and maintain data pipelines to ingest transform and load data from various sources.
- Design and manage scalable data lakes to support comprehensive data storage and analysis needs.
- Design retention lifecycle archival policies for datasets
- Work with Azure Data Lake Storage to efficiently store and manage large datasets.
- Create and manage data models and data warehouses to support business intelligence and analytics needs.
- Set up and manage external tables and integrate with various data sources.
- Utilize Delta Lake for optimized data storage and realtime analytics capabilities.
- Develop and deploy interactive and visually compelling reports and dashboards using Power BI.
- Utilize Azure Databricks for advanced data processing.
- Optimize and manage Azure SQL databases to ensure high performance and availability.
- Implement CI/CD pipelines using Azure DevOps to streamline development and deployment processes.
- Ensure data security and compliance with relevant regulations and best practices (eg: NIST).
- Setup Azure Purview for data governance
- Experience with data integration and migration from onpremises to cloud environments.
- Proficiency in Python and experience with Python Notebooks.
- Proficiency in scripting and automation (Power Shell ARM templates Terraform
- Azure certifications (e.g. Azure Solutions Architect Azure Data Engineer) are a plus
Key Skills: Azure Cloud Data Lake Azure Databricks Azure SQL