DECAL Data Architect Microsoft Fabric Azure Databricks
DECAL Data Architect Microsoft Fabric Azure Databricks
Posted on :
04-12-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Supervises the coordination of design and security for computer databases to store track and maintain a large volume of critical business information.
Skill Required /Desired Amount of Experience Candidate Experience 6 years of experience in data architecture and engineering. Required 6 2 years handson experience with Azure Databricks and Spark. Required 2 Recent experience with Microsoft Fabric platform. Required 2 Azure Databricks Experience Required 2 Proficiency in SQL for querying and managing databases including skills in SELECT statements JOINs subqueries and window functions12. Required 3 Using Python for data manipulation analysis and scripting including libraries like Pandas NumPy and PySpark Required 3 Questions No. Question Candidate Answer Question1 Absences greater than two weeks MUST be approved by CAI management in advance and contact information must be provided to CAI so that the resource can be reached during his or her absence. The Client has the right to dismiss the resource if he or she does not return to work by the agreed upon date. Do you agree to this requirement Question2 What is your candidates email address Question3 This assignment is contingent upon customer renewal and availability of adequate funding. Do you agree to this requirement Question4 If selected for engagement your candidate will be expected to start no later than 2 weeks (10 business days) after the clients selection date Do you agree to this requirement
The Department of Early Care & Learning (DECAL) is seeking an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks for integration with statelevel systems. This role will focus on creating scalable data architecture that enables seamless data flow between IES Gateway and our analytics platform. The ideal candidate will have deep expertise in modern data architecture with specific experience in Microsofts data platform and Delta Lake architecture.
Must be physically located in Georgia
Mandatory inperson meetings:
oEnterprise Applications
oDECAL All Staff
Key Responsibilities:
Design endtoend data architecture leveraging Microsoft Fabrics capabilities.
Implement OneLake storage strategies.
Establish Power BI integration patterns.
Architect data integration patterns between IES Gateway and the analytics platform using Azure Databricks and Microsoft Fabric.
Implement medallion architecture (Bronze/Silver/Gold layers).
Establish data quality frameworks.
Implement modern data lakehouse architecture using Delta Lake ensuring data reliability and performance.
Data Governance:
Implement rowlevel security.
Establish data masking for sensitive information.
Pipeline Development:
Performance Optimization:
Optimize Spark configurations.
Design caching mechanisms.
Security Framework:
Required Qualifications:
Bachelors degree in computer science or related field.
6 years of experience in data architecture and engineering.
Recent experience with Microsoft Fabric platform.
Microsoft Fabric Expertise:
Data Pipeline Management: Creating orchestrating and troubleshooting data pipelines.
Data Visualization Techniques: Representing data graphically in impactful and informative ways.
Azure Databricks Experience:
Data Engineering: Building and managing data pipelines including ETL (Extract Transform Load) processes.
Data Analysis and Visualization: Using Databricks notebooks for exploratory data analysis (EDA) and creating visualizations.
Integration with Azure Services: Integrating Databricks with other Azure services like Azure Data Lake Azure SQL Database and Azure Synapse Analytics.
Data Governance: Implementing data governance practices using Unity Catalog and Microsoft Purview
Programming & Query Languages:
Python: Using Python for data manipulation analysis and scripting including libraries like Pandas NumPy and PySpark
Dimensional modeling
Soft Skills:
Excellent communication skills for technical and nontechnical audiences
Preferred Experience:
Infrastructure as Code (Terraform)
Data mesh architecture
Microsoft Azure Data Engineer Associate
Microsoft Fabric certifications (as they become available)
Experience designing data architectures for grant management systems
Understanding of financial data processing requirements
This position requires strong expertise in modern data architecture with specific focus on Microsofts data platform. The successful candidate will play a crucial role in designing and implementing scalable data solutions that enable efficient data processing and analytics for statelevel grant management and reporting systems.
Required/Desired Skills
Employment Type
Full Time
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
