Data Architect

We are Hiring!

• 10 years of experience in data architecture and engineering.
• 4 years handson experience with Azure Databricks and Spark.
• Recent experience with Microsoft Fabric platform.
• Proficiency in SQL for querying and managing databases including skills in SELECT statements JOINs subqueries and window functions12.
• Using Python for data manipulation analysis and scripting including libraries like Pandas NumPy and PySpark
• Experience working with government stakeholders and Knowledge of federal/state compliance requirements for data handling
• Apache Spark Proficiency: Utilizing Spark for largescale data processing and analytics.

Job: Data Architect (Microsoft Fabric & Azure Databricks)
Location : Atlanta Georgia 30334
Duration: Long term Contract
Work Location & Attendance Requirements:
Must be physically located in Georgia
Onsite: Tuesday to Thursday per managers discretion

Supervises the coordination of design and security for computer databases to store track and maintain a large volume of critical business information.

Job Description:

Mandatory inperson meetings:

• All Hands
• Enterprise Applications
• Onsite meetings
• DECAL All Staff
• Work arrangements subject to managements decision
• While the intent may be a longterm tenure this position is subject to annual budget restrictions. The initial contract is through the end of this fiscal year and is anticipated to be renewed July 1st.

Key Responsibilities:

Data Architecture:

• Design endtoend data architecture leveraging Microsoft Fabrics capabilities.
• Design data flows within the Microsoft Fabric environment.
• Implement OneLake storage strategies.
• Configure Synapse Analytics workspaces.
• Establish Power BI integration patterns.

Integration Design:

• Architect data integration patterns between IES Gateway and the analytics platform using Azure Databricks and Microsoft Fabric.
• Design Delta Lake architecture for IES Gateway data.
• Implement medallion architecture (Bronze/Silver/Gold layers).
• Create realtime data ingestion patterns.
• Establish data quality frameworks.

Lakehouse Architecture:

• Implement modern data lakehouse architecture using Delta Lake ensuring data reliability and performance.

Data Governance:

• Establish data governance frameworks incorporating Microsoft Purview for data quality lineage and compliance.
• Implement rowlevel security.
• Configure Microsoft Purview policies.
• Establish data masking for sensitive information.
• Design audit logging mechanisms.

Pipeline Development:

• Design scalable data pipelines using Azure Databricks for ETL/ELT processes and realtime data integration.

Performance Optimization:

• Implement performance tuning strategies for largescale data processing and analytics workloads.
• Optimize Spark configurations.
• Implement partitioning strategies.
• Design caching mechanisms.
• Establish monitoring frameworks.

Security Framework:

• Design and implement security patterns aligned with federal and state requirements for sensitive data handling.

Required Qualifications:

Education:

• Bachelors degree in computer science or related field.

Experience:

• 6 years of experience in data architecture and engineering.
• 2 years handson experience with Azure Databricks and Spark.
• Recent experience with Microsoft Fabric platform.

Technical Skills:

Microsoft Fabric Expertise:

• Data Integration: Combining and cleansing data from various sources.
• Data Pipeline Management: Creating orchestrating and troubleshooting data pipelines.
• Analytics Reporting: Building and delivering detailed reports and dashboards to derive meaningful insights from large datasets.
• Data Visualization Techniques: Representing data graphically in impactful and informative ways.
• Optimization and Security: Optimizing queries improving performance and securing data
• Azure Databricks Experience:
• Apache Spark Proficiency: Utilizing Spark for largescale data processing and analytics.
• Data Engineering: Building and managing data pipelines including ETL (Extract Transform Load) processes.
• Delta Lake: Implementing Delta Lake for data versioning ACID transactions and schema enforcement.
• Data Analysis and Visualization: Using Databricks notebooks for exploratory data analysis (EDA) and creating visualizations.
• Cluster Management: Configuring and managing Databricks clusters for optimized performance. (Ex: autoscaling and automatic termination)
• Integration with Azure Services: Integrating Databricks with other Azure services like Azure Data Lake Azure SQL Database and Azure Synapse Analytics.
• Machine Learning: Developing and deploying machine learning models using Databricks MLflow and other tools.
• Data Governance: Implementing data governance practices using Unity Catalog and Microsoft Purview

Programming & Query Languages:

• SQL: Proficiency in SQL for querying and managing databases including skills in SELECT statements JOINs subqueries and window functions12.
• Python: Using Python for data manipulation analysis and scripting including libraries like Pandas NumPy and PySpark
• Data Modeling:
• Dimensional modeling
• Realtime data modeling patterns

Soft Skills:

• Strong analytical and problemsolving abilities
• Excellent communication skills for technical and nontechnical audiences
• Experience working with government stakeholders
• Preferred Experience:
• Azure DevOps
• Infrastructure as Code (Terraform)
• CI/CD for data pipeline
• Data mesh architecture
• Certifications (preferred):
• Microsoft Azure Data Engineer Associate
• Databricks Data Engineer Professional
• Microsoft Fabric certifications (as they become available)
• ProjectSpecific Requirements:
• Experience designing data architectures for grant management systems
• Knowledge of federal/state compliance requirements for data handling
• Understanding of financial data processing requirements
• Experience with realtime integration patterns
• This position requires strong expertise in modern data architecture with specific focus on Microsofts data platform. The successful candidate will play a crucial role in designing and implementing scalable data solutions that enable efficient data processing and analytics for statelevel grant management and reporting systems.
• 6 years of experience in data architecture and engineering.
• Required
• 6 Years
• 2 years handson experience with Azure Databricks and Spark.
• Required
• 2 Years
• Recent experience with Microsoft Fabric platform.
• Required
• 2 Years
• Azure Databricks Experience
• Required
• 2 Years
• Proficiency in SQL for querying and managing databases including skills in SELECT statements JOINs subqueries and window functions12.
• Required
• 3 Years
• Using Python for data manipulation analysis and scripting including libraries like Pandas NumPy and PySpark

What we are:

My3Tech is an IT services firm focused on catalyzing transformational IT initiatives of its clients through deep domain knowledge technology expertise and customer commitment. A trusted longterm service provider for various state governments across both the software product development and IT Staff Augmentation. Certified Minority Business Enterprise (MBE) with over 13 years of experience. We are CMMI Level 3 Certified for both IT Development and IT Services ISO 27001:2022 certified for Information Security Management and ISO 9001:2015 certified for Quality Management Systems.