Job Title: Apptad Senior Databricks Enterprise Solution Architect
Job Location: Remote
Job Duration: LongTerm
Job Description:
Responsibilities:
- Architecture Design: Design scalable and reliable data analytics and machine learning architectures leveraging the Databricks platform to meet business requirements and objectives.
- Platform Implementation: Implement and configure Databricks clusters workspaces notebooks and other components to support data processing analytics and model development workflows.
- Data Engineering: Develop and optimize data pipelines for ingesting processing and transforming large volumes of data from diverse sources using Databricks and related technologies.
- Data Modeling: Design and implement data models schemas and storage structures within Databricks for efficient data organization and querying.
- Machine Learning: Build and deploy machine learning models using Databricks ML frameworks and libraries and integrate them into production workflows for predictive analytics and decision support.
- Performance Optimization: Optimize Databricks jobs queries and workflows for performance scalability and costefficiency leveraging best practices and optimization techniques.
- Security and Governance: Implement security controls access management policies and data governance frameworks within Databricks to ensure data privacy compliance and regulatory requirements.
- Collaboration: Collaborate with data engineers data scientists business analysts and stakeholders to understand requirements design solutions and deliver actionable insights using Databricks.
- Documentation and Training: Document Databricks architecture design decisions configurations and best practices and provide guidance and training to team members on Databricks usage and methodologies.
- Continuous Improvement: Stay abreast of the latest developments in Databricks and related technologies evaluate new features and capabilities and recommend enhancements to optimize data analytics workflows.