Data Engineer Lead or Architect Onsite - Dallas TX
Data Engineer Lead or Architect Onsite - Dallas TX
Posted on :
20-09-2024
Employer Active
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Monthly Salary
Not Disclosed
Salary Not Disclosed
Posted on :
20-09-2024
Job Description
Position : Data Engineer Lead or Architect
Location : Dallas TX
Visa : USC and GC only
Responsibilities:
Architect and Design Data Solutions: Lead the design and architecture of scalable data solutions leveraging Azure Cloud services Microsoft Fabric and Snowflake.
Data Pipeline Development: Build and maintain data pipelines integrating data from a variety of sources using Azure Data Factory Databricks and other ETL tools.
Data Warehousing: Design and implement data warehousing solutions in Snowflake ensuring data integrity security and high performance.
Cloud Management: Oversee the management of cloud infrastructure on Microsoft Azure ensuring best practices in security scalability and cost optimization.
Collaboration with Teams: Work closely with data scientists business analysts and application developers to ensure seamless integration of data solutions.
Monitoring and Optimization: Monitor data systems for performance issues and proactively optimize queries storage and compute resources.
Data Governance: Implement and enforce best practices for data governance security and quality across cloud and onpremise environments.
Mentorship: Lead mentor and provide technical guidance to junior engineers and team members.
Automation: Automate deployment and scaling of infrastructure using Azure DevOps and CI/CD pipelines.
Documentation: Ensure thorough documentation of data architecture data flows and data transformations.
Required Skills:
Azure Expertise: Strong experience with Microsoft Azure (Data Factory Azure SQL Synapse Analytics Data Lake etc.).
Microsoft Fabric: Handson experience with Microsoft Fabric and its data integration capabilities.
Snowflake: Extensive experience designing developing and optimizing data warehouses on Snowflake.
ETL/ELT Tools: Proficiency in ETL tools such as Azure Data Factory Databricks or SSIS.
Programming Skills: Proficiency in SQL Python and Spark for data processing and transformation.
CI/CD: Experience with CI/CD pipelines using Azure DevOps or GitHub Actions.
Data Governance: Knowledge of data governance frameworks including data quality metadata management and security.
Team Leadership: Proven experience leading data engineering teams or projects.
Cloud Security: Understanding of cloud security compliance and privacy standards in data solutions.
Preferred Skills:
Experience with Azure Synapse Analytics.
Knowledge of Azure Purview or similar data governance tools.
Familiarity with Kubernetes and containerization technologies.
Agile Methodology: Experience working in an Agile environment.
Certification in Azure or Snowflake (e.g. Azure Data Engineer Associate Snowflake SnowPro).
Education:
Bachelors degree in Computer Science Information Technology or related field (Masters preferred)
Employment Type
Full Time
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
