Senior Snowflake Data Engineer
Senior Snowflake Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Description :
Client requires the services of Software Engineer 3 hereafter referred to as Candidate(s) who meets the general qualifications of Software Engineer 3 Applications/Software Development and the specifications outlined in this document for the client.
All work products resulting from the project shall be considered works made for hire and are the property of the client and may include preselection requirements that potential Vendors (and their Candidates) submit to and satisfy criminal background checks as authorized by Texas law. client will pay no fees for interviews or discussions which occur during the process of selecting a Candidate(s).
Client requires the services of One Developer hereafter referred to as Worker who meets the general qualification of Developer 3 Emerging and the specifications outlined in this document for Health & Human Services Commission Social Services Applications team.
All work products resulting from the project shall be considered works made for hire and are the property of the HHSC. HHSC may include preselection requirements that potential Vendors (and their Workers) submit to and satisfy criminal background checks as authorized by the Texas law. HHSC will pay no fees for interviews or discussions which occur during the process of selecting a Worker(s).
- Design overall data structure ensuring that Snowflakes features (e.g. data sharing scalability secure data exchange etc.) are fully utilized to meet the business requirements.
- Create a blueprint for how data will be stored processed and accessed within the Snowflake platform.
- Perform optimization of data pipelines and workflows for performance scalability and costefficiency.
- Design ETL (Extract Transform Load) or ELT (Extract Load Transform) processes and optimize queries and data storage strategies.
- Integrate with other cloud services (e.g. AWS Azure GCP) thirdparty tools and onpremises data systems.
- Designs and implements strategies to control access to sensitive data applying encryption rolebased access control and data masking as necessary.
- Work closely with data engineers data scientists business analysts and other stakeholders to understand their requirements and ensure the Snowflake environment meets those needs.
- Monitor the performance of the Snowflake environment identifying bottlenecks and ensuring optimal query performance.
- Automate administrative tasks using Snowflake SQL and scripting languages like Python or Shell scripting.
- Preform data loading methods (bulk loading using COPY INTO Snowpipe for realtime ingestion and External tables).
- Perform Snowflake cloning capabilities for databases and schemas.
- Perform configuration and management of Snowflake Virtual Warehouses including scaling resizing and autosuspend/resume settings.
- Implement roles and privileges for managing secure access utilizing Snowflake RBAC (RoleBased Access Control)
- Integrate Snowflake SSO (Single SignOn) and SCIM (System for Crossdomain Identity Management) for secure access and identity management.
- Configure alerts and monitor data pipeline failures resource spikes and cost thresholds.
CANDIDATE SKILLS AND QUALIFICATIONS
- Experience with data modeling data integration data warehousing data governance and data security Required8Years
- Experience with Oracle and/or PostgreSQL in HA deployments and Expertise in data storage Required8Years
- Proficiency in Snowflake architecture and its components. Required8Years
- Handson experience with Snowflake objects such as Databases Procedures Tasks and Streams. .Required8Years
- Expertise in using Snowflakes cloning capabilities for databases and schemas. Required8Years
- Proven experience in managing Snowflake Warehouses and optimizing performance for efficient query execution. Required8Years
- Proficiency in Snowflake RBAC (RoleBased Access Control) including implementation of roles and privileges. Required8Years
- Experience with integrating Snowflake SSO (Single SignOn) and SCIM (System for Crossdomain Identity Management) for secure access and identity management. Required8Years
- Experience working with data integration tools like Informatica and ADF for seamless ETL/ELT processes. Required8Years
- Ability to automate administrative tasks using Snowflake SQL and scripting languages like Python or Shell scripting. Required8Years
- Expertise in monitoring and troubleshooting Snowflake environments including usage tracking and query profiling. Required8Years
- Strong understanding of Snowflakes security features such as data masking encryption and network policies. Required8Years
- Technical writing and diagramming skills including proficiency with modeling and mapping tools (e.g. Visio Erwin) and the Microsoft Office Suite (Word Excel and PowerPoint) and MS Project. Required8Years
- Experience on an agile sprint team Required8Years
- Experience with JIRA software Required8Years
- Experience working with multiple teams concurrently being able to prioritize and complete work on time with high quality Required8Years
- Knowledge of Informatica 10.5 Required8Years
- Developing reports in Cognos Analytics 11.1 Required8Years
- Familiarity with CI/CD pipelines and version control for managing Snowflake code deployments. Preferred 5Years
- Prior experience in the Healthcare Industry Preferred 5Years
- Prior experience with an HHS agency Preferred 5Years
- Prior experience working with PII or PHI data Preferred 5Years
- Prior experience working with HL7 data Preferred 5Years
- Prior experience with Azure Preferred 5Years
- Bachelors degree in computer science Information Systems or Business or equivalent experience. Preferred 4Years
Employment Type
Full Time
