Sr Data Engineer

Summary/Objective:

The Data Engineer is primarily responsible for resource designing building and maintaining our largescale data infrastructure. This includes data pipelines ensuring high data quality and accessibility for business intelligence data warehouse needs and data analytics applications. This position will collaborate with data analysts BI lead and other stakeholders to understand data requirements and design solutions to support business needs. A high level of expertise in data modeling ETL processes and database management/warehousing/data lake will be essential in ensuring the integrity and availability of our organizations data assets.

Essential Functions:

• Communicate effectively with business leads and stakeholders to shape/define project requirements and objectives.

• Design construct install test and maintain reliable and scalable data management systems including data warehouse needs.

• Develop and optimize ETL (Extract transform load) processes to ensure timely delivery of highquality data to downstream applications and analytics platforms.

• Ensure systems meet business requirements and industry best practices for data architecture and processing.

• Develop processes for data modeling and data production for downstream consumption.

• Integrate new data management technologies and processes as well as software engineering best practices into existing structures and processes.

• Create custom software components and analytics applications when necessary.

• Employ a variety of languages (primarily Python and SQL) and tools to marry systems together.

• Recommend ways to improve data reliability efficiency and quality.

• Collaborate with data architects modelers and IT team members on project goals.

• Mentor more junior data talent fostering a culture of continuous improvement in data practices.

• Actively participate with application end users and IT teams to support system upgrades new processes and initiatives.

• Advocate within project design meetings to ensure all requirements are documented and accounted for.

• Lead user acceptance testing and endtoend testing including enduser training.

• Provide monitoring and troubleshooting of integration points between the ERP system and external applications/API usage.

• Drive continuous improvement and challenge paradigms that may be barriers to progress.

• Assist in maintaining system standards security and cleanliness of incoming data.

• Advise develop and standup Allied Data Warehouse capturing data needs across business units and departments.

Required Education and Experience:

• Bachelors degree in computer science Engineering or related field; Masters degree or equivalent experience preferred.

• Advanced knowledge of SQL and experience with relational databases query authoring (SQL) as well as working familiarity with a variety of databases.

• Experience building and optimizing data pipelines architectures and data sets for analytics.

• Strong analytic skills related to working with both structured and unstructured data assets.

• Experience with modern data tools: Snowflake BigQuery dbt Airflow dagster Fivetran etc.

• Experience with cloud services: AWS Azure GCP etc.

• Strong project management and organizational skills.

• Excellent communication and collaboration skills.

Preferred Education and Experience:

• Masters degree in computer science Engineering or a related field.

• 5 years of experience in a Data Engineering role with a proven track record in a senior or leadership position.

• Experience with modern data tools: Snowflake BigQuery dbt Airflow dagster Fivetran etc.

• Experience with cloud services: AWS Azure GCP etc.