Job Summary:
We are seeking an experienced Data Engineer to join our team. As a Data Engineer you will be responsible for designing building and maintaining largescale data systems that support our business intelligence and data analytics initiatives. You will work closely with our data scientists product managers and other stakeholders to identify and prioritize data engineering projects and then design and implement solutions to meet those needs.
Key Responsibilities:
1. Design and Implement Data Pipelines: Design build and maintain largescale data pipelines that extract data from various sources transform and process the data and load it into our data warehouse and other data systems.
2. Data Warehouse Management: Design implement and manage our data warehouse and other data systems to ensure they are scalable secure and performant.
3. Data Quality and Governance: Ensure data quality and integrity by implementing data validation data cleansing and data normalization processes.
4. Collaboration and Communication: Work closely with data scientists product managers and other stakeholders to identify and prioritize data engineering projects and then design and implement solutions to meet those needs.
5. Troubleshooting and Optimization: Troubleshoot data pipeline issues and optimize data processing performance to ensure data is delivered to stakeholders in a timely and efficient manner.
6. Data Security and Compliance: Ensure data systems and pipelines are secure and compliant with relevant regulations and industry standards.
7. Staying UptoDate with Industry Trends: Stay current with emerging trends and technologies in data engineering and make recommendations for how to apply them to our business.