Overview
The Data Engineer plays a crucial role in the organization responsible for designing implementing and maintaining scalable data pipelines to support the businesss data infrastructure and analytics needs. They work closely with data scientists analysts and other stakeholders to ensure data availability integrity and usability for decisionmaking processes.
Key Responsibilities
- Design build and optimize data pipelines and ETL processes
- Develop and maintain data models and schema designs
- Implement data warehousing solutions for efficient storage and retrieval of data
- Collaborate with crossfunctional teams to understand data requirements and deliver solutions
- Optimize database performance and troubleshoot datarelated issues
- Create and maintain documentation for data processes and systems
- Ensure data quality and integrity through validation and testing
- Automate data workflows and processes for efficiency and reliability
- Support data governance and security best practices
- Stay updated with emerging technologies and best practices in data engineering
Required Qualifications
- Bachelors degree in Computer Science Engineering or a related field
- 4 years of experience in data engineering or a similar role
- Proficiency in Python SQL and other scripting languages for data manipulation
- Experience with ETL tools and processes for data integration
- Strong understanding of data modeling and database design principles
- Knowledge of data warehousing and big data technologies
- Ability to work with cloudbased data platforms such as AWS Azure or GCP
- Understanding of data governance security and compliance requirements
- Excellent problemsolving and analytical skills
- Effective communication and collaboration skills in a crossfunctional team environment
- Experience with agile development methodologies and version control systems
- Ability to multitask and prioritize workload in a fastpaced environment
- Certifications in relevant data engineering technologies or platforms is a plus
gcp,collaboration skills,etl tools,data integration,aws,analytical skills,database design principles,agile development methodologies,big data technologies,security,compliance requirements,communication skills,data modeling,sql,azure,cloud-based data platforms,version control systems,data governance,python,data warehousing,etl,data manipulation,problem-solving