Overview:
The Data Engineer is a key role in our organization responsible for developing constructing testing and maintaining architectures such as databases and largescale data processing systems. They will work closely with the data scientists data analysts and data warehouse engineers to understand and aid in the implementation of database requirements analyze performance and troubleshoot any existent issues.
Key Responsibilities:
- Design and develop reliable scalable and highperformance data pipelines to support data analytics and reporting requirements.
- Implement and maintain ETL processes to acquire integrate and distribute data across various platforms.
- Collaborate with crossfunctional teams to understand data and information needs.
- Utilize Snowflake Azure AWS Informatica and DataStage to build and optimize data solutions.
- Ensure data quality and integrity through the implementation of testing and validation processes.
- Manage and manipulate large datasets for analytical purposes.
- Develop and maintain documentation related to data processing and data flow.
- Stay current with emerging technologies and trends in big data data engineering and data processing.
- Participate in code reviews identify areas for improvement and ensure best practices are followed.
- Support data scientists and analysts by providing infrastructure and tools necessary for analysis.
Required Qualifications:
- Bachelors or Masters degree in Computer Science Information Systems or related field.
- Proven experience with Snowflake Azure AWS Informatica and DataStage.
- Proficiency in SQL Python or Java for data manipulation and analysis.
- Strong understanding of data modeling database design and data warehousing principles.
- Experience with ETL tools and processes.
- Knowledge of data management tools and data governance practices.
- Excellent problemsolving and troubleshooting skills.
- Ability to work in a fastpaced and dynamic environment.
- Excellent communication and collaboration skills.
- Experience with big data technologies and platforms is a plus.
aws,big data technologies,data modeling,informatica,data governance,datastage,sql,data,database design,python,data processing,data management,database,snowflake,java,etl,azure,data engineering,data warehousing