We are looking for a Data Engineer with strong skills in Python and SQL to join our team in Warsaw Poland. The ideal candidate will have experience in developing data pipelines managing large datasets and working with ETL processes.
Tasks
- Data Pipeline Development: Design build and maintain data pipelines to support business intelligence and analytics.
- ETL Processes: Develop and manage ETL processes to extract transform and load data efficiently.
- Data Modeling: Create and maintain data models and schemas for data integration and reporting.
- Data Quality: Ensure data quality integrity and consistency across various sources.
- Collaboration: Work closely with crossfunctional teams to understand data requirements and deliver effective solutions.
- Optimization: Optimize database queries and data pipelines for performance and scalability.
- Documentation: Document data processes workflows and pipelines for clarity and maintainability.
Requirements
- Proficiency in Python for data manipulation and pipeline development.
- Strong SQL skills for querying and managing relational databases.
- Experience with data warehousing solutions and ETL tools.
- Experience: 5 years of experience in data engineering with a focus on handling large datasets in an enterprise environment.
- Education: Bachelors degree in Computer Science Engineering Mathematics or a related field or equivalent work experience.
- Familiarity with cloud platforms like AWS Azure or Google Cloud.
- Knowledge of big data technologies such as Hadoop or Spark.
- Experience with Cassandra Airflow or similar tools is a plus.
- Strong analytical and problemsolving skills.
- Excellent communication skills and the ability to work independently and within a team.