Middle Data Engineer

A little bit about us!At Snoonu, we hold the belief that technology has the power to make anything possible.Our Vision: to be the first Qatari Super App that propels the region and its community through innovation and technology. We envision a global expansion where what we do surpasses norms and limitations every time.Our Mission: To radically transform how people live by leveraging technology to connect them with endless possibilities.Values We Live ByBe Customer Obsessed - “Focus on the customer and all else will follow.”Act with Integrity - “We are honest, ethical, and trustworthy in everything we do.”Be Curious and Creative - “We constantly innovate and create solutions to bring a lasting positive impact.”Lead by Example and Take Ownership - “Be the change you want to see and take ownership.”Hustle and Deliver Results - “You can do more by doing less, better, and faster.”It's all about people - “Be a Team player, together we are stronger.”Position OverviewWe look for experienced engineer to join our everyday activity and platform development. Main responsibilities will include creating pipelines with complex ETL logic, making performance optimizations, investigating cases in collaboration with BI and Data Science team. Our workflow emphasizes adaptability, collaboration, and focus on delivering value to customers and teammates. We look at the entire development process and optimize it as a whole, involving a culture of continuous platform and personal improvement.Skills RequiredPython programming skills, with a focus on code reuse, parallelization, and ensuring reliable pipeline functionalitySkills in workflow management frameworks (Airflow) with the ability to define and run complex DAGs.Extensive SQL skills, including DML and DDL (ALTER TABLE, GENERATE_ARRAY, LEAD, ...) and query performance optimizationPySpark knowledge for ad-hoc Spark jobs, window functions, and Spark SQL for aggregate and join operationsUnderstanding of Data Warehousing and Data Lake concepts, dimensional approach, ability to follow appropriate indexing, partitioning, and other optimizations to support efficient data retrieval2+ years of experience with cloud providers or proficiency in using Databases/Cloud Storage APIsResponsibilitiesCreate new batch/streaming pipelines for newly appearing databasesParticipating in integrated storage layer creation, investigating linkage between servicesImprove/expand pipelines with new tables or fields according to business requestsParticipate in technical debt management, redefine tables partitioning, create summarised tables and proceed migration, create metadataUse SQL and business context understanding skills to help engineers, BI analysts, and product managers get insightsOur StackGCP platformBigQueryDatabricksAWS streaming servicesTableau, Redash Benefits100% remote work with ability to work from office in the countries where we have offices - Qatar, Kazakhstan, Tajikistan Free courses and and personal growth activitiesThe opportunity for growth in a mission-driven, well-funded and already profitable start-upCultural enrichment interacting with Teammates from more than 50+ countries