Big Data Engineer
Big Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Positium produces impactful statistics that are effective and easy to use for decisionmakers around the world. We believe that through betterinformed decisions we can do our bit to improve societies around the world.
As Big Data Engineer at Positium you will be at the forefront of designing and optimising robust data pipelines that process vast datasets from mobile positioning data sources. You will work with cuttingedge big data technologies contribute to the architecture of scalable cloudbased systems and streamline data integration processes. Join our expert team in developing efficient highperforming solutions that drive meaningful insights for our global clients.
Tasks
- Design build and optimise data pipelines using big data technologies to efficiently process and integrate large datasets from mobile positioning data sources.
- Collaborate in the design and implementation of relational database schemas and ensure effective data storage and retrieval practices.
- Deploy and manage data solutions on major cloud platforms to enhance scalability and accessibility of data resources.
- Use commandline tools and shell scripting (e.g. bash Python) to automate data processing tasks and improve operational efficiency.
- Stay uptodate with the latest advancements in data engineering and big data technologies and be ready to share knowledge with colleagues.
Requirements
- BSc/MSc in Computer Science or MSc in Data Science.
- At least two years of work experience as a Data Engineer or similar.
- Proficiency in programming: working proficiency in Python and SQL. Familiarity with JavaScript for data visualisation is also beneficial.
- Databases: working experience with relational databases (preferably PostgreSQL) and familiarity with designing data models.
- Big data technologies and engineering: experience with Apache Spark for largescale data processing familiarity with Hadoop ecosystem and distributed storage solutions (e.g. S3 Azure Blob Storage MinIO). Experience in designing building and managing data pipelines. Experience in working with APIs for data sourcing integration and delivery.
- Cloud platforms: familiarity with major cloud providers and services (AWS Azure Google Cloud); work experience with at least one of them is a plus.
- Unix/Linux systems: proficient with Unix/Linux commandline tools and shell scripting (e.g. bash). Experience with system administration and automation tasks.
- Containerisation and orchestration: experience with Docker; experience with Kubernetes is a plus.
- Software development practices: familiarity with objectoriented programming (OOP) design patterns clean code practices and testing frameworks (e.g. pytest unittest). Experience using Git for version control and collaboration on platforms like GitHub and GitLab including code reviews and refactoring.
- Agile methodologies: understanding of software development life cycles and agile methodologies.
- Being a team player with great communication skills.
- Good speaking and writing skills in English.
- We expect the candidate to be located in Estonia and have a right to work here.
Additional experience that would be beneficial:
- Geospatial database experience: proficiency with spatial extensions for relational databases (e.g. PostGIS Oracle Spatial DuckDB Spatial).
- Python geospatial libraries: familiarity with Python libraries for geospatial analysis such as GeoPandas and Shapely.
- Geospatial data formats: experience handling various geospatial data formats including GeoParquet GeoJSON Shapefiles and raster data formats.
- Big geospatial data frameworks: familiarity with Apache Sedona.
- Understanding of geospatial concepts: knowledge of spatial reference systems coordinate transformations and familiarity with spatial analysis and GIS theory.
Benefits
- Working in our HQ in Tartu with an amazing view of the city (remote working is also a possibility depending on the nature of the projects).
- Flexible working hours just make sure you are available to other team members and complete your tasks on time.
- Global reach you get to be part of different client projects across the globe and a chance to travel.
- Support for your active life. Your wellbeing is important to us we provide compensation for sporting activities and taking care of your mental health so that you can feel your best every day.
- Fun team we enjoy each others company and organise regular social activities.
Positium is the only data analytics company in the world specialising in mobile positioning data for official statistics. Founded in 2003 we have nearly two decades of experience working with global clients and scientists alike. Positium develops cool GIS solutions highquality methodology software and expertise to process MPD for insights on the spatiotemporal behaviour of human beings. At Positium you will be a part of a close group of industry experts who are determined to make a positive impact on the world.
If you share our passion we invite you to apply to join Positiums datadriven mission!
Employment Type
Full Time
