Senior Data Engineer
Senior Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Nines Data Engineering team is on a mission to modernise how we store consume and process data to derive value from it. Were building and managing cuttingedge pipelines applications and infrastructure handling hundreds of millions of daily events and crafting rich data models that inform business decisions at every level.
Currently were embarking on an exciting journey to migrate our legacy data pipelines and services from AWS to GCP. This is a unique opportunity for a seasoned Data Engineer to play a pivotal role in modernising our data ecosystem ensuring seamless data flow and unlocking new possibilities for innovation and growth.
As a Senior Data Engineer specialising in cloud migration youll be:
- Analysing and assessing our existing AWS data pipelines and services identifying areas for optimization and standardisation and formulating a comprehensive migration plan.
- Collaborating with product and business stakeholders to create a plan for the future state including data sources sinks and transformations
- Tracing the data lineage to understand how data moves through the system.
- Identifying underutilised assets that could be retired
Familiarity with the below areas would be beneficial:
- Designing and implementing new data pipelines and infrastructure in GCP leveraging the platforms full potential for scalability efficiency and reliability.
- Adhering to Nines data standards and industry best practices ensuring our GCP environment is robust secure and primed for future growth.
- Sharing your expertise with other team members fostering a culture of continuous improvement and contributing to our collective knowledge and skill set.
Qualifications :
Technical Expertise:
- A minimum of 4 years of experience with a demonstrated track record of successfully migrating data pipelines and services from one cloud platform to another
- Experience drafting SQL and Python
- Handson experience with cloud data technologies. Wed love to see experience across AWS (Redshift Lambda Functions ECS) and GCP (BigQuery Dataproc Dataflow Composer Pub/Sub) but experience across all those technologies is not a must
ProblemSolving & Leadership:
- A strong analytical mindset a passion for tackling complex technical challenges and the ability to find creative solutions to migrationrelated issues.
- Excellent communication and interpersonal skills with the ability to lead technical discussions build consensus and work effectively with crossfunctional teams.
- Deep understanding of cloud migration strategies best practices and potential pitfalls.
Desirables
A bachelors or masters degree in computer science software engineering data engineering data science information technology or a related field.
- Experience in GCP environments.
- Deep understanding of data warehousing principles ELT processes and data modelling techniques.
- Proficiency with Airflow DAG syntax and orchestration tools like DBT.
- Experience in deploying cloud infrastructure as code (IaC) using Terraform or similar
Additional Information :
Our Commitment to Diversity and Inclusion:
At Nine we are committed to fostering a workforce that embraces all aspects of diversity and inclusion and where practices are equitable to ensure our people experience a sense of belonging. From day one youll be encouraged to bring your whole self to work and will be supported to perform at your best. Should you require any adjustments to the recruitment process in order to equitably participate we encourage you to advise us at the time of application.
We encourage applications from Aboriginal and Torres Strait Islander people people with disabilities and of all ages nationalities backgrounds and cultures.
Disclaimer: We do not accept unsolicited agency resumes and are not responsible for any fees related to unsolicited resumes.
Work rights: Please note to apply for this role you must already have the right to lawfully work and live in Australia.
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
