DTP Digital Transformation Program Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
- Contract period: 01 October 2024 till 30 June 2025
- Location: ACT
- Must have Baseline
- Working arrangements: Onsite at least 3 days a week and mandatory allday face to face team meeting once a fortnight
About the Role:
SoftLabs is seeking Data Engineers with strong experience in developing Extract Transform Load (ETL) and Extract Load Transform (ELT) processes and /or the development of data products and complex data visualisations at their technology consulting based in Canberra.
Responsibilities:
The role will be responsible for design development and unit testing activities across several data movement data transformation and data visualisation processes within DAFF. The data movement and transformation processes focus on the preparation of data for use in decision making processes across the department utilising modern cloud technology (Azure) to enable operational analytics use cases.
The successful candidate will require experience with the following techniques and technologies:
MS Azure Stack Data Integration Data Factory SQL Server Integration Services and/or Databricks Logic App and/or Function App Data Store SQL Server and/or Data Lake Storage Unity Catalog (Medallion Architecture) Analytics Azure Databricks Azure Machine Learning ArcGIS Enterprise Development tools DevOps Visual Studio VS Code Data technology solutions sourcing (Flat file Ingres Azure SQL Server)collecting ingesting and storing. SQL Python R .NET Data Preparation Transformation of data into formats tailored to analytics use cases Parquet and/or Delta and Data visualisation. Analyse and interpret complex data sets and to identify trends and patterns. Design principles to create appropriate visualisations for target audience. Visualisation tools Power BI
Essential Criteria:
1. Demonstrated experience developing ETL/ELT processes for complex and/or large data movement transformation and/or visualisations particularly in a cloud environment.
2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark) Azure SQL Python R
3. Experience working with Engineering Storage and Analytics services in cloud infrastructure.
4. Experience working collaboratively in an agile development team.
Application Deadline: Wednesday 11 September 2024
Expected Start Date: Tuesday 01 October 2024
Job Type: Contract
Rate: As per Australian Market Standards
If you are interested in this position please click Apply with your resume in WORD and send your details for review. If you wish to have a confidential discussion call us onorfor more information
Employment Type
Full Time
