DTP Digital Transformation Program Data Engineer
DTP Digital Transformation Program Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Requirements
The Department of Agriculture Fisheries and Forestry (DAFF) is looking for Data Engineers to join the Digital Transformation Program in the Australian Bureau of Agricultural and Resource Economics and Sciences (ABARES) to work across several data and analytics platforms. We are seeking candidates with strong experience in developing Extract Transform Load (ETL) and Extract Load Transform (ELT) processes and /or the development of data products and complex data visualisations.
The role will be responsible for design development and unit testing activities across several data movement data transformation and data visualisation processes within DAFF. The data movement and transformation processes focus on the preparation of data for use in decision making processes across the department utilising modern cloud technology (Azure) to enable operational analytics use cases.
The successful candidate will require experience with the following techniques and technologies:
- MS Azure Stack
- Data Integration Data Factory SQL Server Integration Services and/or Databricks LogicApp and/or FuncationApp
- Data Store SQL Server and/or Data Lake Storage Unity Catalog (Medallion Architecture)
- Analytics Azure Databricks Azure Machine Learning ArcGIS Enterprise
- Data Integration Data Factory SQL Server Integration Services and/or Databricks LogicApp and/or FuncationApp
- Development tools DevOps Visual Studio VS Code
- Data technology solutions sourcing (Flat file Ingres Azure SQL Server) collecting ingesting and storing
- SQL Python R .Net
- Data Preparation
- Transformation of data into formats tailored to analytics use cases Parquet and/or Delta
- Transformation of data into formats tailored to analytics use cases Parquet and/or Delta
- Data Visualisation
- Analyse and interpret complex data sets and to identify trends and patterns.
- Design principles to create appropriate visualisations for target audience.
- Visualisation tools Power BI
- Analyse and interpret complex data sets and to identify trends and patterns.
Business Modelling Business Process Improvement Business Situation Analysis Consultancy Feasibility Assessment DEED OF STANDING OFFER SONPage 3 Requirements definition and management Stakeholder Relationship Management Appropriate training in the field with requisite experience. Acceptable training includes any of the below: BABOK v3.0 Core practitioner (with extension courses desirable); or BA-Cube Pathway certifications; or Business Analysis Foundations & Business Process Modelling (LinkedIn Learning); and BPMN Fundamentals (with extension courses desirable) or equivalent.
Employment Type
Full Time
