Data Engineer II

Data Engineer

Job brief

We are looking for the right individual to embrace the opportunity to tackle challenging problems and use their influence to drive continual improvement. You will use various methods to transform raw data into useful data systems. For example youll create algorithms and conduct statistical analysis. Overall youll strive for efficiency by aligning data systems with business goals.

To succeed in this data engineering position you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine methods.

Responsibilities

Analyse and organize raw data

Build data systems and pipelines

Evaluate business needs and objectives

Interpret trends and patterns

Conduct complex data analysis and report on results

Prepare data for prescriptive and predictive modelling

Build algorithms and prototypes

Combine raw information from different sources

Explore ways to enhance data quality and reliability

Identify opportunities for data acquisition

Develop analytical tools and programs

Collaborate with data scientists and architects on several projects

Requirements and skills

Previous experience as a data engineer or in a similar role

GCP experience is a must for this role

Experience with Big query GCS Dataflow and other tools and techniques used for building pipeline is a must

Good hands on experience in programming languages (e.g. Java and Python)

Technical expertise with data models data mining and segmentation techniques

Handson experience with SQL and NoSQL database design

Great numerical and analytical skills

GCP Data engineering certification is a plus