Google Cloud Data Engineer - Senior ociate

Google Cloud Data Engineer - Senior Associate

Job Description & Summary


Support PwC in implementing data platforms and delivering data warehouse migration projects to Google Cloud. Discover and analyze legacy ETL processes and data pipelines and transform them to Google Cloud based data pipelines using corresponding Google Cloud tools like Data Fusion, DataForms, Dataflow, etc. Ensure data lineage and data governance requirements are implemented and support decision making for target data architectures and the tool chain on Google Cloud. Collaborate with the team of data engineers, architects and analysts to ensure high quality solutions and success of client projects. The ideal candidate is experienced in migrating Teradata to BigQuery.

Background:

• Experienced in designing and building ETL processes, data pipelines and data transformations on Google Cloud

• Experienced in migrating data pipelines, schemata and data from legacy solutions (e.g. AbInitio) to Google Cloud baked solutions
• Experienced in discovery and assessment of legacy ETL processes using corresponding tools (e.g. Datametica, IBM, Informatica)
• Proven track record of migrating large data warehouses to BigQuery
• Experienced in scheduling, monitoring, validating and error handling for data migrations to BigQuery
• Extensive knowledge in relevant Google Cloud tools like Data Fusion, Dataflow, Dataproc etc and other relevant ingestion solutions like Kafka
• Experienced in implementing data pipelines with SQL, Python, Java and other relevant programming languages
• Extensive knowledge about performance and cost optimization in BigQuery, typical challenges and pitfalls in these areas when migrating from legacy data warehouses to BigQuery.
• Target Projects: Large data warehouse migrations and optimization to Google Cloud, implementing modern data concepts on Google Cloud