Key Skills & Technologies:
Data Warehousing
- Understanding of data warehousing concepts
- Experience with tools like BigQuery for storing and querying large datasets.
ETL (Extract Transform Load)
- Proficiency in designing and implementing ETL pipelines using tools like Dataflow
- Apache Beam or Cloud Composer
Programming Languages
- Strong programming skills in languages such as Python Java or Scala for building data pipelines and performing data manipulation tasks.
Database Management
- Knowledge of database systems particularly BIg Query Google Cloud SQL Cloud Spanner
Data Modeling
- Ability to design and implement data models for efficient storage and retrieval of data
Google Cloud Services
- GCP services such as Pub/Sub for messaging Cloud functions etc
- Data Catalog for metadata management
- Data Studio for data visualization
Version Control and Code deployment
- Familiarity with version control systems like Git for managing code
- GitHub Actions