Skip to content

Conversation with chapter lead data engineer

Focus on GCP - Woolworths currently transitioning to have main cloud service being GCP.

GCP engineer certification

Key tools DE team uses:

  • Google Cloud Storage
  • Cloud composer (key)- Google managed version of Airflow
  • Data flow (key)
  • Cloud functions (key)
  • Big Query (key) (sink 80% of the time)

Python GCS -> BigQuery

Data engineering team currently getting familiar with GCP

Sumathi to review options with Joel.

Overall sentiment

Should be able to transfer over with:

  • GCP engineer certification
  • Projects demonstrating familiarity with 4 key GCP products