Conversation with chapter lead data engineer
Focus on GCP - Woolworths currently transitioning to have main cloud service being GCP.
GCP engineer certification
Key tools DE team uses:
- Google Cloud Storage
- Cloud composer (key)- Google managed version of Airflow
- Data flow (key)
- Cloud functions (key)
- Big Query (key) (sink 80% of the time)
Python GCS -> BigQuery
Data engineering team currently getting familiar with GCP
Sumathi to review options with Joel.
Should be able to transfer over with:
- GCP engineer certification
- Projects demonstrating familiarity with 4 key GCP products