GCP Training Course Content
Chapter 1: Introduction to Google Cloud Platform Services
Overview of Google Cloud Platform (GCP)
GCP Console, Cloud Shell, and SDK
GCP core infrastructure components and services
Virtual networks, subnetworks, IP addresses, routes, and firewall rules
Compute Engine, App Engine, Kubernetes Engine, and Cloud Functions.
Chapter 2: Security and Access Management
Understanding projects, billing, and IAM (Identity and Access Management)
Resource hierarchy and organization policies
Roles, members, service accounts, and best practices
Security features, including encryption, access control, and compliance
Chapter 3: Data Storage and Management
Cloud Storage, Cloud Storage Bucket, Cloud SQL, Cloud Spanner, and Cloud Datastore
Data storage options, including object storage, relational databases, and NoSQL databases
Chapter 4: Networking and Application Development
Virtual Private Cloud (VPC), subnetworks, and routing
Load balancing, auto-scaling, and application development services
App Engine, Cloud Run, and Cloud Functions
Chapter 5: Data Engineering Fundamentals
Data Engineering roles & responsibilities
Batch vs. Stream processing
ETL vs. ELT concepts
Overview of GCP data ecosystem (BigQuery, Dataflow, Dataproc, Data Fusion, Pub/Sub, etc.)
Introduction to BigQuery Data Warehouse on GCP
Datasets, tables, and views
Writing and optimizing SQL queries
Partitioned and clustered tables
Query optimization and cost control
Loading data into Big Query (from GCS, Cloud Storage, Dataflow)
Big Query ML and Big Query BI Engine
Chapter 6: Working ETL/ELT Data Processing
Introduction to Dataflow/Dataproc/Cloud Data Fusion
Batch and stream data pipelines
Creating pipelines in Python or Java
Windowing, triggers, and stateful processing
Integration with Pub/Sub, Big Query, and GCS
Monitoring and debugging Dataflow/Dataproc jobs
Chapter 7: Real-Time Data with Pub/Sub
Introduction to Pub/Sub messaging
Publisher and Subscriber model
Push vs. Pull subscriptions
Integrating Pub/Sub with Dataflow for streaming
Chapter 8: Data Orchestration with Cloud Composer
Introduction to Apache Airflow
Setting up Cloud Composer environment
Creating and scheduling DAGs
Orchestrating Dataflow, BigQuery, and Dataproc jobs