In Class Tutorials / Demos for GCP (and AWS)
Tutorials are grouped by the lecture they accompany.
Lecture 1
Create Simple Translate App - No Docker, No UV
- Description: A simple translation app built without using Docker or UV.
- GCP GitHub URL: Install App on VM Manually
- AWS GitHub URL: Install App on VM Manually - AWS
Create Simple Translate App with UV (GCP) / Pipenv (AWS), No Docker
- Description: A translation app using UV on GCP or Pipenv on AWS, without Docker.
- GCP GitHub URL: Install App on VM using UV
- AWS GitHub URL: Install App on VM using Pipenv - AWS
Lecture 2
Create Simple Translate App with Docker, Push Image to Docker Hub
- Description: Build a simple translation app, containerize it with Docker, and push the image to Docker Hub.
- GCP GitHub URL: Develop App using Containers
- AWS GitHub URL: Develop App using Containers - AWS
Run App in VM using Docker
- Description: A continuation of the Docker tutorial, running the containerized app in a VM.
- GCP GitHub URL: Run App on VM using Docker
- AWS GitHub URL: Run App on VM using Docker - AWS
Lecture 3
Mega Pipeline App
- Description: Build a Mega Pipeline App.
- GCP GitHub URL: Mega Pipeline App
- AWS GitHub URL: Mega Pipeline App
Lecture 4
LLM-RAG
- Description: Building a RAG System with Vector DB and LLM
- GCP GitHub URL: LLM-1
Lecture 5
Lecture 6
LLM-Agents
- Description: LLM Agents
- GCP GitHub URL: LLM-Agents
Lecture 7
LLM-Fine Tuning
- Description: LLM Fine Tuning using PEFT
- GCP GitHub URL: LLM Fine Tuning
LLM Finetuning Hooks A
- Description: LLM Finetuning Hooks A
- GCP GitHub URL: LLM Finetuning Hooks
LLM Finetuning Hooks B
- Description: LLM Finetuning Hooks B
- GCP GitHub URL: LLM Finetuning Hooks
Lecture 8
Mega Pipeline App with Flexible Workflow
- Description: Build a Mega Pipeline App with Flexible Workflow.
- GCP GitHub URL: Mega Pipeline App (Flexible Workflow)
Lecture 9
Testing with Pytest
- Description: Unit, integration, system and acceptance tests with pytest
- GCP GitHub URL: Testing with Pytest
Automating with Pre-commit Hooks
- Description: Local git hooks that run linters, formatters and tests before each commit
- GCP GitHub URL: Pre-commit Hooks
Lecture 10
Label Studio
- Description: Learn how to use Label Studio for data labeling.
- GCP GitHub URL: Label Studio
- AWS GitHub URL: Label Studio - AWS
Data Versioning
- Description: Learn about versioning practices in development. Particularly, how to use DVC for data versioning.
- GCP GitHub URL: DVC
Lecture 11
Lecture 12
Experiment Tracking
- Description: Classification Model, Experiment Tracking
- Colab Notebook A: Cheese Classification Models
- Colab Notebook B: Experiment Tracking with W&B
Advanced Workflow: Serverless Model Training with Vertex AI
- Description: Serverless Model Training with Vertex AI
- GCP GitHub URL: Serverless Model Training
- AWS GitHub URL: Coming Soon
Lecture 13
Cloud Function and Cloud Run
- Description: Cloud Function and Cloud Run
- GCP GitHub URL: Cloud Function, Cloud Run
- AWS GitHub URL: Coming Soon
Lecture 14
Model Deployment using Vertex AI
- Description: Model Deployment using Vertex AI
- GCP GitHub URL: Model Deployment
- AWS GitHub URL: Model Deployment - AWS
ML Workflow
- Description: Vertex AI ML Workflow for pipeline. Data Processing, data collection, model training, model deployment.
- GCP GitHub URL: ML Workflow
- AWS GitHub URL: ML Workflow - AWS
Lecture 15
Lecture 16
Lecture 17
Ed lesson (APIs) Ed lesson (Frontend)
Frontend and FastAPI
- Description: Simple Frontend with FastAPI
- GCP GitHub URL: App v1
Backend and FastAPI
- Description: Cheese App APIs
- GCP GitHub URL: App v2: FastAPI Backend
Frontend Simple
- Description: Frontend Simple
- GCP GitHub URL: App v2: Frontend Simple
Frontend React
- Description: Frontend App (React)
- GCP GitHub URL: App v2: Frontend React
Lecture 18
Scaling: Kubernetes (local)
- Description:
- GCP GitHub URL:
Tutorial for Scaling: Kubernetes (local) coming soon
Lecture 19
Deployment of the full app to GCP (Manual)
- Description: Deployment to GCP. Manual steps to deploy the app to GCP.
- GCP GitHub URL: App v3: Deployment to GCP (Manual)
Deployment to GCP with Pulumi
- Description: Automate the same deployment with Pulumi: build and push images to GCR, create the compute instance, provision it, and launch the containers.
- GCP GitHub URL: App v3: Deployment to GCP (Single VM Instance)
Lecture 20
Deployment with Scaling using Kubernetes (cloud)
- Description: Deployment with Scaling using Kubernetes
- GCP GitHub URL: App v3: Deployment with Scaling using Kubernetes
Lecture 21
Remote CI/CD with GitHub Actions
- Description: CI pipeline on GitHub Actions: build container, lint and format, test, summary
- GCP GitHub URL: GitHub Actions Remote CI/CD
Lecture 22
Continuous Integration and Continuous Deployment
- Description: Continuous Integration and Continuous Deployment
- GCP GitHub URL: App v4: Continuous Integration and Continuous Deployment
- AWS GitHub URL: No K8s App: AWS - Continuous Integration and Continuous Deployment