In Class Tutorials / Demos for GCP (and AWS)
Tutorials are grouped by the lecture they accompany.
Lecture 1: Virtual Environments and Virtual Machines
Create Simple Translate App - No Docker, No UV
- Description: A simple translation app built without using Docker or UV.
- GCP GitHub URL: Install App on VM Manually
- AWS GitHub URL: Install App on VM Manually - AWS
Create Simple Translate App with UV (GCP) / Pipenv (AWS), No Docker
- Description: A translation app using UV on GCP or Pipenv on AWS, without Docker.
- GCP GitHub URL: Install App on VM using UV
- AWS GitHub URL: Install App on VM using Pipenv - AWS
Lecture 2: Containers I
Create Simple Translate App with Docker, Push Image to Docker Hub
- Description: Build a simple translation app, containerize it with Docker, and push the image to Docker Hub.
- GCP GitHub URL: Develop App using Containers
- AWS GitHub URL: Develop App using Containers - AWS
Run App in VM using Docker
- Description: A continuation of the Docker tutorial, running the containerized app in a VM.
- GCP GitHub URL: Run App on VM using Docker
- AWS GitHub URL: Run App on VM using Docker - AWS
Lecture 3: Containers II
Mega Pipeline App
- Description: Build a Mega Pipeline App.
- GCP GitHub URL: Mega Pipeline App
- AWS GitHub URL: Mega Pipeline App
Lecture 4: Containers III
Docker
Mega Pipeline App with Flexible Workflow
- Description: Build a Mega Pipeline App with Flexible Workflow.
- GCP GitHub URL: Mega Pipeline App (Flexible Workflow)
Docker Compose: Port Toy App
- Description: Container networks and ports. Two containers, one published port, one message.
- GCP GitHub URL: Port Toy App
Lecture 5: Introduction to RAG
LLMs
LLM-RAG
- Description: Building a RAG System with Vector DB and LLM
- GCP GitHub URL: LLM-1
Lecture 6: LLM: Agents I
Tutorial 1: Cheese Quiz
- Description: LLM Agents notebook (Cheese Quiz)
Tutorial 2: Travel Planner
- Description: LLM Agents notebook (Travel Planner)
- Travel Planner: Colab
Tutorial 3: Cheese Newsletter - Harness
- Description: LLM Agents notebook (Cheese Newsletter - Harness)
- Cheese Newsletter - Harness: Colab
Lecture 7: LLM: Agents II (practical use)
LLM-Agents
- Description: LLM Agents
- GCP GitHub URL: LLM-Agents
Lecture 8: LLM: Finetuning
LLM-Fine Tuning
- Description: LLM Fine Tuning using PEFT
- GCP GitHub URL: LLM Fine Tuning
LLM Finetuning Hooks A
- Description: LLM Finetuning Hooks A
- GCP GitHub URL: LLM Finetuning Hooks
LLM Finetuning Hooks B
- Description: LLM Finetuning Hooks B
- GCP GitHub URL: LLM Finetuning Hooks
Lecture 9: Connecting to the Cloud: Networking, Authentication & Storage
Lecture 10: Automating Software Development: CI, unit testing
Testing with Pytest
- Description: Unit, integration, system and acceptance tests with pytest
- GCP GitHub URL: Testing with Pytest
Automating with Pre-commit Hooks
- Description: Local git hooks that run linters, formatters and tests before each commit
- GCP GitHub URL: Pre-commit Hooks
Lecture 11: Data Labeling, Versioning and Monitoring
Label Studio
- Description: Learn how to use Label Studio for data labeling.
- GCP GitHub URL: Label Studio
- AWS GitHub URL: Label Studio - AWS
Data Versioning
- Description: Learn about versioning practices in development. Particularly, how to use DVC for data versioning.
- GCP GitHub URL: DVC
Lecture 12: App Design
Lecture 13: Advanced Training Workflows: experiment tracking (W&B), multi-GPU, serverless training (Vertex AI)
Experiment Tracking
- Description: Classification Model, Experiment Tracking
- Colab Notebook A: Cheese Classification Models
- Colab Notebook B: Experiment Tracking with W&B
Advanced Workflow: Serverless Model Training with Vertex AI
- Description: Serverless Model Training with Vertex AI
- GCP GitHub URL: Serverless Model Training
- AWS GitHub URL: Coming Soon
Lecture 14: Serverless Deployment: Cloud Functions, Cloud Run
Cloud Function and Cloud Run
- Description: Cloud Function and Cloud Run
- GCP GitHub URL: Cloud Function, Cloud Run
- AWS GitHub URL: Coming Soon
Lecture 15: ML Workflows with Vertex AI
Model Deployment using Vertex AI
- Description: Model Deployment using Vertex AI
- GCP GitHub URL: Model Deployment
- AWS GitHub URL: Model Deployment - AWS
ML Workflow
- Description: Vertex AI ML Workflow for pipeline. Data Processing, data collection, model training, model deployment.
- GCP GitHub URL: ML Workflow
- AWS GitHub URL: ML Workflow - AWS
Lecture 16: System Tradeoffs: Performance, Cost, and Design Choices
Lecture 17: Evaluating and Monitoring ML Systems in Production
Lecture 18: APIs + Frontend
Frontend and FastAPI
- Description: Simple Frontend with FastAPI
- GCP GitHub URL: App v1
Backend and FastAPI
- Description: Cheese App APIs
- GCP GitHub URL: App v2: FastAPI Backend
Frontend Simple
- Description: Frontend Simple
- GCP GitHub URL: App v2: Frontend Simple
Frontend React
- Description: Frontend App (React)
- GCP GitHub URL: App v2: Frontend React
Lecture 19: Scaling: Kubernetes (local)
Scaling: Kubernetes (local)
- Description:
- GCP GitHub URL:
Tutorial for Scaling: Kubernetes (local) coming soon
Lecture 20: Deployment: Pulumi
Deployment of the full app to GCP (Manual)
- Description: Deployment to GCP. Manual steps to deploy the app to GCP.
- GCP GitHub URL: App v3: Deployment to GCP (Manual)
Deployment to GCP with Pulumi
- Description: Automate the same deployment with Pulumi: build and push images to GCR, create the compute instance, provision it, and launch the containers.
- GCP GitHub URL: App v3: Deployment to GCP (Single VM Instance)
Lecture 21: Scaling: Kubernetes
Deployment with Scaling using Kubernetes (cloud)
- Description: Deployment with Scaling using Kubernetes
- GCP GitHub URL: App v3: Deployment with Scaling using Kubernetes
Lecture 22: Automating Software Development: CI/CD with GitHub Actions and other tools II
Remote CI/CD with GitHub Actions
- Description: CI pipeline on GitHub Actions: build container, lint and format, test, summary
- GCP GitHub URL: GitHub Actions Remote CI/CD
Lecture 23: Final Deployment and Review
Continuous Integration and Continuous Deployment
- Description: Continuous Integration and Continuous Deployment
- GCP GitHub URL: App v4: Continuous Integration and Continuous Deployment
- AWS GitHub URL: No K8s App: AWS - Continuous Integration and Continuous Deployment