image.png

Link to Github


Objectives

By the end of the session you will have:

What we'll build

We cover the foundations together (OpenCV, real-time detection, segmentation), then you fork this repo, make a folder in projects/, and build whatever webcam app you want. Kiro writes most of the code; you steer it.

The seven demo apps in demos/ are there to run, read, and borrow from. You can rebuild one, mash two together, or ignore them and do something completely different. The prompt library (docs/prompts/) has the exact prompts that produced each demo, cleaned up so you can paste them into Kiro and swap in your own subject.

Technology Role in this workshop
Python 3.10-3.12 and OpenCV Webcam capture, frame manipulation, all on-screen drawing
Ultralytics YOLO26 (PyTorch, CPU) Real-time COCO detection. The nano model (yolo26n.pt, ~5 MB) runs end-to-end without a separate NMS step and downloads itself on first use
Meta SAM 3.1 Text-prompted segmentation. Type "laptop" and get the pixel mask back. The model is ~6.5 GB, so we show it on a pre-loaded machine rather than downloading in the room
MediaPipe Hand, face, and pose landmark tracking (21 / 478 / 33 points). Powers the gesture demos
Flask + flask-sock Lightweight web framework already included. Every demo has a browser version you can run locally as a dashboard, and you can do the same for your own app. See prompt 07 in the library.
Kiro (CLI or IDE) Local coding agent. Writes boilerplate, manages dependencies, helps you iterate
GitHub You fork the repo, build in your folder, push when done

Reminders