[Scale ML] Kevin Wang and Kristine Lu: Model Scaling (Part 1)
Speaker
Kevin Wang and Kristine Lu
Host
Scale ML
Scale ML
Time Change -- starting at 4:30pm!
Speaker: Kevin Wang and Kristine Lu
Topic: Model Scaling: Part 1
Date: Tuesday, Sept 30
Time: 4:30 PM (EST), dinner will be provided
Zoom: https://mit.zoom.us/j/91697262920 (password: mitmlscale)
Using How to Scale Your Model as a reference, we discuss how to handle and optimize large models in in distributed training and inference. We also tackle the mathematics and principles behind the tradeoffs between latency, throughput, and model size in GPU communication.