[Scale ML] Kevin Wang and Kristine Lu: Model Scaling (Part 1)

Speaker

Kevin Wang and Kristine Lu

Host

Scale ML
Scale ML

Time Change -- starting at 4:30pm!

Speaker: Kevin Wang and Kristine Lu
Topic: Model Scaling: Part 1
Date: Tuesday, Sept 30
Time: 4:30 PM (EST), dinner will be provided
Zoom: https://mit.zoom.us/j/91697262920 (password: mitmlscale)

 

Using How to Scale Your Model as a reference, we discuss how to handle and optimize large models in  in distributed training and inference. We also tackle the mathematics and principles behind the tradeoffs between latency, throughput, and model size in GPU communication.