Efficient AI
Efficient Training and Deployment of Language and Vision Models
We develop techniques to reduce the computational and memory costs of training and deploying large-scale language and vision models. Our research focuses on efficient training methods, model compression techniques such as quantization and sparsity, KV-cache optimization, and efficient inference and serving systems.
