Memory Optimizations for Machine Learning

Tue, Jun 11 2024, 7:00 pm – 9:00 pm PDT              Memory Optimizations for Machine Learning 1


Machine Learning (ML) continues to forge its way into diverse industries and applications. ML’s ability to optimize computational resources – and in particular memory – has become a critical aspect of effective model deployment. This talk will offer an exhaustive look into the specific memory requirements of ML tasks, and the cutting-edge strategies needed to minimize memory consumption efficiently.

Our speaker Tejas Chopra will begin by demystifying the memory footprint of typical ML data structures and algorithms, elucidating the nuances of memory allocation and deallocation during model training phases. He will then focus on memory-saving techniques such as data quantization, model pruning, and efficient mini-batch selection. These techniques offer the advantage of conserving memory resources without significantly degrading model performance. Tejas will offer additional insights into how memory usage can be optimized across various hardware setups, from CPUs and GPUs to custom ML accelerators.

(Please note this presentation has a somewhat modified title and scope from what was originally posted.)


Memory Optimizations for Machine Learning 3About the speaker,  Tejas Chopra of Netflix Studios

Tejas Chopra is a Senior Engineer at Netflix working on the Machine Learning Platform. Previously, he was a part of the Content Engineering organization working on building Storage Infrastructure for Netflix content. Tejas is also the Co-Founder of GoEB1 – a thought leadership platform for immigrants. He is an IEEE Senior Member, a BCS Fellow, a 2x TEDx speaker, and he has spoken at several conferences on Cloud Computing, Blockchain, and Storage Infrastructure. His experience includes work at Box, Datrium, Samsung, Cadence, and Apple, and he holds a Master’s in Electrical and Computer Engineering from Carnegie Mellon University, Pittsburgh.


Location: SEMI, Milpitas, CA

567 Yosemite Dr, Milpitas, CA 95035
View Map & Directions



 

Event recording coming soon.