Stable Diffusion and LLMs at the Edge with Jilei Hou - 633 скачать в хорошем качестве

Stable Diffusion and LLMs at the Edge with Jilei Hou - 633

Today we’re joined by Jilei Hou, a VP of Engineering at Qualcomm Technologies. In our conversation with Jilei, we focus on the emergence of generative AI, and how they've worked towards providing these models for use on edge devices. We explore how the distribution of models on devices can help amortize large models' costs while improving reliability and performance and the challenges of running machine learning workloads on devices, including model size and inference latency. Finally, Jilei we explore how these emerging technologies fit into the existing AI Model Efficiency Toolkit (AIMET) framework. 🔔 Subscribe to our channel for more great content just like this: https://youtube.com/twimlai?sub_confi... 🗣️ CONNECT WITH US! =============================== Subscribe to the TWIML AI Podcast: https://twimlai.com/podcast/twimlai/ Join our Slack Community: https://twimlai.com/community/ Subscribe to our newsletter: https://twimlai.com/newsletter/ Want to get in touch? Send us a message: https://twimlai.com/contact/ 📖CHAPTERS =============================== 00:00:56 - Background 00:06:27 - Generative AI creates new content using models. 00:13:41 - Why is Edge Stable Diffusion important? 00:16:15 - Challenges of running diffusion models on edge devices. 00:21:41 - Creating an open-source quantization toolkit. 00:26:10 - Does this translate to other types of Generative AI? 00:36:04 - The role of multimodality. 00:40:24 - Investment in generative AI for business impact. 🔗 LINKS & RESOURCES =============================== Blog: World’s first on-device demonstration of Stable Diffusion on an Android phone - https://www.qualcomm.com/news/onq/202... Paper: Up or Down? Adaptive Rounding for Post-Training Quantization - https://arxiv.org/abs/2004.10568 Kahneman, D - Thinking, Fast and Slow - https://amzn.to/3MddsxP The complete resource list can be found at https://twimlai.com/go/633. 📸 Camera: https://amzn.to/3TQ3zsg 🎙️Microphone: https://amzn.to/3t5zXeV 🚦Lights: https://amzn.to/3TQlX49 🎛️ Audio Interface: https://amzn.to/3TVFAIq 🎚️ Stream Deck: https://amzn.to/3zzm7F5