BloombergGPT - an LLM for Finance with David Rosenberg - 639 скачать в хорошем качестве

BloombergGPT - an LLM for Finance with David Rosenberg - 639

Today we’re joined by David Rosenberg, head of the machine learning strategy team in the Office of the CTO at Bloomberg. In our conversation with David, we discuss the creation of BloombergGPT, a custom-built LLM focused on financial applications. We explore the model’s architecture, validation process, benchmarks, and its distinction from other language models. David also discussed the evaluation process, performance comparisons, progress, and the future directions of the model. Finally, we discuss the ethical considerations that come with building these types of models, and how they've approached dealing with these issues. 🔔 Subscribe to our channel for more great content just like this: https://youtube.com/twimlai?sub_confi... 🗣️ CONNECT WITH US! =============================== Subscribe to the TWIML AI Podcast: https://twimlai.com/podcast/twimlai/ Join our Slack Community: https://twimlai.com/community/ Subscribe to our newsletter: https://twimlai.com/newsletter/ Want to get in touch? Send us a message: https://twimlai.com/contact/ 📖CHAPTERS =============================== 00:00 - Intro 02:47 - Introducing BloombergGPT 06:20 - Focus on numerical data tokenization 07:57 - Challenges in training large models and improving performance 17:38 - Focusing on experimentation for small changes. 25:30 - For commercial use, to build a model or to fine-tune? 28:49 - Model architecture and infrastructure flexibility 33:47 - Training and instruction tuning 38:34 - Investment in small-scale experiments for models 40:39 - Researching natural language models for varied uses 43:37 - Ethical concerns and considerations 🔗 LINKS & RESOURCES =============================== Paper: BloombergGPT: A Large Language Model for Finance - https://arxiv.org/abs/2303.17564 BloombergGPT Blog Post - https://www.bloomberg.com/company/pre... For a complete list of references, head over to https://twimlai.com/go/639. 📸 Camera: https://amzn.to/3TQ3zsg 🎙️Microphone: https://amzn.to/3t5zXeV 🚦Lights: https://amzn.to/3TQlX49 🎛️ Audio Interface: https://amzn.to/3TVFAIq 🎚️ Stream Deck: https://amzn.to/3zzm7F5