GenAI Grows Up: Building Production-Ready Agents on the JVM • Rod Johnson • GOTO 2025 скачать в хорошем качестве

GenAI Grows Up: Building Production-Ready Agents on the JVM • Rod Johnson • GOTO 2025

This presentation was recorded at GOTO Copenhagen 2025. #GOTOcon #GOTOcph https://gotocph.com Rod Johnson - Building the Future of Agent Frameworks at Embabel RESOURCES   / springrod   https://github.com/johnsonr   / johnsonroda   https://the-composition.com/@springrod ABSTRACT Every C-suite demands a GenAI strategy. Few deliver results. While GenAI technology borders on miraculous, most attempts to deploy it in business applications fail—not because the technology is flawed, but because the approach is fundamentally wrong. In this talk, Rod Johnson explains why these initiatives stumble and how to build agents that actually work in production. One critical mistake? Treating GenAI as a standalone technology divorced from your existing systems. Agents are only as valuable as what they can access and act upon. Your business logic, your data, your processes—these are key assets that underpin AI power. Python dominates machine learning, but almost none of the business-critical software running your enterprise is written in Python. There's a reason for that. There's also a reason the world's most reliable systems run on the JVM. The JVM isn't just relevant to enterprise AI—it's essential. Agents built on the JVM have frictionless access to critical business logic and infrastructure. The mature ecosystem, robust tooling, and battle-tested reliability of the JVM become AI superpowers. Another mistake: ignoring what we already know about software engineering. Domain modeling, unit testing, type safety—these aren't obstacles to AI; they're the foundations of dependable AI systems. Learn how the Embabel agent framework brings together the power of GenAI with the strength of the JVM, enabling you to build agents that are testable, maintainable, and production-ready from day one. It's time for GenAI to grow up. Let's build it right. [...] TIMECODES 00:00 Intro 01:53 Let's make this personal 02:24 Tools add power 03:36 "Personal assistant" use case 04:30 Powerful but not predictable is sometimes OK 06:45 Alarming failure rate 07:19 Why do GenAI projects fail? 07:21 Technology issues 09:56 Prompt engineering: The new alchemy 12:48 Integration problems 13:28 Excessive vendor influence 13:57 Top-down mandates 15:15 Organizational issues 15:55 How do we fix this? 16:04 1. Attack nondeterminism 21:11 2. Integrate with what works 22:30 Bringing structure to LLM interactions 23:42 Domain-integrated context engineering 26:47 What is the role of Java developers? 27:27 Option 1: Imitate Python approaches 28:20 Option 2: Build something better 29:10 The stakes are high 29:46 What the JVM brings to GenAI 30:32 Python vs JVM for enterprise AI 32:22 Time for Java community to lead again 33:01 Introducing Embabel 39:19 Java example: Bank support agent 41:40 Seamless code actions & LLM invocation 42:29 Builds on Spring 44:03 Modern Java/Kotlin API 46:01 Example: This slide deck 49:24 Decker agent example 50:04 Embabel vs Python frameworks 51:22 Conclusion 52:38 Start right away 53:32 Outro Download slides and read the full abstract here: https://gotocph.com/2025/sessions/3893 RECOMMENDED BOOKS Reynolds T. Smith • Hands-on Spring AI Projects • https://amzn.to/47eFR23 Sebastian Raschka • Build a Large Language Model (From Scratch) • https://amzn.to/3WpVP3g Banu Parasurama • Mastering Spring AI • https://amzn.to/4oLWiZK https://bsky.app/profile/gotocon.com   / gotocon     / goto-     / goto_con     / gotoconferences   #SpringAI #GenAI #JVM #JavaAI #Embabel #PromptEngineering #EnterpriseAI #LLM #TodayInTech #RodJohnson CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks:    / @goto-   Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConf...