Agentic Enterprise System Demo - small open LLMs + Kafka скачать в хорошем качестве

Agentic Enterprise System Demo - small open LLMs + Kafka

Using Qwen, Llama, Granite, Mistral, and Deepseek. Including guardrails model via Granite Guardian. Using Kafka for non-deterministic latency, non-determinstic LLM responses, audit trail and explainability. Structured output Tools Enterprise database lookup RAG kbase Enterprise API calls All models runnable via Ollama but I am also using a Model-as-a-Service provided by Red Hat. The various models can be swapped in/out via .env settings. https://github.com/burrsutter/ai-mess... https://github.com/burrsutter/ai-mess... Demo originally created for All Things Open AI https://allthingsopen.ai/speakers/bur...