MCP server to let any LLM control your robot скачать в хорошем качестве

MCP server to let any LLM control your robot

I created an MCP server that lets any LLM (GPT, Gemini, Claude, etc.) control my real 3D-printed robot 🤖 This is a deep dive video that walks you through the entire process — from concept and setup to hands-on demos and real-world results. MCP is like a universal API for LLMs. With a robot-controlling MCP server, I can ask an LLM to "move my robot up 5 cm" or "grab the bottle in front of you", and it can execute the command zero-shot, relying only on the camera feed — no finetuning or special training required. But this video is not just about the results — I go through every step so you can replicate it yourself. 🧠 Along the way, we explore: What is MCP and how it works with LLMs + clients (GPT, Claude, Gemini, Cursor, Windsurf) How inverse kinematics makes robot commands more intuitive Walkthrough of my open-source code + how to test calibration and control the robot with your keyboard Full guide to implementing the MCP server and testing it with the built-in dev inspector Demos using different clients: Claude Desktop, Cursor, Windsurf, LibreChat Simple zero-shot tasks (like pick-and-place) and more reasoning-heavy challenges ✅ Successes and 💥 lots of failures — plus insights on why they happened Discussion of System 1 vs. System 2 roles in robot reasoning and how LLMs fit in ⚙️ Code + Setup Instructions: 👉 https://github.com/IliaLarchenko/robo... 🧵 Short summary thread on X: https://x.com/IliaLarchenko/status/19... 🔗 Links & Resources MCP docs: https://modelcontextprotocol.io/intro... HuggingFace MCP course: https://huggingface.co/learn/mcp-cour... LeRobot library: https://huggingface.co/lerobot SO-ARM100 robot: https://github.com/TheRobotStudio/SO-... My robot overview video:    • Running AI robotics experiments at home wi...   List of MCP-compatible clients: https://github.com/punkpeye/awesome-m... (Unofficial list, in theory, you can control the robot from any of them, but I didn't try most of them) 💬 Tried MCP or LLM-based robot control? Share your experience below! 🔔 Subscribe for more robotics + AI experiments 👍 Like if you enjoyed the video 00:00 - Introduction & Demo 02:13 - What is the MCP Protocol and how does it work with LLMs 13:43 - Robot Description 18:08 - Inverse Kinematics Theory 27:08 - Code Implementation 31:51 - Calibration Testing 35:06 - Keyboard Control Demo 38:54 - MCP Server Development 41:50 - MCP Inspector Testing 45:36 - MCP in practice 46:57 - Claude Desktop Client 51:05 - Windsurf IDE Client 54:43 - Cursor IDE Client 1:00:21 - LibreChat & GPT Client 1:01:31 - Systems 1 and 2 1:11:30 - Summary #AI #Robotics #LLM #MCP #Claude #Gemini #GPT #RobotControl #InverseKinematics #ToolUse #HuggingFace #LeRobot #Cursor #Windsurf #LibreChat #System1 #System2 #EmbodiedAI #EmbodiedReasoning