NVIDIA RTX 5090 PCIe Scaling Benchmarks for Local LLM and AI: 20 Local LLMs + 124 PyTorch Tests скачать в хорошем качестве

NVIDIA RTX 5090 PCIe Scaling Benchmarks for Local LLM and AI: 20 Local LLMs + 124 PyTorch Tests

Would you need a new motherboard with the latest PCIe Gen 5 lanes to get the full potential of your new RTX 5090? That's what we are going to find out in this video. I ran benchmarks for the most popular LLMs, including DeepSeek, Llama, Gemma, Mistral, Phi, Falcon, Command-R, and a bunch of Pytorch benchmarks. I tested these to find out the performance difference between PCIe Gen 5 and all other older generations. Yes, all older generations, including PCIe Gen 4, Gen 3, Gen 2 and Gen 1. PyTorch benchmark used. I ran every test that I could, excluding only those that caused errors I couldn’t fix in the time I had: https://github.com/pytorch/benchmark Correction - it has nearly* 22,000 CUDA cores 00:00 - Intro 01:16 - Testbench 02:20 - Gemma 3 1B 03:03 - Gemma 3 4B 03:22 - Gemma 3 12B 03:40 - Gemma 3 27B 04:52 - Deepseek r1 1.5B 05:17 - DeepSeek r1 7B 05:43 - Deepseek r1 8B 06:00 - Deepseek r1 14B 06:13 - Deepseek r1 32B 06:57 - llama 3.2 1B 07:20 - llama 3.2 3B 07:32 - llama 3.2 8B 07:40 - llama 3.2 70B/ Deepseek r1 70B 09:14 - mistral 7B 09:38 - mixtral 7B 10:07 - mixtral 22B 10:46 - Falcon 7B 11:01 - Phi4 14B 11:20 - QWQ 32B 11:40 - Command-R 35B 12:00 - LLM Overview: speed by PCIe generation 12:30 - LLM Overview: speed by model 13:10 - LLM Overview: VRAM 14:10 - PyTorch Benchmarks 17:50 - All PyTorch Benchmark Results 18:50 - PyTorch Benchmarks Overview 19:47 - Strengths and Limitations of the Experiments 22:29 - Conclusion - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 🔌 My Plugins and .blends Autofocus Pro - https://blendermarket.com/products/ap... Physics Plug-in - https://blendermarket.com/products/ph... Total Render Time - https://blendermarket.com/products/to... Domino Run Kit. - https://blendermarket.com/products/do... Patreon - https://bit.ly/MobyPatreon ✅ My Socials Blog - http://www.mobymotionblog.com Twitter -   / mobymotion   Instagram -   / mobymotion   Tumblr -   / mobymotion   Patreon -   / mobymotion   😊 Affiliate Links Marble Run Kit - https://blendermarket.com/products/ma... Marble Race Kit - https://blendermarket.com/products/ma... Wooden Train Set - https://blendermarket.com/products/wo... FLIP Fluids Plugin - https://blendermarket.com/products/fl... Backrooms Tutorial - https://blendermarket.com/products/ba... Poolrooms Tutorial - https://blendermarket.com/products/po... Escalators - https://blendermarket.com/products/an... Tube Buddy - https://www.tubebuddy.com/Moby render+ - https://blendermarket.com/products/re... Beautiful interior scene - https://blendermarket.com/products/in... Material Builder Suite - https://gumroad.com/a/418477171/vYItG Topaz Video AI - https://www.topazlabs.com/topaz-video... 🖥️ My Rigs (includes Amazon affiliate links) Desktop 1: @AMD Ryzen 9 5900X - https://amzn.to/3FVWhNW @Nvidia RTX 4090 - https://amzn.to/3GlrtYe Desktop 2: @AMD Ryzen 9 9950X - https://amzn.to/3U129NO 2 x @Nvidia RTX 3090 - https://amzn.to/3WN357u