local agentic audit: kimi-k2 vs Qwen3-Coder Q4_K_XL 4K скачать в хорошем качестве

local agentic audit: kimi-k2 vs Qwen3-Coder Q4_K_XL 4K

Watch as I compare DeepSeek-V3-0324, kimi-k2, and Qwen3-Coder at Q4_K_XL quant size on my local hardware. NOTE: I realized while editing this video that V3-0324 was using `cat` to read files. I was up till 3am editing and rather than re-shoot an hour and a half of footage and re-edit, I decided to just ship my mistake so you can appreciate an obsolete human LLM hallucinating and being whiny about it because he's tired. 0:00 Intro 1:03 System details 2:38 How to Utilize 96gb VRAM 9:11 Model File Size on Disk 11:26 V3-0324 Open WebUI 14:40 Agentic Audit Intro 20:35 DeepSeek-V3-0324 26:57 Kimi-K2 31:58 Qwen3-Coder 42:54 Outro Previous videos: adding blackwell 6000 pro    • llama.cpp - DeepSeek-R1-0528 - 20 tok/s - ...   ktransformers and 3090 GPU    • ktransformers: DeepSeek_V3_0324:671b-Q4_K_...   PC Build and CPU Only    • PC Build: Run Deepseek-V3-0324:671b-Q8 Loc...   Github project: https://github.com/createthis/07_27_2... Amazon Affiliate Links: NVD RTX PRO 6000 Blackwell Professional Workstation Edition Graphics Card for AI, Design, Simulation, Engineering - 96GB DDR7 ECC Memory - 4th Gen RT/5th Gen Tensor Core GPU - OEM Packaging [amazon affiliate us]: https://amzn.to/4kNYXjU Gigabyte MZ73-LM0 Motherboard Socket SP5 Extended ATX [amazon affiliate us]: https://amzn.to/43YROaH Corsair HX1500i Fully Modular Ultra-Low Noise ATX Power Supply - ATX 3.0 & PCIe 5.0 Compliant - Fluid Dynamic Bearing Fan - CORSAIR iCUE Software Compatible - 80 Plus Platinum Efficiency - Black [amazon affiliate us]: https://amzn.to/42lzPcr NEMIX RAM 384GB (12X32GB) DDR5 5600MHZ PC5-44800 1Rx4 1.1V CL46 288-PIN ECC RDIMM Registered Server Memory KIT [amazon affiliate us]: https://amzn.to/42nzXJn SAMSUNG 990 PRO Heatsink SSD 4TB, NVMe M.2, Speeds Up to 7,450MB/s Best for PlayStation® 5 (PS5 SSD) Console Expansion MZ-V9P4T0CW [amazon affiliate us]: https://amzn.to/4lc60Uc I have six of these on the case: ARCTIC P14 PWM PST (5 Pack) - 140 mm Case Fan with PWM Sharing Technology (PST), Pressure-optimised, Computer, Fan Speed: 200-1700 RPM - Black [amazon affiliate us]: https://amzn.to/3T6bVgQ This is the one small fan at the back of the case: ARCTIC F12 PWM PST (5 Pack) - 120 mm PWM PST Case Fan with PWM Sharing Technology (PST), Quiet Motor, Computer, Fan Speed: 230-1350 RPM - Black [amazon affiliate us]: https://amzn.to/4jgJxDL