bitnet.cpp from Microsoft: Run LLMs locally on CPU! (hands-on) скачать в хорошем качестве

bitnet.cpp from Microsoft: Run LLMs locally on CPU! (hands-on)

In the series of BitNet papers, we have the bitnet.cpp a.k.a "1-bit AI Infra" in the paper. In this video, lets setup the repo locally on a Mac machine and test the inference on the CPU! RELATED WORK BitNet paper: https://arxiv.org/abs/2310.11453 BitNet b1.58: https://arxiv.org/abs/2402.17764 bitnet.cpp (this video): https://arxiv.org/abs/2410.16144 ⌚️ ⌚️ ⌚️ TIMESTAMPS ⌚️ ⌚️ ⌚️ 0:00 - Intro 0:58 - BitNet github repo 1:18 - bitnet.cpp Hands-on 3:00 - Running inference locally on CPU 4:56 - Comparison with llama.cpp 5:48 - Extro AI BITES KEY LINKS YouTube:    / @aibites   Twitter:   / ai_bites​   Patreon:   / ai_bites​   Github: https://github.com/ai-bites​ #machinelearning #deeplearning #aibites