Скачать с ютуб Quick and Easy Guide to Installing Meta Llama 3.1 405B, 70B, 8B with Ollama, Docker, and OpenWebUI в хорошем качестве

Quick and Easy Guide to Installing Meta Llama 3.1 405B, 70B, 8B with Ollama, Docker, and OpenWebUI

I will show how easy and quick it is to install Llama 3.1 405B, 70B, 8B, or another language model on your computer or VM using Ollama, Docker, and OpenWebUI. It is so simple to install that even a grandmother or grandfather could do it. This is private AI, not cloud-based. All data is on your own computer. OpenWebUI is a front interface similar to OpenAI ChatGPT's interface. I will demonstrate how to install it on Windows 11, but it can be installed just as quickly on Apple Mac Silicon or various Linux distributions. My instructions for Linux versions will come later. Quick Steps: • Download Ollama and install it on your computer. https://ollama.com/ • Close Ollama • Set up variables for Ollama, specifying where you want the language models to be stored. Advanced system settings Environment Variables Variable name: OLLAMA_MODELS Variable value: Drive/Folder location • Start Ollama • Install Docker on your computer. https://www.docker.com • Launch a browser and go to your OpenWebUI address. https://openwebui.com/ • Install OpenWebUI in your Docker setup. Open Terminal (administrator rights) Copy and paste the command docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main • Launch a browser and http://localhost:3000/ • Create a user in OpenWebUI. • Install language models via OpenWebUI. • Install language models via Terminal https://vandu.tech/quick-and-easy-gui...