Ollama Open WebUI ChatGPT
Abandoning this one, it was too complicated and didn’t work well anyway. See the local AI page for recent efforts instead.
Below Is Redundant
Installation
On HP3
Installed Ollama using this:
https://medium.com/@sridevi17j/step-by-step-guide-setting-up-and-running-ollama-in-windows-macos-linux-a00f21164bf3
>>> The Ollama API is now available at 127.0.0.1:11434.
>>> Install complete. Run "ollama" from the command line.
>>> AMD GPU ready.
So it detected the GPU.
And OpenWebUI with this:
https://docs.openwebui.com/getting-started/quick-start
Starting Up I tried using the command I used before, sudo docker run -d -p 3000:8080 -v open-webui:/app/backend/data --name open-webui ghcr.io/open-webui/open-webui:main but this gave me the error “You have to remove (or rename) that container to be able to reuse that name.” so I tried some websites and found a lot about how to delete the container in order to recreate it but nothing about how to start that existing container, so I guessed.
sudo docker start open-webui
Which worked. Still not familiar with Docker. Anyway, onwards…
Check if ollama itself is running with http://localhost:11434/
OpenWebUI is at http://localhost:3000/
And then connect OpenWebUI to Ollama:
https://docs.openwebui.com/getting-started/quick-start/starting-with-ollama/
But of course none of this works, and the user interface described in the instructions has little resemblance to the actual user interface in WebUI… but at least the command line part works.
https://techjunction.co/unable-to-access-ollama-models-on-open-webui-after-enabling-https-troubleshooting-and-resolution-guide/ may have some answers.
and now none of it works at all. Time to delete everything I think and do something made by grown-ups.
ollama run llama3
Back Up The Database
docker cp open-webui:/app/backend/data/webui.db ./webui.db
import to a new instance:
docker stop open-webui
[then]
docker cp ./webui.db open-webui:/app/backend/data/webui.db
[then]
docker start open-webui
Manual Update
- Stop and remove the current container: docker rm -f open-webui
- Pull the latest version: docker pull ghcr.io/open-webui/open-webui:main
- Start the container again: docker run -d -p 3000:8080 -v open-webui:/app/backend/data –name open-webui ghcr.io/open-webui/open-webui:main