If you’ve ever plunged into the world of home labs and server setups, you know that the journey is as much filled with failures as it is successes. I’m no exception. I’ve lost count of how many times I’ve had to rebuild over the years and learned in the process.
My latest project was to have Ollama and Open WebUI installed on my Unraid server using Docker. Both applications are now an integral part of my daily workflow, but their installation wasn’t all smooth sailing. What you are about to read will guide you through how I installed them, share some lessons learned, and hopefully shave a couple of headaches off your time.
Why Ollama and Open WebUI?
Let’s talk a bit about why I chose Ollama and Open WebUI before we dive into the installation.
Ollama is an amazing tool that allows you to run large language models locally. If you’re interested in automating work, generating text, or just experimenting with AI, Ollama gives you an accessible means to begin experimenting.
Open WebUI, on the other hand, provides a less complicated interface for working with such models. Both of them are a lifesaver for my workflow, as they simplify automating processes and even just experimenting with AI.
Setting Up Ollama and Open WebUI on Unraid
Step 1: Preparing Your Unraid Server
First, you’ll need server running Unraid. If you’re new to Unraid, don’t worry—it’s absurdly simple to use. I recommend looking at Unraid’s starter guide to getting your initial set up dialed in. The key to an easy setup is keeping things organized. I really can’t stress how useful it is to keep ports, IP addresses, and login info organized. Trust me, you do not want to be scrambling around trying to remember what port you mapped to what container at 2 AM.
Step 2: Installing Docker Containers
It’s simple to add Docker containers with Unraid. Here’s a quick rundown of what I did:
Look up Ollama and Open WebUI in the Community Applications (APPS) tab. Add the containers of your choosing to your Unraid server. Then, fill in the required fields under each install. being sure to assign the correct ports and network settings. This sounds like “Draw the rest of the owl.” but it’s very simple to add applications within Unraid once you have your system dialed in.
Step 3: Setting up Ollama and Open WebUI
This is where things can get tricky. I’ll be honest—I messed up more than once. Forgetting which port I was using here, misconfiguring a setting there. But that’s all part of the learning process. One tip that saved me a lot of time? Take good notes. Whether it’s a simple text file or a dedicated notebook, keeping track of your configurations will make troubleshooting a lot easier. Be sure to read up on Open WebUI’s manual so you know how to select the correct language model to download.
Lessons Learned
Looking back, a few things I wish I had learned at the beginning:
Documentation is Your Best Friend: Unraid and Docker both have great documentation. When you get stuck, you can bet someone else has been there too. Google is your friend.
Begin Small: Don’t attempt to do it all in one go. Create one container, test it, and proceed to the next.
And naturally, mock your mistakes. Believe me, there will be plenty of them. You’ll look back and realize you simply weren’t paying attention and left out one specific setting.
One of the best uses of Ollama and Open WebUI is automating routine tasks. I, for example, use it to summarize long documents, draft emails, or even generate ideas for this very article. If you can get your LLM attached to a n8n workflow, it really can open up a whole new world of options.
Summary
Installing Ollama and Open WebUI on Unraid has been an experience with its fair share of highs and lows, but the final product has been well worth the effort. Taking the time to structure my configuration, write down my configurations, and figure out my mistakes has paid off in the form of a useful tool that streamlines my everyday tasks.
Have you downloaded Ollama or Open WebUI on your Unraid server? Tell me how it went and your advice in the comments section below. And if you like this post, do subscribe to my blog for more technology and self-improvement posts. Let’s learn and grow together!