Skip to main content

Manta

Manta is an extensible, feature-rich, and user-friendly self-hosted AI platform designed to operate entirely offline. It supports various LLM runners like Ollama and OpenAI-compatible APIs, with built-in inference engine for RAG, making it a powerful AI deployment solution.

Quick Start with Docker 🐳​

Manta runs on top of the underlying Open WebUI Docker image.

info

WebSocket support is required for Manta to function correctly. Ensure that your network configuration allows WebSocket connections.

If Ollama is on your computer, use this command:

docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v manta:/app/backend/data --name manta --restart always ghcr.io/open-webui/open-webui:main

To run Manta with Nvidia GPU support, use this command:

docker run -d -p 3000:8080 --gpus all --add-host=host.docker.internal:host-gateway -v manta:/app/backend/data --name manta --restart always ghcr.io/open-webui/open-webui:cuda

Manta Bundled with Ollama​

This installation method uses a single container image that bundles Manta with Ollama, allowing for a streamlined setup via a single command. Choose the appropriate command based on your hardware setup:

  • With GPU Support: Utilize GPU resources by running the following command:

    docker run -d -p 3000:8080 --gpus=all -v ollama:/root/.ollama -v manta:/app/backend/data --name manta --restart always ghcr.io/open-webui/open-webui:ollama

  • For CPU Only: If you're not using a GPU, use this command instead:

    docker run -d -p 3000:8080 -v ollama:/root/.ollama -v manta:/app/backend/data --name manta --restart always ghcr.io/open-webui/open-webui:ollama

Both commands facilitate a built-in, hassle-free installation of both Manta and Ollama, ensuring that you can get everything up and running swiftly.

After installation, you can access Manta at http://localhost:3000. Enjoy! 😄

Using the Dev Branch 🌙​

warning

The :dev branch contains the latest unstable features and changes. Use it at your own risk as it may have bugs or incomplete features.

If you want to try out the latest bleeding-edge features and are okay with occasional instability, you can use the :dev tag like this:

docker run -d -p 3000:8080 -v manta:/app/backend/data --name manta --restart always ghcr.io/open-webui/open-webui:dev

Updating Manta​

To update Manta container easily, follow these steps:

Manual Update​

Use Watchtower to update your Docker container manually:

docker run --rm -v /var/run/docker.sock:/var/run/docker.sock containrrr/watchtower --run-once manta

Automatic Updates​

Keep your container updated automatically every 5 minutes:

docker run -d --name watchtower --restart unless-stopped -v /var/run/docker.sock:/var/run/docker.sock containrrr/watchtower --interval 300 manta

🔧 Note: Replace manta with your container name if it's different.

Other Installation Methods​

We offer various installation alternatives, including non-Docker native installation methods, Docker Compose, Kustomize, and Helm. Visit our Manta Documentation for comprehensive guidance.