🔗 Integrations

📄️ 🐋 Run DeepSeek R1 Dynamic 1.58-bit with Llama.cpp

A huge shoutout to UnslothAI for their incredible efforts! Thanks to their hard work, we can now run the full DeepSeek-R1 671B parameter model in its dynamic 1.58-bit quantized form (compressed to just 131GB) on Llama.cpp! And the best part? You no longer have to despair about needing massive enterprise-class GPUs or servers — it’s possible to run this model on your personal machine (albeit slowly for most consumer hardware).

📄️ 🖥️ Local LLM Setup with IPEX-LLM on Intel GPU

This guide is verified with MANTA setup through Manual Installation.

📄️ ⚛️ Continue.dev VSCode Extension with MANTA

Download Extension

📄️ 🛃 Setting up with Custom CA Store

If you get an [SSL: CERTIFICATEVERIFYFAILED] error when trying to run OI, most likely the issue is that you are on a network which intercepts HTTPS traffic (e.g. a corporate network).

📄️ 🌐 Browser Search Engine

MANTA allows you to integrate directly into your web browser. This tutorial will guide you through the process of setting up MANTA as a custom search engine, enabling you to execute queries easily from your browser's address bar.

📄️ 💥 Monitoring and Debugging with Langfuse

Langfuse (GitHub) offers open source observability and evaluations for MANTA. By enabling the Langfuse integration, you can trace your application data with Langfuse to develop, monitor, and improve the use of MANTA, including: