Local LLM Helper

WebextLLM

Browser-native LLMs at your fingertips Unleash the Power of AI in Your Browser! WebextLLM is the first extension to embed large language models in the browser. The LLMs run in an isolated environment within the extension with zero configuration or external dependencies, making it the easiest method to run local inference on any platform (with 7 supported LLMs for you to choose from!). Experience a growing ecosystem of AI-based applications (with window.ai) as a user, and fuel it further as an application developer. Key Features * Own your models: Experience the freedom of owning your LLMs, enjoying a limitless, offline, private, and secure environment * Control: Exercise complete control over access to your LLM, granting or denying permission to any application at any time * Visibility: Gain insights into the history of prompts and responses to your model across different applications Why should you use WebextLLM? It's: 1. Free: The model runs on your hardware, eliminating the need for costly service providers 2. Private: Your data remains securely on your device, safeguarding your privacy 3. Unlimited: Take full control of the model without any quotas, censorship, or limitations 4. Highly available: Overcome limitations of internet connectivity and cloud-based LLM availability Disclaimer This extension is a proof-of-concept using experimental technologies. It is not recommended for production. By using this software, you assume all risks, including potential data loss, system failure, or other issues. The models and applications featured in this project are not endorsed by the author and the author is not responsible for any issues arising from their use.

Local LLM

Use Local LLM extension: run llm locally (LLama 70B or DeepSeek with WebLLM + Gemini Nano), ask ai models on your tabs - private ai. Meet a browser helper that makes running local models feel natural, fast, and private. If you like theese chats and want to have your personal, which will run on your computer - that's it. You now not limited for external services and can download it. Chat about website, pdf or any other file just in your browser. Get a good summary of pages. It is built for people who want a smooth and clean local llm ui, and a practical way to ask assistant while browsing. 🚀 Next models available for local usage: - Google’s Gemini Nano - embedded in Chrome - DeepSeek R1 Distill Llama 8B - deep thinking - running on your local - Qwen 3 - available from smallest 0.6B until strong 8B - Llama 3.1 70B ✅ How to start tips 1. Add the extension and open the sidebar 2. Pick from list in the local llm ui 3. Tap download once 4. Then keep using the same setup every day Models available for choosing are always visible, so switching is quick and predictable. You can rotate between lightweight and stronger options, keep your preferred local llm suite, and stay productive without tool hopping. Available choices includes different pre-built webllm for an in-browser experience. This helps you ask in chat on any website and use models with tab context, while keeping private ai as the default goal. 📦 Download once, then run always 1️⃣ Get local webllm single time 2️⃣ keep chat with GPT ready across sessions 3️⃣ reduce setup friction for ai llm tasks 4️⃣ stay consistent even when offline Website context is available for models, so it behaves like a real browser assistant. You can ask ai about your tabs, selected text, and current page content, then get grounded answers that fit your workflow. What you can do every day: • Summaries, highlights, and action items on webpage - and no internet required • Rewrite selected text in your tone - and llm runs in your local • Have a conversation across all your session • Turn a tab into notes or a checklist • Draft quick replies with page context Why it feels like an anything llm helper: ➤ Fast, repeatable prompts with ai ➤ Clear status and model switching in the local llm ui ➤ A easier flow for research and writing ➤ If you just to want to run llm on your local 📺 More smart things you can right away: 🔄 Turn messy pages into structured outlines for study or work 🔍 Extract definitions, names, and key facts without leaving the tab ❓Create follow-up questions to llm deepen understanding in seconds 🛡️Summarize multiple sources, then compare conclusions side by side 🎁 Build a short brief using only local open website context Privacy and control, without extra complexity: ▸ no query will leave your computer, while you using opensource models ▸ private ai, local by design ▸ WebLLM - framework to run LLM in browser For builders and explorers, it giving open source llms 🧩 - feels like you constructing your own local one. If you like to tinker, you can treat your setup like a personal lab: ➤ keep a lightweight suite for speed, and a stronger one for reasoning ➤ test different local llms for different tasks and writing styles ➤ follow updates to track improvements in quality and stability ➤ explore open source llms trends without changing your daily flow Updates stay manageable and user-friendly: 💎 Updates that improve output quality 🚀 Simple model switching without breaking your flow Extra details that help in real life: • Clear separation between tab context and your own notes on you local • A repeatable workflow that supports research, writing, and planning • Consistent behavior even across long sessions and many open pages • A simple path from download ai to daily use, without extra steps If you are teaching someone an easy way to install their own llm, this is a clean starting point. It also matches a downloadable ai repository mindset, so you can download ai once, keep ai models ready, and avoid repeating the same setup steps. Use cases people love: ◆ summarize long articles ◆ extract action items from docs ◆ rewrite emails from page context ◆ compare sources in website ◆ create structured notes fast Bonus ideas for everyday browsing: 1️⃣ Create a quick glossary from technical pages 2️⃣ Turn documentation into a checklist you can follow 3️⃣ Rewrite content for different audiences or levels 4️⃣ Generate a short briefing from tab at once 5️⃣ Capture key takeaways for your personal knowledge base

open-os LLM Browser Extension

Quick access to your favorite local LLM from your browser (Ollama). Ollama UI. A lightweight, open-source extension for Chromium-based browsers (Chrome, Brave, Edge) that gives you instant access to your local AI assistant while you browse. Features: - Works with any Ollama model — Llama 3, Qwen, Gemma, Mistral, DeepSeek, and more - Configurable Ollama host — connect to a remote server on your local network or anywhere - Switch between installed models on the fly - Streaming responses rendered token by token - Full Markdown support in conversations - Access from the sidebar (supported browsers) or as a new tab - Pre-prompts and scenarios to set the right context for your LLM - 6 built-in themes: Light, Dark, Light Modern, Dark Modern, Retro Terminal (MS-DOS), and NOSTROMO MU-TH-UR 6000 - Soul Identity Injection (experimental) — inject rich AI personalities like MU-TH-UR 6000, HAL 9000, or OS1 into your conversations. Powered by soul-protocol.com - Customization options: font size, username, assistant name, header text - Simple, fast, private — no accounts, no telemetry, no external servers 1. Install Ollama from https://ollama.com 2. Pull a model from your terminal, e.g.: ollama run llama3:8b 3. Click the extension icon to start chatting. Right-click to open in a new tab.

Chatty for LLMs

Helps you to chat and RAG with your LLMs via ollama This tool is designed to help to chat with your LLMs running locally using Ollama and perform RAG on the document in the active tab. Uses ollama to chat with your local LLMs installed. run ollama using this command: export OLLAMA_ORIGINS=chrome-extension://* ; ollama serve