ekobbgdgkocdnnjoahoojakmoimfjlbm
Query a local model from your browser. Elevate your browsing experience with our cutting-edge Chrome extension, designed to seamlessly interact with local models hosted on your own server. This extension allows you to unlock the power of querying local models effortlessly and with precision, all from within your browser. Our extension is fully compatible with both Llama CPP and .gguf models, providing you with a versatile solution for all your modeling needs. To get started, simply access our latest version, which includes a sample Llama CPP Flask server for your convenience. You can find this server on our GitHub repository: GitHub Repository - Local Llama Chrome Extension: https://github.com/mrdiamonddirt/local-llama-chrome-extension To set up the server, install the server's pip package with the following command: ``` pip install local-llama ``` Then, just run: ``` local-llama ``` With just a few straightforward steps, you can harness the capabilities of this extension. Run the provided Python script, install the extension, and instantly gain the ability to effortlessly query your local models. Experience the future of browser-based model interactions today.
SecureAI Chat: Chat with Local LLM Models
Private AI assistant that works with local LLMs (like LLaMA 3) using Ollama. Summarize pages, ask anything — all without cloud APIs. Chat with AI locally – no cloud required. This Chrome extension lets you interact with powerful open-source LLMs like LLaMA 3, running locally via Ollama, directly from any browser tab. 🔒 100% Private: Your data stays on your machine—no tracking, no cloud APIs, no data sent to external servers. Ask questions and get intelligent answers instantly Summarise selected web content with one click Launch a floating chat window on any page Clean, lightweight UI with a fast response 🛠️ Powered by Ollama – A simple, secure way to run local LLMs on your system. Whether you're researching, coding, reading, or brainstorming — this extension brings the full power of local AI into your browser. Disclaimer: This extension is not affiliated with or endorsed by Meta, Ollama, or Google. “LLaMA”, “Chrome”, and “Ollama” are trademarks of their respective owners.
Local LLM Helper
Interact with your local LLM server directly from your browser. Local LLM Helper: Your Browser's Gateway to Private AI Unlock the power of large language models right from your browser, with complete privacy and control. Local LLM Helper is a Chrome extension that seamlessly connects your browsing experience to your personal AI server, allowing you to harness advanced language processing capabilities without relying on cloud-based services. 1. Private and Secure: - Connect to your own local LLM server, ensuring your data never leaves your control. - Perfect for handling sensitive information or maintaining strict data privacy. 2. Versatile Text Processing: - Summarize lengthy articles or documents with a single click. - Transform casual text into professional-grade content. - Generate actionable items from meeting notes or project descriptions. - Generate Twitter threads or hot takes. - Craft custom prompts for specialized tasks. 3. Seamless Integration: - Works on MOST webpages, allowing you to process text without leaving your current tab. - Simple select-and-click interface for effortless use. 4. Customizable: - Compatible with various local LLM servers, including Ollama and LM Studio. - Easily switch between different AI models to suit your specific needs. 5. Resource-Efficient: - Leverage your local hardware, making it ideal for users with powerful GPUs or specialized AI hardware. 1. Select text on any webpage. 2. Choose a processing option (summarize, professionalize, generate action items, or custom prompt). 3. Click "Transform" and watch as your local AI processes the text. 4. View the results directly in your browser, formatted for easy reading. Setup and Compatibility: - Requires a local LLM server (e.g., Ollama, LM Studio) running on your machine or local network. - Easy configuration through the extension's options page. - Compatible with a wide range of LLM models, depending on your local setup. Privacy and Security: Local LLM Helper is designed with privacy as a top priority. Unlike cloud-based AI services, all processing occurs on your local machine or network. This means: - No data is sent to external servers. - Complete control over which models and data are used. - Ideal for businesses and individuals handling sensitive or confidential information. 1. Researchers and Students: - Quickly summarize academic papers or lengthy articles. - Generate study notes or key points from textbooks. 3. Content Creators: - Generate ideas or outlines from existing content. - Refine and polish draft content. Customization and Flexibility: Local LLM Helper is designed to be highly adaptable to your specific needs: - Custom Prompts: Create your own prompts for specialized tasks unique to your field or requirements. - Model Selection: Switch between different AI models to optimize for speed, accuracy, or specific domain knowledge. - Server Configuration: Easily update server settings to connect to different local LLM setups. Performance and Efficiency: By leveraging your local hardware, Local LLM Helper can offer: - Faster processing times, especially for users with powerful GPUs. - Ability to work offline, perfect for travel or areas with limited internet connectivity. - No usage limits or API costs associated with cloud-based services. 1. Install the Local LLM Helper extension from the Chrome Web Store. 2. Set up a local LLM server (like Ollama or LM Studio) on your machine or local network. 3. Configure the extension with your server's address and preferred model. 4. Start transforming text on any webpage with the power of AI! Troubleshooting and Support: The extension includes a comprehensive FAQ section covering common setup issues and best practices, including: - Configuring CORS settings for your local server. - Optimizing performance for different hardware setups. - Troubleshooting connection issues. For additional support, visit our GitHub repository for documentation, issue tracking, and community discussions. - Support for more local LLM server types. - Additional text processing options. - Integration with local vector databases for enhanced context-aware processing. - Collaborative features for team environments. Embrace the future of private, powerful, and personalized AI assistance with Local LLM Helper. Transform your browsing experience while keeping your data under your control. Download now and unlock the potential of your personal AI right in your browser!
WebextLLM
Browser-native LLMs at your fingertips Unleash the Power of AI in Your Browser! WebextLLM is the first extension to embed large language models in the browser. The LLMs run in an isolated environment within the extension with zero configuration or external dependencies, making it the easiest method to run local inference on any platform (with 7 supported LLMs for you to choose from!). Experience a growing ecosystem of AI-based applications (with window.ai) as a user, and fuel it further as an application developer. Key Features * Own your models: Experience the freedom of owning your LLMs, enjoying a limitless, offline, private, and secure environment * Control: Exercise complete control over access to your LLM, granting or denying permission to any application at any time * Visibility: Gain insights into the history of prompts and responses to your model across different applications Why should you use WebextLLM? It's: 1. Free: The model runs on your hardware, eliminating the need for costly service providers 2. Private: Your data remains securely on your device, safeguarding your privacy 3. Unlimited: Take full control of the model without any quotas, censorship, or limitations 4. Highly available: Overcome limitations of internet connectivity and cloud-based LLM availability Disclaimer This extension is a proof-of-concept using experimental technologies. It is not recommended for production. By using this software, you assume all risks, including potential data loss, system failure, or other issues. The models and applications featured in this project are not endorsed by the author and the author is not responsible for any issues arising from their use.
llama explain
Get an explanation from a llama (or another local LLM) about the selected text on a website, ELI5 style. All local. llama explain is a Chrome extension that explains complex text online in simple terms, by using a local-running LLM (Large Language Model). All is done locally on your machine. No data is sent to OpenAI's, or any other company's, server. No need to pay for any service. Just select the text you need help understanding, right click, and select 'llama explain' from the context menu. It's built on top of Ollama (https://ollama.ai/) and as such, currently runs only on MacOS. For full installation steps (on top of this extension, you also need to install Ollama and create models), please refer to https://github.com/welniak/llama-explain. The extension is open source, you can find the code at https://github.com/welniak/llama-explain.