ppaknoehgmcpjhpjmbbclhmegelnpfim
Checks for the presence of llms.txt and llms-full.txt on the current website. Unlock AI-Ready Content with LLMs.txt Checker & LLMs-full.txt Finder As the ecosystem for Large Language Models (LLMs) evolves, a new standard for AI-friendly documentation is emerging. The llms.txt and llms-full.txt files provide concise, markdown-formatted summaries and full-text context designed specifically for AI tools and developers. LLMs.txt Checker & LLMs-full.txt Finder is an essential utility for developers, researchers, and AI enthusiasts. It automatically detects if a website provides these specialized context files, allowing you to quickly gather the best data for your AI prompts, RAG (Retrieval-Augmented Generation) pipelines, or custom GPTs. Key Features Real-Time Detection: Automatically scans the root directory of any website you visit for /llms.txt and /llms-full.txt files. Instant Visual Feedback: A smart badge on your browser toolbar changes color based on file availability: > Orange: One of the two files is available. One-Click Access: Open the detected files directly from the extension popup to copy content or view documentation. Developer-Friendly Interface: Clean, modern UI with Light and Dark mode support that displays the current domain and the specific status of each file. Optimized Performance: Uses an intelligent 1-minute memory cache to prevent redundant network requests and ensure a fast browsing experience. Why Install This Extension? 1. Faster AI Prompting Stop hunting through complex HTML menus. If a site has an llms.txt file, you can immediately grab the exact context your LLM needs for accurate results. 2. Support the AI-Ready Web Stay ahead of the curve as more documentation sites (like Tailwind CSS, Astro, and others) adopt the llms.txt standard to help AI models understand their content better. 3. Streamline RAG Workflows For developers building AI-powered applications, this tool provides a quick way to verify if a source is "AI-friendly," saving you time during the data ingestion phase. How It Works The extension performs a lightweight HEAD request to check for the existence of these files without downloading the entire page content. It respects your privacy and only activates on http and https protocols. Get the best context for your LLMs today. Install LLMs.txt Checker and start discovering AI-ready documentation everywhere.
Robots Exclusion Checker
Checks robots.txt, meta robots, x-robots-tag with URL alerts. Canonical warnings, HTTP header info. An SEO extension, robots tester. Robots Exclusion Checker is designed to visually indicate whether any robots exclusions are preventing your page from being crawled or indexed by Search Engines. ## The extension reports on 6 elements: 1. Robots.txt 2. Meta Robots tag 3. A.I. Bots 4. X-robots-tag 5. Rel=Canonical 6. UGC, Sponsored and Nofollow attribute values If a URL you are visiting is being affected by an "Allow” or “Disallow” within robots.txt, the extension will show you the specific rule within the extension, making it easy to copy or visit the live robots.txt. You will also be shown the full robots.txt with the specific rule highlighted (if applicable). Cool eh! Any Robots Meta tags that direct robots to “index", “noindex", “follow" or “nofollow" will flag the appropriate Red, Amber or Green icons. Directives that won’t affect Search Engine indexation, such as “nosnippet” or “noodp” will be shown but won’t be factored into the alerts. The extension makes it easy to view all directives, along with showing you any HTML meta robots tags in full that appear in the source code. Checks whether a website's robots.txt file blocks A.I. companies from accessing its content. It monitors 14 bots across 6 companies - OpenAI, Anthropic, Google, Perplexity, Meta, and Apple, covering three types of access: training data collection, search indexing, and real-time browsing. If any bot exclusions are detected, an "AI" label will appear over the Robots Exclusion Checker icon in your browser. This feature can be deactivated within settings if preferred. Spotting any robots directives in the HTTP header has been a bit of a pain in the past but no longer with this extension. Any specific exclusions will be made very visible, as well as the full HTTP Header - with the specific exclusions highlighted too! Although the canonical tag doesn’t directly impact indexation, it can still impact how your URLs behave within SERPS (Search Engine Results Pages). If the page you are viewing is Allowed to bots but a Canonical mismatch has been detected (the current URL is different to the Canonical URL) then the extension will flag an Amber icon. Canonical information is collected on every page from within the HTML and HTTP header response. - UGC, Sponsored and Nofollow A new addition to the extension gives you the option to highlight any visible links that use a "nofollow", "ugc" or "sponsored" rel attribute value. You can control which links are highlighted and set your preferred colour for each. I’d you’d prefer this is disabled, you can switch off entirely. Within settings, you can choose one of the following user-agents to simulate what each Search Engine has access to: This tool will be useful for anyone working in Search Engine Optimisation (SEO) or digital marketing, as it gives a clear visual indication if the page is being blocked by robots.txt (many existing extensions don’t flag this). Crawl or indexation issues have a direct bearing on how well your website performs in organic results, so this extension should be part of your SEO developer toolkit for Google Chrome. An alternative to some of the common robots.txt testers available online. This extension is useful for: - Faceted navigation review and optimisation (useful to see the robot control behind complex / stacked facets) - Detecting crawl or indexation issues - General SEO review and auditing within your browser ## Avoid the need for multiple SEO Extensions Within the realm of robots and indexation, there is no better extension available. In fact, by installing Robots Exclusion Checker you will avoid having to run multiple extensions within Chrome that will slow down its functionality. 1.0.3: Various bug fixes, including better handling of URLs with encoded characters. Robots.txt expansion feature to allow the viewing of extra-long rules. Now JavaScript history.pushState() compatible. 1.0.4: Various upgrades. Canonical tag detection added (HTML and HTTP Header) with Amber icon alerts. Robots.txt is now shown in full, with the appropriate rule highlighted. X-robots-tag now highlighted within full HTTP header information. Various UX improvements, such as "Copy to Clipboard” and “View Source” links. Social share icons added. 1.0.5: Forces a background HTTP header call when the extension detects a URL change but no new HTTP header info - mainly for sites heavily dependant on JavaScript. 1.0.6: Fixed an issue with the hash part of the URL when doing a canonical check. 1.0.7: Forces a background body response call in addition to HTTP headers, to ensure a non-cached view of the URL for JavaScript heavy sites. 1.0.8: Fixed an error that occurred when multiple references to the same user-agent were detected within robots.txt file. 1.0.9: Fixed an issue with the canonical mismatch alert. 1.1.0: Various UI updates, including a JavaScript alert when the extension detects a URL change with no new HTTP request. 1.1.3: Added UGC, Sponsored and Nofollow link highlighting. 1.1.4: Switched off nofollow link highlighting by default on new installs and fixed a bug related to HTTP header canonical mismatches. 1.1.6: Extension now flags 404 errors in Red. 1.1.7: Not sending cookies when making a background request to fetch a page that was navigated to with pushstate. 1.1.8: Improvements to the handling of relative vs absolute canonical URLs and unencoded URL messaging. 1.2.0.11: Updating to Google's new manifest V3 and fixing small bugs. 1.2.0.12: Added a Spanish language version and made improvements to existing translations. Linking to new website https://www.checkrobots.com 1.2.0.13: Fixed pushState navigation data extraction, resolved inconsistent icon display, and added security protections to prevent logout issues with enterprise websites. 1.3.0: Introduced A.I. bot checking to monitor robots.txt exclusion rules for 14 bots across 6 companies including OpenAI, Anthropic, Google, Perplexity, Meta and Apple, with training, search indexing and real-time browsing bots tracked. New site exclusion feature lets you skip checking for specific domains. Fixes for SPA/back-forward navigation, x-robots-tag case sensitivity for Bingbot and Yahoo and improved allow/disallow rule precedence. Redesigned settings page with collapsible sections.
Image Alt Text Missing Finder and Highlighter
Find and highlight images missing alt text and title attributes. View alt text of all images on any webpage for better accessibility Improve web accessibility and SEO efficiency with Image Alt Text Missing Finder and Highlighter, the definitive browser tool for identifying, auditing, and optimizing image metadata. This extension is designed to bridge the gap between complex accessibility compliance and fast-paced web development. The Problem: Why Image Alt Text Matters Missing image alternative text is one of the most common accessibility failures on the web today. For visually impaired users relying on screen readers, an image without alt text is a "black hole" of information. Furthermore, search engine crawlers use this data to understand and rank your content. That means it also helps SEO. Without it, your site loses visibility and inclusivity. What Image Alt Text Missing Finder and Highlighter Fixes? Manual auditing of large web pages for image attributes is tedious and prone to human error. This extension automates the discovery process, instantly flagging every image that lacks essential descriptions. It eliminates the need to "Inspect Element" on every graphic, saving hours of manual labor for developers, auditors, and marketers. Key Features and Capabilities 1) Real-Time Image Analysis: With a single click, the extension scans the entire Document Object Model (DOM) to provide a comprehensive count of total images, those with valid alt text, and those missing critical attributes. 2) Visual Highlighting System: Stop searching through code. The extension applies high-visibility colored borders and informative badges directly onto the webpage: a) Red (No Alt): Instantly spot images that are invisible to screen readers. c) Green (View Mode): Overlay actual alt text content over every image to verify descriptive accuracy without leaving the page. 3) Smart Badge Positioning: Using advanced logic, badges are placed to avoid being cropped by parent containers or hidden by overflow settings, ensuring you see the status of every asset regardless of site layout. d) Deduplicated URL Auditing: The "View URLs" feature provides a clean, deduplicated list of every image source on the page, allowing you to see how many times a specific asset is used and its corresponding metadata status. e) One-Click Export (CSV): Generate professional accessibility reports instantly. The CSV export includes image URLs, current alt/title text, occurrence counts, and specific issue flags—perfect for sharing with clients or team members. f) Multi-Language Support: Fully localized in English, German, and French to support global development teams. Empowering Your Workflow 1) For Web Developers & A11Y Specialists Accessibility shouldn't be an afterthought. Use this tool during the development and QA phases to ensure every component meets WCAG standards. The visual feedback loop allows you to fix missing attributes in real-time before code hits production. It handles relative-to-absolute URL conversion automatically, making it easy to track down assets hosted on CDNs or external servers. 2) For SEO Professionals & Content Strategists Image SEO is a massive driver of organic traffic. This extension allows you to quickly audit a client's site for "low-hanging fruit" optimization opportunities. By ensuring all images have descriptive, keyword-relevant alt text, you improve your chances of ranking in Image Search and increase the overall topical relevance of your pages. 3) For UI/UX Designers Understand how your visual hierarchy translates to non-visual users. The "View All Alt Text" mode lets you read the page as a screen reader would, helping you determine if your alt text is too repetitive, overly decorative, or actually helpful to the user journey. Why Choose This Extension? Unlike heavy auditing suites, this extension is lightweight and respects your privacy. It requires no external account and processes all data locally on your machine. It features a clean, modern interface designed to stay out of your way while providing the precise data points you need to make the web a more accessible, searchable place. Optimize your digital assets. Simplify your audit process. Make your website accessible to everyone.
LLMS.TXT Checker By LLMS-TXT.CO
Check if a website has a llms.txt file and suggest generation if missing. LLMS.TXT Checker helps you instantly verify if a website includes a valid llms.txt file, a powerful way to make your site discoverable by LLMs and AI bots like ChatGPT, Gemini, Claude, and more. 🚀 Improve AI visibility 🛡️ Simple & secure (no personal data collected) 🔍 One-click scan and insights Visit https://llms-txt.co for more.
LLMs.txt Generator
Generate llms.txt files for your website. Collect pages, add content, and create structured markdown files. The LLMs.txt Generator will help to create a LLMs.txt file easily by adding content via the floating button showing on web pages, and can edit it based on your preferences via the comprehensive Markdown editor, then download your LLMs.txt file easily when ready. Transform how you organize and share your website content with modern language models. The LLMs.txt Generator is the ultimate tool for creating structured, machine-readable documentation that helps language models understand your content better. Whether you're building a knowledge base, documenting your website, or preparing content for language model training, this extension simplifies the entire process from collection to export. Gone are the days of manually copying and pasting content from multiple tabs, losing track of sources, or spending hours formatting text files. This comprehensive content organization tool automates the tedious parts while giving you complete control over the final output. ### Floating Quick Button The floating quick button revolutionizes how you collect web content during your regular browsing sessions. This LLMs.txt Generator feature intelligently adapts to your browsing behavior, staying visible but never interfering with the page content. - **One-click page collection**: Instantly capture any webpage with a single click - **Smart content extraction**: Automatically pulls titles, descriptions, and metadata from multiple sources - **Visual feedback system**: Green checkmark indicates previously added pages - **Easy disable option**: Close button removes the floating element from all tabs - **Responsive positioning**: Adapts to different screen sizes and website layouts The smart content extraction engine works behind the scenes to automatically capture essential information without you having to think about it. The system prioritizes accuracy, checking multiple sources including Open Graph tags, Twitter meta tags, and traditional HTML elements. ### Multiple Collection Methods Flexibility is key when building content collections, which is why this content organization extension offers four distinct methods to capture information. Each method serves different use cases and browsing patterns, ensuring you never miss important content regardless of how you discover it. - **Current page capture**: Add the active browser tab instantly from the extension popup - **Manual entry system**: Input URLs, titles, and descriptions with complete control - **Right-click context menu**: Add pages or links directly from the browser's right-click menu - **Bulk collection capability**: Efficiently gather multiple pages across different browsing sessions - **Cross-session persistence**: Maintains your collection between browser restarts and updates Current page capture provides instant gratification for active browsing, while manual entry gives you complete control over every detail. The right-click context menu integrates seamlessly into your natural browsing behavior. ### Smart Category Management Organization is crucial for large content collections, and this LLMs.txt file creator's category system grows with your needs. The three thoughtfully chosen default categories cover most common content types, but the real power lies in unlimited customization options. - **Default categories**: Posts, Pages, and Resources for immediate organization - **Unlimited custom categories**: Create categories that match your specific project needs - **Default category setting**: Automatically assign quick-button additions to your preferred category - **Intelligent URL-based suggestions**: System suggests categories based on webpage URL patterns - **Easy category management**: Add, edit, or delete categories through the intuitive interface Custom categories unlock unlimited organizational possibilities for any project type. Create categories like "Customer Stories," "Technical Documentation," or "Industry Reports" to match your specific workflow. ### Professional Editor & Export The built-in editor transforms your collected links into professional documentation ready for any use case. This comprehensive editing suite within the LLMs.txt Generator provides everything needed to create polished, structured documents. - **Live preview rendering**: See changes instantly as you edit your content - **Rich formatting toolbar**: Headers, bold, italic, lists, blockquotes, and links at your fingertips - **Automatic content generation**: Compiles collected entries into well-structured markdown documents - **Professional download functionality**: Creates perfect llms.txt files ready for deployment - **Cross-platform compatibility**: Standard markdown formatting works everywhere Content generation automatically compiles your collected entries into well-structured documents, grouping them by category and formatting them consistently. The rich formatting toolbar puts professional typography options at your fingertips without requiring markdown expertise. ### Setting Up Quick Button Getting started with the floating quick button takes just a few seconds and dramatically improves your content collection efficiency. The LLMs.txt Generator extension makes initial setup intuitive, requiring only a few clicks to activate the most powerful collection method. **Step-by-step setup process:** 1. **Locate the extension icon**: Find the document icon in your browser toolbar with the entry count badge 2. **Open the main popup**: Click the icon to access the full interface and settings 3. **Enable the floating button**: Toggle the "Show Quick Button on Pages" switch to activate 4. **Set default category**: Choose your preferred category for automatic assignment 5. **Verify activation**: Look for the floating button on any website within seconds The default category setting appears directly below the toggle switch, allowing you to choose which category automatically applies to pages added via the floating button. This setting saves significant time by eliminating repetitive categorization steps. ### Collecting Pages The extension offers multiple collection methods to match different browsing patterns and preferences. Each method captures comprehensive information but fits different situations and workflows. **Method 1 - Floating Button Workflow:** - Navigate to any webpage you want to include in your collection - Click the prominent "Add to LLMs" button when it appears automatically - Watch for visual confirmation as the button shows "Adding..." then "Added!" - See the immediate green checkmark indicating successful capture - Continue browsing with your content safely stored using your default category **Method 2 - Extension Popup Workflow:** - Click the extension icon in your toolbar for controlled addition - Use "Add Current Page" for immediate capture of the active tab - Access manual entry for complete control over titles and descriptions - Choose specific categories through the dropdown menu - Review your collection overview and current settings **Method 3 - Context Menu Integration:** - Right-click anywhere on a page to see the "Add to LLMs.txt" option - Select the menu item to capture the current page without toolbar interaction - Right-click individual links to add referenced pages without visiting them - Perfect for collecting sources while reading articles or research papers - Maintains reading flow without interrupting your concentration The context menu method is particularly valuable when reading articles that reference multiple sources you want to explore later. This content organization tool understands that research often involves following trails of references. ### Managing Categories Effective category management keeps your content organized and makes the final document more useful for both human readers and language models. The LLMs.txt Generator balances simplicity with powerful customization options. **Working with default categories:** - **Posts**: Best for time-sensitive content like blog articles, news stories, and announcements - **Pages**: Perfect for evergreen content like company information, team bios, and policy documents - **Resources**: Ideal for reference materials, documentation, tools, and downloadable content - **Automatic suggestions**: System recommends categories based on URL patterns like "/blog/" or "/docs/" - **Override flexibility**: Always maintain final control over categorization decisions **Creating and managing custom categories:** - Access the "+" button next to category dropdowns in the popup interface - Enter descriptive names that will make sense months later during review - Consider your specific use case when naming (e.g., "Competitor Analysis," "Case Studies") - Delete unused categories with the "×" button to maintain clean organization - Understand that existing entries remain safe when categories are deleted The default category setting for the floating button eliminates repetitive selection steps while maintaining override flexibility. The LLMs.txt file creator adapts to any organizational methodology. ### Creating Your llms.txt File The editor transforms your collected links into professional documentation through a streamlined workflow that accommodates both quick exports and detailed customization. **Complete editing workflow:** 1. **Access the full editor**: Click "Open Full Editor" from the extension popup 2. **Generate base content**: Hit "Generate Content" to compile all collected entries automatically 3. **Review structure**: Examine the organized categories and entry formatting 4. **Customize content**: Use the formatting toolbar to enhance and modify the document 5. **Preview changes**: Monitor the live preview panel for immediate visual feedback 6. **Export final file**: Download your completed llms.txt file with one click **Professional formatting options:** - **Header hierarchy**: Create clear document structure with H1, H2, and H3 buttons - **Text emphasis**: Apply bold and italic formatting for important information - **List organization**: Build scannable content with organized bullet points - **Quote highlighting**: Use blockquotes for important information or citations - **Link integration**: Add cross-references and additional context links The live preview updating means you never have to guess how your final document will look. Every change in the editor immediately appears in the preview panel, showing exactly how your final document will appear in the exported file. ### For Content Creators Content creators face unique challenges in organizing research, tracking inspiration, and maintaining consistent documentation across projects. The LLMs.txt Generator addresses these challenges while enhancing creative workflows in measurable ways. **Workflow improvements include:** - **Seamless research integration**: Collect content naturally during inspiration phases without workflow interruption - **Professional presentation**: Generate clean, structured files that demonstrate attention to detail - **Brand consistency**: Maintain standardized organization across all projects and client work - **Time optimization**: Eliminate manual copying and formatting to focus on creative analysis - **Source reliability**: Never lose track of inspiration sources or reference materials Streamlined workflow integration means content collection happens naturally during research phases, separating collection from curation to improve both breadth and quality. Professional documentation capabilities elevate work perception. ### For Developers & Businesses Technical teams and businesses require reliable documentation systems that scale with growing projects and changing requirements. This LLMs.txt file creator provides enterprise-ready organization without enterprise-level complexity or cost. **Business advantages encompass:** - **Language model optimization**: Well-structured content improves interaction quality and response accuracy - **SEO enhancement**: Organized content structure sends positive signals to search engines - **Team collaboration**: Standardized formats reduce training time and minimize confusion - **Scalability assurance**: System handles growing content volume without additional complexity - **Knowledge preservation**: Systematic organization prevents information loss during team changes Language model optimization becomes increasingly important as businesses integrate these tools into workflows. The clean hierarchy and consistent formatting help language models provide more accurate responses. ### For Researchers & Educators Academic and educational work demands rigorous source tracking, systematic organization, and reliable citation management. The LLMs.txt Generator provides scholarly-level organization tools while maintaining workflow simplicity. **Research workflow benefits feature:** - **Comprehensive source tracking**: Automatic capture of URLs, titles, and metadata for proper attribution - **Citation management support**: Structured format facilitates bibliography creation and academic standards - **Systematic organization**: Category system supports analysis by theme, methodology, or chronology - **Collaboration facilitation**: Standardized format enables easy sharing with colleagues and students - **Quality maintenance**: Consistent organization supports systematic review processes Source tracking becomes effortless with automatic capture ensuring all necessary information for proper attribution is preserved from discovery. Citation management integrates smoothly with academic writing workflows. The LLMs.txt Generator provides comprehensive localization in English, French, German, and Chinese with complete interface translation and cultural adaptations. Native speakers contribute to translations ensuring natural language flow rather than mechanical conversion. **Privacy protection includes:** - **Local-only storage**: All collected content remains on your device under complete user control - **Zero external transmission**: No data sent to servers, accounts created, or third-party processing - **No tracking implementation**: No usage patterns, content preferences, or behavioral data collection - **Offline functionality**: Full editing, organization, and export capabilities without internet connectivity - **Minimal permissions**: Requests only specific browser capabilities needed for core functionality Every architectural decision prioritizes user control and data protection. Your research, business intelligence, and personal projects remain completely under your control. ## 💡 Perfect For The LLMs.txt Generator extension serves diverse use cases across professional, educational, and personal contexts. This content organization extension adapts to different working styles while maintaining consistent, professional output quality. **Content marketers and writers** building resource libraries can systematically collect competitor analysis and industry trends. **Developers and technical professionals** benefit from consistent formatting and reliable organization. **Researchers and academics** need reliable systems for source management and literature reviews. **Business professionals** creating knowledge bases benefit from professional formatting and consistent structure. **Anyone working with language models** finds the structured output format particularly valuable for training, fine-tuning, or prompt engineering. Clean organization helps language models better understand content relationships and context. Transform scattered bookmarks into professional documentation that serves multiple purposes across your work. Install the LLMs.txt Generator now and discover how systematic content organization elevates every aspect of your research and documentation workflow.
