WordPress.org

Sardu

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: crawler

Plugin Tag: crawler

  • GoBookMart Robots Editor

    (1 total ratings)

    A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.

    Gobookmart 10+ active installations Tested with 6.9.10

  • Page Modified

    (1 total ratings)

    Display the results of your Page Modified crawls right within your WordPress Admin.

    Chris Klosowski 10+ active installations Tested with 4.9.34

  • Rankal LLMs.txt – Get Cited by ChatGPT, Claude & Perplexity

    (1 total ratings)

    Generate and serve a dynamic, cached /llms.txt AI context index. An add-on that works in partnership with Rankal SEO Optimizer.

    rankalseo 10+ active installations Tested with 7.1.3

  • Robots.txt Extender

    (0 total ratings)

    Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

    bettoadami 10+ active installations Tested with 5.0.30

  • GoVISIBLE AI Bot Tracker

    (0 total ratings)

    Track visits from AI bots like ChatGPT, GPTBot, Claude, Gemini, and Perplexity.

    GoVISIBLE 10+ active installations Tested with 7.0.7

  • JaspreetChahal’s wordpress bot detector lite

    (1 total ratings)

    This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …

    Jaspreet Chahal 10+ active installations Tested with 4.2.39

  • Trackbase Analytics

    (0 total ratings)

    Official Trackbase Analytics plugin for WordPress. Add your tracking ID and enable server-side crawler analytics in minutes.

    trackbase 10+ active installations Tested with 7.0.7

  • SEObot Monitor for Googlebot, Bingbot and search engine spiders

    (0 total ratings)

    With SEObot Monitor for Googlebot you will be able to dump the server logs to Google Analytics, easily and automatically. This will allow you to dete …

    Santiago Alonso 10+ active installations Tested with 5.8.18

  • EZDIGI Tool

    (0 total ratings)

    All-in-one management toolkit for WordPress: site security, bot blocker, crawler, image optimizer, variation fixer, affiliate manager, live streaming …

    EZDIGI Fewer than 10 active installations Tested with 7.1.3

  • OpenBotAuth – AI Crawler Access Control

    (0 total ratings)

    Verify AI crawlers with HTTP Signatures and enforce allow/deny/teaser policies; also serves llms.txt and AI-ready feeds.

    hammadtq Fewer than 10 active installations Tested with 6.9.10

  • ReadyStack Robots Txt AI Crawler Audit

    (0 total ratings)

    Checks robots.txt line by line and says what each AI crawler token actually controls – training, AI-search citation, or user fetch – and which lines.

    readystack Fewer than 10 active installations Tested with 7.1.3

  • AILYS Lens

    (1 total ratings)

    See how AI reads your site. Detects, verifies, and displays AI crawler visits — all data stays on your own server.

    roadleon Fewer than 10 active installations Tested with 7.1.3

  • OtterFixer AI Bot Tracker

    (0 total ratings)

    A lightweight plugin that logs visits from common AI/LLM crawler user-agents and shows a simple report in wp-admin.

    OtterFixer Fewer than 10 active installations Tested with 6.9.10

  • Softrecs AI Crawler Access Check

    (0 total ratings)

    Checks whether AI search and answer engines can reach your site: robots.txt per bot, a live request as each bot, noindex and snippet controls.

    Alauddin Chowdhury Fewer than 10 active installations Tested with 7.1.3

  • Aiso AI Crawler Analytics

    (0 total ratings)

    See which AI assistants — ChatGPT, Claude, Perplexity, Google and more — crawl your site, broken down by assistant, crawler, purpose and page.

    bentannenbaum Fewer than 10 active installations Tested with 7.0.7

  • Msite AI Crawler Monitor

    (0 total ratings)

    See which AI crawlers visit your site and check that your site is technically ready for AI engines. Hebrew and RTL friendly.

    Kobi Mashiah – Msite Fewer than 10 active installations Tested with 7.1.3

  • FacetFence Product Filters

    (0 total ratings)

    Protect WooCommerce filtered URLs from crawl floods with noindex/canonical controls, signed cookies, rate limits, logs, and rollback.

    Hamidreza Rezaei Fewer than 10 active installations Tested with 7.0.7

  • Limpark Bot Monitor

    (0 total ratings)

    Monitor search engine bots visiting your WordPress website in real time.

    limpark Fewer than 10 active installations Tested with 7.0.7

  • LLMAffiliate AI Traffic Monetizer

    (0 total ratings)

    Detect LLM user agents, enforce Google parity, and serve enhanced content through a configurable content service.

    llmaffiliate01 Fewer than 10 active installations Tested with 7.1.3

  • NMOS Crawl Tracking

    (0 total ratings)

    Install NMOS.NET meta tag, tracking.js, and optional no-JS beacon on your WordPress site.

    NMOS Fewer than 10 active installations Tested with 7.1.3