Crawler

SentinelaBot reads your site like a search engine.

It is the crawler behind Sentinela's Visibility module. It walks through a website's public pages to check that they remain accessible and indexable — accidental noindex, wrong canonical, broken sitemap. It only visits sites whose owner turned on this monitoring in their own account.

Identification

How it introduces itself.

User-Agent SentinelaBot/1.0 (+https://sentinelamonitor.com.br/bot)
Name in robots.txt User-agent: SentinelaBot

Upper or lower case makes no difference.

Egress addresses
  • 2.24.98.202
  • 2a02:4780:75:f9af::1

Allow these addresses in your firewall or WAF if you want the analysis to run.

Behavior

What it does and what it does not.

Honors robots.txt

It reads your robots.txt before any page and follows the rules of the SentinelaBot group — or, if there is none, those of the wildcard group (*).

Goes slowly

At most one request per second per site, and it honors Crawl-delay. It backs off on 429 or repeated 5xx errors, and stops when the site shows signs of overload.

Public pages only

It does not log in, submit forms, keep cookies or try protected areas. It reads the HTML and headers any visitor would see.

Never pretends to be another bot

It always identifies itself as SentinelaBot. It never poses as Googlebot, GPTBot or a regular browser to get around a rule.

Does not run JavaScript

It analyzes the HTML the server delivers. That keeps it light on your site — and it is also why it flags pages that need JavaScript to show their content.

Only where it was asked

It does not crawl the web. It only visits domains a Sentinela customer registered in the Visibility module, and only follows links within that same site.

Control

How to block or limit it.

robots.txt
Block the crawler on the whole site
User-agent: SentinelaBot
Disallow: /
robots.txt
Allow it, but slower and outside one folder
User-agent: SentinelaBot
Crawl-delay: 5
Disallow: /carrinho/

If you own the site and turned on Visibility, blocking SentinelaBot makes the analysis inconclusive: the report will say we could not read the site, not that it is fine.

Contact

Something wrong with the crawler?

If SentinelaBot is loading your site, ignoring a rule or visiting a domain you do not recognize, write to sentinela@m2hp.com.br.