Domain & Web · Robots & Sitemap
Robots.txt + Sitemap + Meta Analyzer
Inspect robots.txt, sitemap discovery and head meta of a page.
- slug
- robots-meta-analyzer
- visibility
- Public
- risk
- safe
- level
- 0
activesafemvp
01overview
What this tool does.
Fetches the root robots.txt of the target site, discovers declared sitemaps, and inspects the canonical, title and robots meta of the page itself.
Built for fast SEO triage of a single URL.
02documentation
Dev-docs · 2 documents.
editorial
Related articles.
articleApr 20, 2026
Why Robots.txt, Sitemaps and Metadata Still Matter
These files are often overlooked. Here is why they are worth auditing and how they shape discoverability.
guideApr 20, 2026
Getting Started with Public Surface Analysis
A beginner-friendly walkthrough of what you can responsibly learn from a public URL.
guideApr 20, 2026
A Responsible Method for Reconnaissance on Public Web Surfaces
Reconnaissance is not inherently malicious. Here is how to do it ethically, legally and systematically.
articleApr 20, 2026
How to Turn Weak Signals into Better Questions
OSINT is not about finding smoking guns. It is about asking better questions.