No Robots Here — Disallowed Path Discovery via robots.txt

robots.txt lists a Disallow path that the crawler is never supposed to visit. That path contains the flag.

January 1, 2024 · 1 min · giordii