scrape-le
IntegrationWeb & browsingAnalyse robots.txt content and report whether a path may be crawled.
This server has no hosted endpoint yet, so ahel can't serve it. You can still add it. It stays paused until ahel can serve it.
One link, every agent. Your own credentials, stored once.
Signals
- GitHub stars
- 1
- Last commit
- Aug 2026
- Weekly downloads
- 70
Advanced
- Delivery
- scrape-le MCP server → your ahel gateway (mcp.ahel.ai) → every connected AI client.
- Catalog kind
- mcp-server
- Gateway key
io-github-nolindnaidoo-scrape-le- Source
- github.com/nolindnaidoo/scrape-le