robots-txt
by community
Use this page as a decision snapshot for robots-txt: trust signal, install momentum, real user feedback, and high-intent related pages you can compare next.
Description
When the user wants to configure, audit, or optimize robots.txt. Also use when the user mentions "robots.txt," "crawler rules," "block crawlers," "AI crawler...
Install robots-txt
Run this in your OpenClaw agent to add robots-txt from the ClawHub registry.
openclaw skills install robots-txtRequires ClawHub registry access. Review the security analysis below before installing.
Security Analysis
Open Source
Code is publicly available for audit.
Community Verified
Reviewed by the ClawHub community.
Community Reviews
Real user ratings only — separate from the editorial assessment and ClawHub signal.
Installed this skill? Sign in and leave the first review.
Save the skill now, come back after testing it, and help the next person choose with a quick review.
Related skills
Frequently asked questions
Is robots-txt safe to install?
robots-txt has a SkillsReview security score of 50/100. It is open source and community-verified on ClawHub. Check the full Security Analysis on this page before installing.
How much does robots-txt cost?
robots-txt is free to install for OpenClaw via ClawHub.
What are the best alternatives to robots-txt?
You can compare robots-txt side by side with similar OpenClaw skills on the SkillsReview comparison page to find the best fit for your workflow.
How do I install robots-txt?
Install robots-txt from ClawHub at clawhub.ai/skills/robots-txt, or use the install action on this page to copy the command for your OpenClaw agent.
Community Signal
Historical movement
Timeline plus trend snapshots for security, reviews, and reputation tilt.
Trend Charts
30 / 90 / 180 day snapshots for ranking movement and security-score movement.
Last updated unknown UTC
Submit your review
Share your experience and help others find the best skills.
Newsletter
Stay updated on robots-txt and the wider SkillsReview ecosystem
Get the weekly Top 5, fresh security alerts, and newly hot skills by email. You can unsubscribe from any newsletter email in one click.