SEO tool
robots.txt & llms.txt Generator
An llms.txt file generator and robots.txt generator. Set search and AI crawler rules, write an LLM-readable overview, then copy robots.txt, llms.txt, or app/robots.ts. It all stays on your device.
Like the tool? Find a bug?Share with usGenerator
Fill the site, crawler policy, and llms.txt sections, then copy robots.txt, llms.txt, or a Next.js robots.ts. Files stay on this device.
Search crawlers
AI crawlers
llms.txt
Sections
01
02
Live preview
https://html69.com/robots.txt
User-agent: * Allow: / Disallow: /wp-admin/ Disallow: /wp-content/ Sitemap: https://www.html69.com/sitemap.xml Host: www.html69.com
User-agent: * Allow: / Disallow: /wp-admin/ Disallow: /wp-content/ Sitemap: https://www.html69.com/sitemap.xml Host: www.html69.com
# html69 > Fast, free developer utilities that run in the browser. Convert YAML, CSS, SVG, and Markdown, and generate SEO markup without uploading files. Every html69 tool stays on-device. There is no account and no API. Start with a tool page, then follow the markdown-friendly links below. ## Tools - [YAML to JSON Converter](https://www.html69.com/yaml-to-json): Convert YAML maps and lists into JSON in the browser. - [Schema Markup & JSON-LD Generator](https://www.html69.com/schema-markup-generator): FAQ, Article, and Product JSON-LD. - [SEO Meta Tag & Open Graph Generator](https://www.html69.com/meta-tag-generator): HTML head tags and a Next.js metadata export. ## Optional - [Blog](https://www.html69.com/blog): Guides for browser-based developer tools.
import type { MetadataRoute } from "next";
export default function robots(): MetadataRoute.Robots {
return {
rules: [
{
userAgent: "*",
allow: "/",
disallow: ["/wp-admin/", "/wp-content/"],
},
],
sitemap: "https://www.html69.com/sitemap.xml",
host: "www.html69.com",
};
}