# --- Default: private webapp blocked, only marketing/entry pages allowed --- User-agent: * Allow: /$ Allow: /index$ Allow: /web$ Allow: /web/ Allow: /sign-up$ Allow: /login$ Allow: /reset-password$ Allow: /web/wp-admin/admin-ajax.php Disallow: / Disallow: /web/wp-admin$ Disallow: /web/wp-admin/ Disallow: /web/wp-login.php Disallow: /web/docs/ai/en/ Disallow: /web/docs/ai/de/ Disallow: /web/llms.txt Disallow: /llms.txt # --- AI bots: same as above, but AI docs + llms.txt remain crawlable --- User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: Google-Extended User-agent: ClaudeBot User-agent: Claude-User User-agent: Claude-SearchBot User-agent: Claude-Web User-agent: PerplexityBot Allow: /$ Allow: /index$ Allow: /web$ Allow: /web/ Allow: /sign-up$ Allow: /login$ Allow: /reset-password$ Allow: /web/wp-admin/admin-ajax.php Allow: /web/llms.txt Allow: /llms.txt Disallow: / Disallow: /web/wp-admin$ Disallow: /web/wp-admin/ Disallow: /web/wp-login.php Sitemap: https://www.picdrop.com/web/sitemap_index.xml Sitemap: https://www.picdrop.com/web/docs/ai/sitemap-ai.xml