chore: update robots.txt to disallow /settings and /my-account (#19867)

* chore: update robots.txt to disallow /settings and /my-account * Update robots.txt --------- Co-authored-by: Keith Williams <keithwillcode@gmail.com>
2025-03-09 08:53:34 +00:00
parent f8af9dc17e
commit 3166db9bcf
1 changed files with 2 additions and 0 deletions
@@ -2,6 +2,8 @@ User-agent: *
 Disallow: /sandbox
 Disallow: /api
 Disallow: /static/locales
+Disallow: /settings
+Disallow: /settings/my-account

 # Specifically allow access to OG Image api, otherwise eg Twitter won't render these images.
 Allow: /api/social/og/image