Search Engines
Remove your media library from search engines
Section titled “Remove your media library from search engines”If you do not want to appear on Google or other search engines, you can ask them not to index your site.
Do this by adding a /public/robots.txt file to your project folder,
containing this content:
User-agent: *Disallow: /