• @[email protected]
      link
      fedilink
      English
      5
      edit-2
      4 months ago

      I also don’t know if a law that says search engines have to honor a robots.txt file. I guess we will see what happens if Bing or some other service decides to ignore it.

      • @[email protected]
        link
        fedilink
        English
        14 months ago

        You can just require a log in to view content, or just flat out auto ban indexing robots.