Saw four robots.txt plugins on micro.blog — debating which one to install. It tells search engines to stay out — just a polite ‘no thanks,’ not a hard block. Good bots respect it, bad bots ignore it. I wonder if it’s even necessary. Worth it? How did I not know this has been around since 1994?

✍️ Reply by email    ✴️ Also on Micro.blog

Thanks so much for reading! If you want more posts like this one, hit that subscribe button, and you'll get my newest posts delivered straight to your inbox.