Post from March 4, 2026

Saw four robots.txt plugins on micro.blog — debating which one to install. It tells search engines to stay out — just a polite ’no thanks,’ not a hard block. Good bots respect it, bad bots ignore it. I wonder if it’s even necessary. Worth it? How did I not know this has been around since 1994?