Internet Archive to ignore robots.txt directives

[bitterross]

9. I disagree with you. Your argument is not logical.

If a person or company is so naive as to believe there is any such thing as an expectation of privacy on the Internet they are foolish. Once you publish something to the web it is now part of history. For better or worse and whether you like it or not.

What you are actually saying is the same as if you felt that when a business puts up a racist, bigoted, etc. sign in its front window then I shouldn't be able to take a picture of that and publish it later in a newspaper. I should honor their wishes to hide the fact they are racist, bigoted, etc. by not publishing the picture or even just keeping a copy of it. That makes no sense at all.

More importantly, if politicians and governments are using the robots.txt to try to prevent their content from being archived so it can be disappeared later then this move makes even more sense.