Hacker Timesnew | past | comments | ask | show | jobs | submitlogin



If anyone's about to mirror the stuff on his web sites, it might be wise to act quickly. Wayback Machine always checks the current robots.txt for a given domain, so it's possible to block files that have already been archived.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: