Building Google's Cheap Web Crawling Server

David explains how Google built their own cheap web crawling server by taking commodity hardware, making it redundant, and not putting a case or a cover on it. This allowed them to search more of the internet, do it better and faster, and have a higher refresh rate than anyone else.