Gungho is an extensible, high-performance web crawler framework.
Please see the included documentation for details