Pegasus

About:

Pegasus is a robust, modular, multi-threaded web-crawler for clojure.

Details:

Examples:

Details: