Open-source crawlers

Full-featured, flexible and extensible. Run on any platform. Crawl what you want, how you want.

Available Crawlers

...

HTTP Collector

Web crawler for the Internet or Intranet.

Download   More Info

...

Filesystem Collector

Crawl data from local disk, FTP, SFTP, WebDAV, HDFS, ...

Download   More Info

Features

Why chose Norconex Collectors? Click here or on a feature to learn more.

More features: HTTP Collector | Filesystem Collector

User Feedback

Real feedback from real Github users. Click a quote to view its origin.

Copyright © 2013-2017 Norconex Inc.