Posts tagged ‘Filesystem Collector’

Use Norconex crawlers with Apache Kafka

Kafka users rejoice! You can now use Norconex open-source crawlers with Apache Kafka, thanks to the Norconex Apache Kafka Committer. We owe this contribution to Joseph Paulo Mantuano (Senior Developer at The Red Flag Group) and Dan Davis. The Norconex Collectors community keeps growing. We ... Read More...


Posted on July 23, 2019 by in Latest Releases


An Open-Source Crawler for Google Cloud Search

Great news! There is now a Google Cloud Search Committer for Norconex Crawlers! This addition to Norconex Collector family should delight Google Cloud Search fans.  They too can now enjoy the full-featured crawling capabilities offered by Norconex Open-Source crawlers. Since this ... Read More...


Posted on May 31, 2019 by in Latest Releases


AWS Public Sector Summit 2019 in Ottawa

Amazon Web Services (AWS) and the Canadian Public Sector organized another excellent Public Sector Summit on May 15, 2019. AWS hosted the first such summit in Ottawa last year, but this year’s event attracted a much larger crowd. Thousands of ... Read More...


Posted on May 24, 2019 by in Latest Events


Open-Source Crawlers for Neo4j

Norconex crawlers and Neo4j graph database are now a love match! Neo4j is arguably the most popular graph database out there. Use Norconex crawlers to harvest relationships from websites and filesystems and feed them to your favorite graph engine. This was made ... Read More...


Posted on January 15, 2019 by in Latest Releases


Norconex HTTP Collector 2.8.0 released

Norconex is proud to announce the release of Norconex HTTP Collector version 2.8.0.  This release is accompanied by new releases of many related Norconex open-source products (Filesystem Collector, Importer, Committers, etc.), and together they bring dozens of new features and ... Read More...


Posted on November 26, 2017 by in Latest Releases


An Open-Source Crawler That Feeds an SQL Database

Norconex released an SQL Committer for its open-source crawlers (Norconex Collectors).  This enables you to store your crawled information into an SQL database of your choice. To define an SQL database as your crawler’s target repository, follow these steps: Download ... Read More...


Posted on May 29, 2017 by in Latest Releases


Diagrams for Norconex Crawlers

Norconex just made it easier to understand the inner-workings of its crawlers by creating clickable flow diagrams. Those diagrams are now available as part of both the Norconex HTTP Collector and Norconex Filesystem Collector websites. Clicking on a shape will ... Read More...


Posted on May 15, 2017 by in Latest Articles


Indexing to an AWS CloudSearch Domain

Amazon Web Services (AWS) have been all the rage lately, used by many organizations, companies and even individuals. This rise in popularity can be attributed to the sheer number of services provided by AWS, such as Elastic Compute (EC2), Elastic ... Read More...


Posted on May 4, 2017 by in Latest Articles


Norconex HTTP and Filesystem Collector 2.7.0 released

Norconex released version 2.7.0 of both its HTTP Collector and Filesystem Collector.  This update, along with related component updates, introduces several interesting features. HTTP Collector changes The following items are specific to the HTTP Collector.  For changes applying to both the ... Read More...


Posted on April 26, 2017 by in Latest Releases


New release of Norconex Collectors

Optical character recognition (ORC), content translation, title generation, detection and text extraction from more file formats, are among the new features now part of your favorite crawlers: Norconex HTTP Collector 2.1.0 and Norconex Filesystem Collector 2.1.0. They are both available ... Read More...


Posted on April 8, 2015 by in Latest Releases


Sorry, no posts matched your criteria.