This release of Norconex Importer brings many fixes, increased stability, and nice new features. The following highlights some of the additions with XML configuration or Java code…
Blog
Notes from the team on crawling, search, and building data pipelines that hold up in production.
For a client last year, we had to upgrade some old Lucene code to Lucene 4. Lucene 4 was a rather large release and there are many aspects to be aware of when upgrading non…
Optical character recognition (ORC), content translation, title generation, detection and text extraction from more file formats, are among the new features now part of your…
Release 1.6.0 of Norconex Commons Lang provides new Java utility classes and enhancements to existing ones: New Classes TimeIdGenerator Use TimeIdGenerator when you need to…
This tutorial will show you how to extend Norconex HTTP Collector using Java to create a link checker to ensure all URLs in your web pages are valid. The link checker will crawl…
During a recent client project, I was required to crawl several websites with specific requirements for each. For example, one of the websites required: to have a meta tag content…
