Great news! There is now a Google Cloud Search Committer for Norconex Crawlers! This addition to the Norconex Collector family should delight Google Cloud Search fans. They too…
Blog
Notes from the team on crawling, search, and building data pipelines that hold up in production.
Norconex released version 2.7.0 of both its HTTP Collector and Filesystem Collector. This update, along with related component updates, introduces several interesting features.…
Norconex just released version 1.2 of Norconex HTTP Collector, its open-source web crawler. Along with it comes a complete product web site redesign and a new logo: a lovely web…
There are many business applications where web crawling can be of benefit. You or your team likely have ongoing research projects or smaller projects that come up from time to…
Norconex has released version 2.6.0 of its HTTP Collector web crawler! Among new features, an upgrade of its Importer module brings new document parsing and manipulating…
Norconex has released Norconex HTTP Collector version 2.5.0! This new version of our open source web crawler was released to help minimize your re-crawling frequencies and…
