Docker is popular because it makes it easy to package and deliver programs. This article will show you how to run the Java-based, open-source crawler, Norconex HTTP Collector and…
Blog
Notes from the team on crawling, search, and building data pipelines that hold up in production.
Kafka users rejoice! You can now use Norconex open-source crawlers with Apache Kafka, thanks to the Norconex Apache Kafka Committer. We owe this contribution to Joseph Paulo…
Great news! There is now a Google Cloud Search Committer for Norconex Crawlers! This addition to the Norconex Collector family should delight Google Cloud Search fans. They too…
Norconex crawlers and Neo4j graph database are now a love match! Neo4j is arguably the most popular graph database out there. Use Norconex crawlers to harvest relationships from…
Norconex released version 2.7.0 of both its HTTP Collector and Filesystem Collector. This update, along with related component updates, introduces several interesting features.…
Norconex released an SQL Committer for its open-source crawlers (Norconex Collectors). This enables you to store your crawled information into an SQL database of your choice. To…