Commercial Web Crawling
Open-source crawlers allow you to locate and gather information from the web (HTTP). Once crawled, the data can be committed to top search engines such as Apache Solr, Elasticsearch, and others, or put to work in a variety of other ways. Whether you are crawling content from public websites, partner sites or your own content, you need the information gathered to be provided to you in an easily manageable format. We can help you to maximize the efficacy and efficiency of your web crawler so that you can achieve the best possible outcome.
The Challenge
As enterprise search specialists, we understand that the crawling process can be technically challenging, and some corporate users require commercial-level crawling services.
In response to these regular requests for commercial web crawling assistance with our Norconex HTTP Collector, we’re excited to introduce the packages below. Get started by choosing from the options below.
Why Choose Us?
Our in-house team of specialized search professionals brings years of experience to your project. We have the knowledge and skills to see your project through. When you need help and answers fast, you can rely on us to step in quickly. Our packages begin with response times as low as one hour!
Our company is based in Canada’s National Capital Region (just outside Ottawa). No outsourcing, no part-timers and no hobbyists; only the professional, high-quality enterprise search support you need.
Basic HTTP Crawler
For 1 website
Up to 500 pages/website
Web crawling included
Basic configuration included
Configuration of Standard Committer included
Intermediate HTTP Crawler
Up to 3 websites
Up to 1000 pages/website
Web crawling included
Basic configuration included
Configuration of Standard Committer included
Basic installation and testing on client’s environment
Enterprise Crawler Custom Packages
Unlimited websites
Unlimited pages/website
Web crawling included
Other sources crawling (Filesystem, database, REST API, etc)
Advanced configuration
Configuration of Standard Committer included
Full installation and testing on client’s environment