iCrawl is a Web Crawling toolbox developed at L3S Research Center. It provides integrated and focused crawling of Web and Social Media data, i.e. the combined crawling of the Web and Social Media for a specified topic. It allows researchers, journalists and other domain experts to easily create and run web crawls to collect, analyze and archive web documents for their specific needs.

You can download the system and give it a go.

The system is described in the following published and several forthcoming papers:

Back to top

Reflow Maven skin by Andrius Velykis.