 |
|
|
|
|
|
|||||||||
 |
||||||||||||||
|
||||||||||||||
|
||||||||||||||
 |
|||
|
|
|
|
|
VisualText serves to implement focused crawlers consisting of a suite of cooperating expert text analyzers. Typically, a top level analyzer manages the crawl by recording visited locations in its knowledge base, while calling an expert analyzer to parse a web page and to decide which links to visit next, as well as experts that analyze the content of particular types of web pages, e.g., to extract lists of people and their contact information, to process people's home pages, and the like. Below we link to a video describing the University Crawler, built by a TAI customer for the purpose of finding faculty and staff information within academic websites.
kewords: intelligent crawler, focused crawler.
|
|||