Content Gathering (2)
Techniques
- Search Engines
- Crawling: Topic distillation, Classification, User preferences
- Presentation: Automatic classification/refinement
- XML helps here to get “behind the peephole”
- Extraction
- Wrapper templates
- Summarize and correlate documents (feature selection)
- Steady progress, but unrelated to warehouse infrastructure