Text Mining
Definition (01 Intro s.4): the extraction of implicit, previously unknown and potentially useful information from large amounts of textual resources.
- Motivation: ~90% of the world’s data is unstructured or semi-structured (web pages, emails, complaint letters, documents, papers, books) (s.3).
- Interdisciplinary: Data Mining, Information Retrieval, Computational Linguistics & NLP, Statistics, Machine Learning (s.4).
- Discovery (opportunistic) on text, versus Information Retrieval = goal-oriented search on text; Data Mining = discovery on structured data (s.10).
- Applications: news classification, spam filtering, Concept - Sentiment Analysis, clustering, search-term auto-completion, Concept - Information Extraction, search log mining (s.5-9).
- Pipeline: Concept - Text Mining Process.
Related
Concept - Text Mining Process | Concept - Text Preprocessing | Concept - Bag of Words