Information mining platforms: an infrastructure for KDD rapid deployment
Experience has shown that the data extraction, parsing, cleaning and analysis steps of a KDD problem account for a much larger expenditure of resources (time and money) than the statistical modeling or machine learning part. Couple this statement with the need for fast turn-around time in commercial applications, and the obvious conclusion is that it is impractical to start from scratch for each new KDD application. To deal with this situation, we propose the use of an information mining platform that amortizes several of the critical preand post-processing steps needed to apply KDD. Thus, new KDD applications can leverage the platform for efficiency and robustness.