CDV Index: A Validity Index for Better Clustering Quality Measurement

• 作者: Fei-Jie Joung Jia-Chi Lin Jian-Hua Yeh
• 来源期刊: 电脑和通信(英文)
• 学科: 医学
• 关键词: CLUSTER Validity INDEX UNSUPERVISED Learning K-Means Clustering INTRA CLUSTER COMPACTNESS Inter CLUSTER Dispersedness
• 年，卷（期）: dnhtxyw_2014,（4）
• 页码范围: 163-171
• 页数: 9页
• 分类号: R73

摘要

In this paper, a cluster validity index called CDV index is presented. The CDV index is capable of providing a quality measurement for the goodness of a clustering result for a data set. The CDV index is composed of three major factors, including a statistically calculated external diameter factor, a restorer factor to reduce the effect of data dimension, and a number of clusters related punishment factor. With the calculation of the product of the three factors under various number of clusters settings, the best clustering result for some number of clusters setting is able to be found by searching for the minimum value of CDV curve. In the empirical experiments presented in this research, K-Means clustering method is chosen for its simplicity and execution speed. For the presentation of the effectiveness and superiority of the CDV index in the experiments, several traditional cluster validity indexes were implemented as the control group of experiments, including DI, DBI, ADI, and the most effective PBM index in recent years. The data sets of the experiments are also carefully selected to justify the generalization of CDV index, including three real world data sets and three artificial data sets which are the simulation of real world data distribution. These data sets are all tested to present the superior features of CDV index.