Regularization and Estimation in Regression with Cluster Variables

• 作者: Bin Li Qingzhao Yu
• 来源期刊: 统计学期刊(英文)
• 学科: 数学
• 关键词: Clustered VARIABLES Lasso Principal COMPONENT ANALYSIS
• 年，卷（期）: 2014,（10）
• 页码范围: 814-825
• 页数: 12页
• 分类号: O1

摘要

Clustering Lasso, a new regularization method for linear regressions is proposed in the paper. The Clustering Lasso can select variable while keeping the correlation structures among variables. In addition, Clustering Lasso encourages selection of clusters of variables, so that variables having the same mechanism of predicting the response variable will be selected together in the regression model. A real microarray data example and simulation studies show that Clustering Lasso outperforms Lasso in terms of prediction performance, particularly when there is collinearity among variables and/or when the number of predictors is larger than the number of observations. The Clustering Lasso paths can be obtained using any established algorithm for Lasso solution. An algorithm is proposed to construct variable correlation structures and to compute Clustering Lasso paths efficiently.