1D-LDA vs. 2D-LDA: When is vector-based linear discriminant analysis better than matrix-based?
文献类型：期刊论文
| 作者 | Zheng, Wei-Shi2,3; Lai, J. H.1,3; Li, Stan Z.4,5
|
| 刊名 | PATTERN RECOGNITION
 |
| 出版日期 | 2008-07-01 |
| 卷号 | 41期号:7页码:2156-2172 |
| 关键词 | Fisher's linear discriminant analysis (LDA) matrix-based representation vector-based representation pattern recognition |
| 英文摘要 | Recent advances have shown that algorithms with (21)) matrix-based representation perform better than the traditional (I D) vector-based ones. In particular, 2D-LDA has been widely reported to outperform 1D-LDA. However, would the matrix-based linear discriminant analysis be always superior and when would 1D-LDA be better! In this paper, we investigate into these questions and have a comprehensive comparison between 1D-LDA and 2D-LDA in theory and in experiments. We analyze the heteroscedastic problem in 2D-LDA and formulate mathematical equalities to explore the relationship between 1D-LDA and 2D-LDA; then we point out potential problems in 2D-LDA. It is shown that 2D-LDA has eliminated the information contained in the covariance, information between different local geometric structures, such as the rows or the columns, which is useful for discriminant feature extraction, whereas 1D-LDA could preserve such information. Interestingly, this new finding indicates that 1D-LDA is able to gain higher Fisher score than 2D-LDA in some extreme case. Furthermore, sufficient conditions on which 2D-LDA would be Bayes optimal for two-class classification problem are derived and comparison with 1D-LDA in this aspect is also analyzed. This could help understand how 2D-LDA is expected to achieve at its best, further discover its relationship with 1D-LDA, and well support other findings. After the theoretical analysis, comprehensive experimental results are reported by fairly and extensively comparing 1D-LDA with 2D-LDA. In contrast to the existing view that some 2D-LDA based algorithms would perform better than 1D-LDA when the number of training samples for each class is small or when the number of discriminant features used is small, we show that it is not always true and show that some standard 1D-LDA based algorithms could perform better in those cases on some challenging data sets. (c) 2007 Elsevier Ltd. All rights reserved. |
| WOS标题词 | Science & Technology ; Technology |
| 类目[WOS] | Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic |
| 研究领域[WOS] | Computer Science ; Engineering |
| 关键词[WOS] | INDEPENDENT COMPONENT ANALYSIS ; FACE-RECOGNITION ; FEATURE-EXTRACTION ; IMAGE MATRIX ; LDA ; PCA ; ALGORITHM ; CRITERION ; REPRESENTATION ; TRANSFORMATION |
| 收录类别 | SCI |
| 语种 | 英语 |
| WOS记录号 | WOS:000255818900005 |
| 公开日期 | 2015-12-24 |
| 源URL | [http://ir.ia.ac.cn/handle/173211/9664]  |
| 专题 | 自动化研究所_09年以前成果 |
| 作者单位 | 1.Sun Yat Sen Univ, Dept Elect & Commun Engn, Sch Informat Sci & Technol, Guangzhou, Peoples R China 2.Sun Yat Sen Univ, Sch Math & Computat Sci, Guangzhou, Peoples R China 3.Guangdong Prov Key Lab Informat Secur, Guangzhou, Guangdong, Peoples R China 4.Chinese Acad Sci, Ctr Biometr & Secur Res, Inst Automat, Beijing, Peoples R China 5.Chinese Acad Sci, Natl Lab Pattern Recognit, Inst Automat, Beijing, Peoples R China |
| 推荐引用方式 GB/T 7714 | Zheng, Wei-Shi,Lai, J. H.,Li, Stan Z.. 1D-LDA vs. 2D-LDA: When is vector-based linear discriminant analysis better than matrix-based?[J]. PATTERN RECOGNITION,2008,41(7):2156-2172. |
| APA | Zheng, Wei-Shi,Lai, J. H.,&Li, Stan Z..(2008).1D-LDA vs. 2D-LDA: When is vector-based linear discriminant analysis better than matrix-based?.PATTERN RECOGNITION,41(7),2156-2172. |
| MLA | Zheng, Wei-Shi,et al."1D-LDA vs. 2D-LDA: When is vector-based linear discriminant analysis better than matrix-based?".PATTERN RECOGNITION 41.7(2008):2156-2172. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。