研究生: |
林秀菊 Shiow-Jyu Lin |
---|---|
論文名稱: |
以GHA實現快速主成分分析之硬體設計 Hardware Design of Fast Principal Component Analysis Using Generalized Hebbian Algorithm |
指導教授: |
黃文吉
Hwang, Wen-Jyi |
學位類別: |
博士 Doctor |
系所名稱: |
資訊工程學系 Department of Computer Science and Information Engineering |
論文出版年: | 2012 |
畢業學年度: | 100 |
語文別: | 英文 |
論文頁數: | 96 |
中文關鍵詞: | 主成分分析 、區塊計算 、場規劃閘陣列 、可程式系統晶片 |
英文關鍵詞: | PCA, Generalized Hebbian Algorithm (GHA), block-wise computation, FPGA, SOPC |
論文種類: | 學術論文 |
相關次數: | 點閱:135 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
本論文為實現快速主成分分析之硬體,提出三種GHA的硬體架構,分別為達成高速計算及最少的硬體資源消耗為目的。在高速計算的架構,所有主成分值計算與突觸權重值之更新,皆使用專屬的電路作並行之運算。對於高維度訓練資料之適用架構,以所有主成分值計算共用一個主成分計算電路輪流完成計算,並將訓練資料區塊化方式逐步更新每個神經元的突觸權重值。所有實現的硬體架構訓練取得之權重向量,應用在紋理的分類。
This dissertation proposes three types of GHA architectures, achieving the aims of high speed computation and low area costs, for fast principal component analysis. In the architecture with high speed computation, all principal components computation and synaptic weight vectors updating are operated concurrently in individual dedicated circuits. In the architectures with high-dimensional training vector, all principal components can be sequentially computed by a single circuit. Meanwhile, each synaptic weight vector is updated block by block in fixed number of synaptic weight updating modules. To demonstrate the effectiveness of the proposed architectures, texture classification will be adopted.
[Alp10] E. Alpaydin, Introduction to Machine Learning, 2nd ed., MIT Press, Massachusetts, USA, 2010.
[Bra10] Ignacio Bravo, Manuel Mazo, José L. Lázaro, Alfredo Gardel, Pedro Jiménez and Daniel Pizarro “An Intelligent Architecture Based on FPGA Designed to Detect Moving Objects by Using Principal Component Analysis,” Sensors, Vol. 10, pp. 9232 - 9251, 2010.
[Broda] Brodatz Textures Collection, http://www.ux.uis.no/~tranden/brodatz.html
[Boo01] W. Boonkumklao, Y. Miyanaga, and K. Dejhan, “Flexible PCA architecture realized on FPGA,” International Symposium on Communications and Information Technologies, pp.590 - 593, 2001.
[Car07] Gonzalo Carvajal, Waldo Valenzuela, and Miguel Figueroa, “Subspace-Based Face Recognition in Analog VLSI,” Advances in Neural Information Processing Systems, Vol. 20, MIT Press, Cambridge, pp. 225–232, 2007.
[Car09] Gonzalo Carvajal, Waldo Valenzuela, and Miguel Figueroa, “Image recognition in analog VLSI with on-chip learning”, Lecture Notes in Computer Science, Vol. 5768, pp. 428 - 438, 2009.
[Che08] Tung-Chien Chen, Wentai Liu, and Liang-Gee Chen, “VLSI architecture of leading eigenvector generation for on-chip principal component analysis spike sorting system,” Proceedings of the IEEE Engineering in Medicine and Biology Society Conference, Vancouver, pp. 3192-3195, 2008.
[Che09] Dake Chen and Han Jiu-qiang, “An FPGA-based Face Recognition Using Combined 5/3 DWT with PCA Methods,” Journal of Communication and Computer, Vol. 6, 2009.
[Dav12] David C. Lay and Eric Stade, Linear Algebra and Its Applications, 4th ed., Addison Wesley, 2012.
[Dag06] Issam Dagher and Rabih Nachar, “Face recognition using IPCA-ICA algorithm,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, pp. 996-1000, 2006.
[Dia96] K. I. Diamantaras and S. Y. Kung, Principal Component Neural Networks Theory and Applications, 1st ed., Wiley-Interscience, 1996.
[Got06] Rajkiran Gottumukkal, Hau T. Ngo, and Vijayan K. Asari, “Multi-lane architecture for eigenface based real-time face recognition,”Microprocessors and Microsystems, Vol. 30, pp. 216 - 224, 2006.
[Hay09] Simon, Haykin, Neural Networks and Learning Machines, 3rd ed., Pearson, 2009.
[Jol02] I. T. Jolliffe, Principal Component Analysis, 2nd ed., Springer-Verlag, New York, 2002.
[Kim05] Kwang In Kim, Matthias O. Franz, and Bernhard Schö lkopf, “Iterative kernel principal component analysis for image modeling,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 27, pp. 1351 - 1366, 2005.
[Lin11] Shiow-Jyu Lin, Yi-Tsan Hung, and Wen-Jyi Hwang, “Efficient hardware architecture based on generalized Hebbian algorithm for texture classification,” Neurocomputing, Vol. 74, pp. 3248 - 3256, 2011.
[Ngo05] Hau T. Ngo, Rajkiran Gottumukkal, and Vijayan K. Asari, “A flexible and efficient hardware architecture for real-time face recognition based on eigenface,” Proceedings of the IEEE Computer Society Annual Symposium on VLSI, pp. 280 - 281, 2005.
[Pav07] A. Pavan Kumar, V. Kamakoti, and Sukhendu Das, ” System-on-programmable-chip implementation for on-line face recognition,” Pattern Recognition Letters, Vol. 28, pp. 342 - 349, 2007.
[Row98] Sam Roweis,”EM algorithms for PCA and SPCA,” Advances in Neural Information Processing Systems, Vol. 10, pp. 626 - 632, 1998.
[Saj08] I. Sajid, M.M. Ahmed, and I. Taj, “ Design and Implementation of a Face Recognition System Using Fast PCA,” International Symposium on Computer Science and its Applications, pp. 126 - 130, 2008.
[San89] Terence D. Sanger, “Optimal Unsupervised Learning in a Single-Layer Linear Feedforward Neural Network,” Neural Networks, Vol. 2, pp. 459 - 473, 1989.
[Sha07] Alok Sharma and Kuldip K. Paliwal, “Fast principal component analysis using fixed-point algorithm,” Pattern Recognition Letters, Vol. 28, pp. 1151 - 1155, 2007.
[Sud08] A.R. Mohan, N. Sudha, and P.K. Meher, “An embedded face recognition system on a VLSI array architecture and its FPGA implementation,” Proceedings of the IEEE Conference on Industrial Electronics, pp. 2432 - 2437, 2008.
[Sud11] A.R. Mohan, N. Sudha, and P.K. Meher, “A Self-Configurable Systolic Architecture for Face Recognition System Based on Principal Component Neural Network,” IEEE Transactions on Circuits and Systems for Video Technology, Vol. 21, pp.1071-1084, 2011.