簡易檢索 / 詳目顯示

研究生: 江宗憲
Zong-Sian Jiang
論文名稱: 低成本高速眼動儀之建構
Building a Low-Cost and High-Speed Eye-Tracking System
指導教授: 黃奇武
Huang, Chi-Wu
學位類別: 碩士
Master
系所名稱: 電機工程學系
Department of Electrical Engineering
論文出版年: 2012
畢業學年度: 101
語文別: 中文
論文頁數: 94
中文關鍵詞: 眼動儀眼動追蹤熱區圖掃視路徑跳視注視凝視
英文關鍵詞: Eye-Tracker, Eye-Tracking, Hot Zone, Scan Path, Saccade, Gaze, Fixation
論文種類: 學術論文
相關次數: 點閱:295下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 本研究提出了一種低成本高速眼動儀的建構方法,僅需要新台幣3000元的硬體製作成本,即完成一套取樣率為184Hz的眼動儀。過程中嘗試了數種硬體的組裝且不斷進行改良,並將控制端軟體中的眼動追蹤演算法與硬體驅動間調適及整合至最佳化,使硬體得以發揮最高效能。此外,本研究自製眼動儀系統除一般電腦螢幕上應用與實驗外,尚可透過影格率為75FPS的實景攝影機藉由同時錄製實景影像與紀錄眼動數據來進行真實場景中的相關應用與實驗。由於本研究掌握眼動儀硬體底層至軟體高階應用全方面關鍵技術,在高取樣率的眼動追蹤與高影格數的影片錄製間能有效控制運算時,資源消耗與調度。應用軟體方面,本研究自製眼動儀曾投入實際眼動實驗中,為配合實驗需求,分別有支援靜態圖片與動態影像的實驗介面;分析軟體上,開發有圖形呈現為主的ScanPath、HotZone、SelectROI;數據統計分析為主的Fixation Analysis、Saccade Analysis。

    本研究自製眼動儀在ISO9241-Part 9指標性裝置評估驗證中具有反應速度快與準確率高的表現;在25點精準度實驗中也展現誤差的小於0.5˚的亮眼成果。

    This research presents a detailed approach to build an eye-tracker with low-cost and satisfied performance. Basically, an eye-tracker uses cameras to monitor the pupil movements of the eyes and to predict the gaze positions on the computer screen. The images displayed on the screen may either come from the computer itself or from the screen cameras, if attached around the eyes, with the maximum frame capturing rate of 75 frames per second (fps). The pupil monitoring cameras of the eye-tracker using infrared light are the main hardware devices which should be precisely controlled by the comprehensive software for the proper image capturing and processing. The commercial eye-trackers are very expensive just because such rather complicated technologies of hardware and software integrations are involved.

    Our low-cost approach started form the widely surveys of both the web-cams to be modified as infrared monitoring cameras, and the basic open core control software released for sale increase of the related products or for helping the software developments of the relative research as well as applications. Finally, after undergoing many trial and error experiments of hardware and software integrations, our eye-trackers incorporated the modified infrared camera from Sony PS3 Eye-Cam with proper tuned and modified control software from CL Eye Platform Driver [18]are constructed. Each constructed eye-tracker cost around US$ 100 and demonstrated 184 Hz sample rate. Comparing to the commercial eye-tracker Tobii which cost above US$ 5000 and run at 30 Hz, our eye-tracker is 16 times less in cost and 6 times faster in frame capturing. Furthermore, our eye-tracker also exhibited the best performances under the ISO9241-Part 9 TEST in the items of “Response time” and “Correct response rate” when compared with two other eye-trackers including the commercial Tobii.

    In additions to the hardware and software system integrations achieved, some software programs are also developed for the practical applications such as the graphic interfaces of ScanPath, HotZone and SelectROI, as well as the data analysis of Fixation and Saccade.

    摘  要 i ABSTRACT ii 誌  謝 iv 目 錄 vi 圖 目 錄 x 表 目 錄 xiv 第一章 緒論 1 1.1 研究背景與動機 1 1.2 研究目的 2 1.3 研究方法 3 第二章 文獻探討 5 第三章 系統架構 8 3.1 系統功能 11 3.2 系統特色與優勢 11 3.3 本研究自製眼動儀、眼動儀市售商品、其他自製眼動儀比較 12 第四章 硬體架構發展與沿革 13 4.1 硬體架構雛形與攝影機選型 13 4.2 攝影機SONY PLAYSTATION 3 EYE介紹 15 4.3 取瞳攝影機設計 16 4.3.1 拆解PS3 Eye 17 4.3.2 紅外線補光燈設計 17 4.3.3 鏡頭改裝、更換 18 4.3.4 取瞳攝影機組裝 22 4.4 骨架設計 23 4.4.1 製作取瞳攝影機與實景攝影機固定用骨架部件 24 4.4.2 骨架組裝 25 4.5 螢幕眼動儀組裝 26 4.6 實景眼動儀組裝 26 4.6.1 設計實景攝影機 26 4.6.2 組裝實景攝影機 27 4.7 螢幕及實景兩用頭戴式眼動儀 28 4.8 硬體架構沿革 28 4.8.1 螢幕眼動儀雛形-2011年9月 28 4.8.2 螢幕眼動儀太陽眼鏡款-2011年12月 28 4.8.3 實景眼動儀太陽眼鏡款-2012年2月 29 4.8.4 螢幕眼動儀運動型太陽眼鏡款-2012年4月 29 4.8.5 螢幕、實景兩用眼動儀運動型太陽眼鏡款-2012年5月 30 4.8.6 螢幕及實景兩用眼動儀改良版-2012年12月 31 第五章 眼動儀原理與控制端軟體開發 33 5.1 控制端軟體架構概述 33 5.2 取瞳攝影機、實景攝影機驅動 34 5.3 基本原理 34 5.3.1 取瞳原理 34 5.3.2 紅外線 35 5.3.3 門檻值分割法(Thresholding) 36 5.3.4 斑點檢測(Blob Detection) 39 5.3.5 取瞳程序 51 5.3.6 校正原理 55 5.3.7 校正程序 61 5.3.8 實景眼動儀校正程序 63 5.4 控制端軟體使用者介面 66 第六章 應用與分析軟體 73 6.1 應用軟體 73 6.1.1 ISO 9241 – Part 9 73 6.1.2 圖片刺激物呈現軟體 73 6.1.3 25點精準度驗證介面(Flash動態刺激物呈現) 74 6.2 分析軟體 75 6.2.1 ScanPath軟體 75 6.2.2 HotZone軟體 75 6.2.3 SelectROI軟體 76 第七章 相關驗證與應用 79 7.1 眼動儀驗證 79 7.1.1 ISO 9241 – Part 9速度與精確度實驗 79 7.1.2 25點精準度實驗 81 7.2 眼動儀應用實驗 84 7.2.1 女用品觀賞實驗(何宏發老師規劃) 84 7.2.2 光復高中數位實驗(何宏發老師規劃) 84 7.2.3 名畫鑑賞實驗 85 第八章 結論與未來展望 87 參 考 文 獻 89 自 傳 92 學 術 成 就 94

    [1] G. Williams, "Least Squares Solutions," in Linear algebra with applications, Jones & Bartlett, 2012, p. 364.
    [2] R. C. Zhor and N. A. Amine, "An adaptive algorithm for eye-gaze-tracking-device calibration," Instrumentation and Measurement, IEEE Transactions on., vol. 57, no. 4, pp. 716-723, 2008.
    [3] N. J. Wade, "Scanning the seen: vision and the origins of eye movement research," in Eye Movements: A Window on Mind and Brain, Elsevier, 2007, pp. 31-61.
    [4] D. Li, "Low-cost eye-tracking for human computer interaction," 2006.
    [5] D. Li and D. J. Parkhurst, "Starburst: A robust algorithm for video-based eye tracking," Elsevier Science, 2005.
    [6] Z. Zhu and Q. Ji, "Robust real-time eye detection and tracking under variable lighting conditions and various face orientations," Computer Vision and Image Understanding, vol. 98, no. 1, pp. 124-154, 2005.
    [7] E. D. Guestrin and M. Eizenman, "General theory of remote gaze estimation using the pupil center and corneal reflections," Biomedical Engineering, IEEE Transactions on., vol. 53, no. 6, pp. 1124-1133, 2006.
    [8] C. Hennessey, B. Noureddin and P. Lawrence, "A single camera eye-gaze tracking system with free head motion," in Proceedings of the 2006 symposium on Eye tracking research & applications, 2006.
    [9] A. Poole and L. J. Ball, Eye Tracking in Human-Computer Interaction and Usability Research: Current Status and Future Prospects, 2005.
    [10] J. B. Hiley, A. H. Redekopp and R. Fazel-Rezai, "A low cost human computer interface based on eye tracking.," in Engineering in Medicine and Biology Society, 2006. EMBS'06. 28th Annual International Conference of the IEEE, 2006.
    [11] R. Mantiuk, M. Kowalik, A. Nowosielski and B. Bazyluk, "Do-it-yourself eye tracker: Low-cost pupil-based eye tracker for computer graphics applications," in Advances in Multimedia Modeling, 2012.
    [12] S. Lee, Y. J. Sohn, M. Lee, Y. M. Jang, M. S. Chang, S. Y. Kim, and H. W. Kwak, "Verifications of the low-cost eye-tracker KSL-240," in Information Science and Service nformation Science and Service Science (NISS), 2011 5th International Conference on New Trends in, 2011.
    [13] C. H. Morimoto, D. Koons,A. Amir and M. Flickner, "Pupil detection and tracking using multiple light sources.," Image and vision computing, vol. 18, no. 4, pp. 331-335, 2000.
    [14] X. Zhang and I. S. MacKenzie, "Evaluating eye tracking with ISO 9241-Part 9. In Human-Computer Interaction.," in HCI Intelligent Multimodal Interaction Environments, 2007.
    [15] C. W. Huang, Z. S. Jiang, W. F. Kao, and Y. L. Huang, "Building a Low-Cost Eye-Tracking System," in The 2012 International Conference on Information Technology and Management Innovation, China, 2012.
    [16] H. F. Ho, C. W. Huang, Y. L. Huang and W. F. Kao, "An Application of Eye-tracking Technology to Fashion Design Education: A Pilot Study on How Women Gaze at Handbags," in Proceedings of the 20th International Conference on Computers in Education (ICCE 2012), 2012.
    [17] Y. T. Peng, "Distributed Algorithms for SVD-based Least Squares Estimation.," 2011.
    [18] Code Laboratories, http://codelaboratories.com/about/, 2013.
    [19] openEyes, http://thirtysixthspan.com/openEyes/, 2013.
    [20] Opengazer, http://www.inference.phy.cam.ac.uk/opengazer/, 2013.
    [21] ITU Gaze Tracker, :http://www.gazegroup.org, 2013.
    [22] Wikipedia: Infrared, https://en.wikipedia.org/wiki/Infrared, 2013.
    [23] OpenCV: Basic Thresholding Operations,
    http://docs.opencv.org/doc/tutorials/imgproc/threshold/threshold.html, 2013.
    [24] Wikipedia: Least squares, https://en.wikipedia.org/wiki/Least_squares, 2013.

    無法下載圖示 本全文未授權公開
    QR CODE