簡易檢索 / 詳目顯示

回結果列表
研究生： 劉鑑儀
Chien-Yi Liu
論文名稱： 低價眼動儀硬體與軟體開發
Development of Low Cost Eye Tracking Hardware and Software
指導教授： 何宏發
Ho, Hong-Fa
學位類別： 碩士
Master
系所名稱： 電機工程學系
Department of Electrical Engineering
論文出版年： 2014
畢業學年度： 102
語文別： 中文
論文頁數： 85
中文關鍵詞： 眼動儀 、眼球追蹤系統 、人機介面 、紅外線
英文關鍵詞： eye tracker, eye-tracking systems, human-machine interface, infrared
論文種類： 學術論文
相關次數： 點閱：337  下載：4 
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

    • 由於目前市售的眼動儀大部分還市價格偏高，本論文的方向為開發出低價、取樣頻率高、方便攜帶的眼動儀，可以開發出多台眼動儀讓更多人使用。
    本論文會介紹眼動儀的發展過程以及眼動實驗常見的參數，各種眼球追蹤
    系統，主要分為接觸式和非接觸式，接觸式的方法有眼電圖法、搜尋線圈法，
    非接觸式的方法有 Purkinje 影像追蹤法、紅外線眼電圖法、紅外線視訊系統
    法，還會介紹著名的眼球追蹤演算法。
    最後就是本研究開發出的眼動儀，有固定式螢幕眼動儀、頭動式螢幕眼動
    儀、實景眼動儀，固定式螢幕眼動儀需要利用 Chin Rest 固定下巴，頭部不能任意移動，優點是準確度高，取樣頻率最高約為 180Hz；頭動式螢幕眼動儀不需要固定下巴，頭可以稍微的在電腦螢幕前移動，但是準確度較差，取樣頻率約為 75Hz；實景眼動儀以螢幕眼動儀為基礎，外加一個實景攝影機作為錄影之用途，在錄製的螢幕範圍內需要貼 Glyph Code 做定位的功能，使用者可以戴著眼動儀到處觀看，電腦記錄影片及眼動座標、凝視點時間，作為事後分析的參
    數，錄製的影片每秒為 30 個畫格。

    Due to a high cost of current commercial eye tracking systems, this study aimed to develop an eye tracker system with low-cost, portable, and high sampling frequency for multiplayer usage.
    This study described the process and common parameters for the eye tracker development and its related eye movement experiments. Current eye-tracking systems are primarily divided into contact methods and non-contact methods. Contact methods include EOG method and search coil method. Non-contact methods include Purkinje image tracking method, infrared EOG, infrared video system law, and the famous eye-tracking algorithm.
    This study developed a fixed screen eye tracker, a Head-Mounted screen eye tracker, and a Real-Time eye tracker. The fixed screen eye tracker uses a Head-Chin Rest to secure the head position to the same level of a computer monitor and 50cm away from the eyes. The fixed screen eye tracker avoids head movements, therefore, highly increases accuracy of eye movement data. The maximum sampling frequency is also able to reach 180Hz. Though the Head-Mounted screen eye tracker allows minor head movements, poorer data accuracy is a disadvantage and a less sampling frequency up to 75Hz. The Real-Time eye tracker is an extension of screen-based eye trackers. With a video camera attached externally and eye position calibrated with Glyph Code within the video recording area, users can wear the Real-Time eye tracker everywhere. The eye-tracking computer records video with 30 frames per second, and analyses eye movement variables of eye coordinates, gaze fixation, and gaze duration.

    摘要……………………………………………………………………………………I ABSTRACT…………………………………………………………………………..II 致謝………………………………………………………………………………III 目錄…………………………………………………………………………………. IV 圖目錄……………………………………………………………………………VI 表目錄……………………………………………………………………………IX 第一章 緒論…………………………………………………………………………1 1.1 背景與研究動機………………………………………………………...1 1.2 研究目的………………………………………………………………...3 1.3 論文架構………………………………………………………………...4 第二章 眼動追蹤發展與相關文獻…………………………………………………5 2.1 眼動儀的發展…………………………………………………………...5 2.2 眼球追蹤方法…………………………………………………………...7 2.2.1 眼電圖法(Electro-Oculography，EOG)………...............................7 2.2.2 搜尋線圈法(Search Coil，SC)…………………………...………..8 2.2.3 Purkinje 影像追蹤法(Dual-Purkinje-Image，DPI)………………..9 2.2.4 紅外線眼動圖法(Infra-Red Oculography，IROG)………………11 2.2.5 紅外線視訊系統法(Infra-Red Video System，IRVS)…………...12 2.2.6 各種方法比較……………………………………………………..13 2.3 Starburst Algorithm 介紹………………………………………………13 2.3.1 Starburst Algorithm……………………………………………….13 2.3.2 影像處理…………………………………………………………..16 2.3.3 尋找特徵點………………………………………………………..16 2.3.4 最佳橢圓的產生…………………………………………………..19 2.4 Circular Hough Transform 眼球偵測………………………………….20 2.4.1 影像前處理………………………………………………………..20 2.4.2 參數驗證…………………………………………………………..20 2.4.3 Circular Hough Transform………………………………………...21 2.5 市售商品介紹 Tobii Glass Eye Tracker………………………………22 第三章 眼動儀系統架構……………………………………………………………27 3.1 眼動儀系統架構……………………………………………………….27 3.2 固定式螢幕眼動儀…………………………………………………….28 3.2.1 固定式螢幕眼動儀硬體架構……………………………………..28 3.2.2 固定式螢幕眼動儀軟體架構……………………………………..33 3.3 實景眼動儀…………………………………………………………….40 3.3.1 實景眼動儀硬體架構……………………………………………..40 3.3.2 實景眼動儀軟體架構……………………………………………..42 3.3.3 實景眼動儀分析系統……………………………………………..47 3.4 頭動式螢幕眼動儀(無 Chin Rest)…………………………………….59 3.4.1 硬體架構…………………………………………………………. 59 3.4.2 軟體架構…………………………………………………………..59 第四章 實驗結果…………………………………………………………………….63 4.1 固定式螢幕眼動儀實驗結果………………………………………….64 4.2 頭動式螢幕眼動儀實驗結果………………………………………….71 4.3 實景眼動儀實驗結果………………………………………………….80 第五章 結論及未來展望…………………………………………………………….81 參考文獻……………………………………………………………………………...82 名詞索引……………………………………………………………………………...85 圖 2-1. Buswell 觀看的圖片…………………………………………………………..6 圖 2-2. Buswell 觀看的路徑和凝視點………………………………………………..6 圖 2-3. 實驗者觀看的圖片…………………………………………………………...7 圖 2-4. 眼電圖法示意圖………………………………………………………………8 圖 2-5. 搜尋線圈法示意圖……………………………………………………………9 圖 2-6. 瞳孔與第一組 Purkinje image 關係圖………………………………………10 圖 2-7. Purkinje 影像追蹤法示意圖………………………………………………….10 圖 2-8. 紅外線眼動圖法示意圖……………………………………………………..11 圖 2-9. 經由紅外線反射……………………………………………………………..11 圖 2-10. 紅外線視訊法示意圖………………………………………………………12 圖 2-11. Starburst 演算法流程圖……………………………………………………..15 圖 2-12. 影像前處理…………………………………………………………………16 圖 2-13. 特徵偵測……………………………………………………………………18 圖 2-14. 特偵點偵測每個階段結果…………………………………………………19 圖 2-15. 霍夫圓轉換…………………………………………………………………22 圖 2-16. Tobii Glass…………………………………………………………………...23 圖 2-17. Recording Assistant………………………………………………………….23 圖 2-18. IR Marker 和 IR Marker Holder……………………………………………..24 圖 3-1. 眼動儀系統架構圖…………………………………………………………..27 圖 3-2. PlayStation 3 Eye……………………………………………………………..28 圖 3-3. 拆解 PlayStation 3 Eye………………………………………………………29 圖 3-4. 鏡頭座及監視器鏡頭………………………………………………………..29 圖 3-5. 電磁波譜……………………………………………………………………..30 圖 3-6. 有、無紅外線補償比較………………………………………………………31 圖 3-7. IR-LED 電路…………………….. …………………………………………..31 圖 3-8. 固定鏡頭支架………………………………………………………………..32 圖 3-9. Chin Rest………………………………………………………………………33 圖 3-10. 系統流程圖…………………………………………………………………34 圖 3-11. Gaze Tracker…………………………………………………………………34 圖 3-12. 調整適當門檻值……………………………………………………………36 圖 3-13. 固定式螢幕眼動儀校正示意圖……………………………………………37 圖 3-14. 使用者介面………………………………………………………………....39 圖 3-15. 重新校正畫面………………………………………………………………39 圖 3-16. 電腦螢幕座標………………………………………………………………40 圖 3-17. 螢幕眼動儀攝影機與紅外線………………………………………………40 圖 3-18. Logtech Webcam…………………………………………………………….41 圖 3-19. 固定攝影機…………………………………………………………………41 圖 3-20. 使用方式……………………………………………………………………41 圖 3-21. 實景眼動儀流程圖…………………………………………………………42 圖 3-22. 計算上下左右極限範圍方法………………………………………………43 圖 3-23. 計算上下左右極限範圍流程………………………………………………44 圖 3-24. 校正點計算…………………………………………………………………45 圖 3-25. 校正 Glyph Code……………………………………………………………46 圖 3-26. Glyph Code 矩陣的形式…………………………………………………….46 圖 3-27. Glyph Code 校正點………………………………………………………….46 圖 3-28. 分析系統模組………………………………………………………………47 圖 3-29. Glyph Code 影像處理過程………………………………………………….48 圖 3-30. 相同圖形、不同旋轉角度…………………………………………………49 圖 3-31. 實際錄影畫面………………………………………………………………49 圖 3-32. LookZone 功能………………………………………………………………50 圖 3-33. 眼睛凝視點表示法…………………………………………………………50 圖 3-34. LookZone 流程圖……………………………………………………………51 圖 3-35. LooZone 結果………………………………………………………………..52 圖 3-36. ScanPath 主模組與子模組…………………………………………………53 圖 3-37. ScanPath 資料結構示意圖…………………………………………………53 圖 3-38. ScanPath 繪製示意圖………………………………………………………54 圖 3-39. 數據平移示意圖…………………………………………………………...54 圖 3-40. ScanPath 流程圖……………………………………………………………55 圖 3-41. ScanPath 結果………………………………………………………………56 圖 3-42. HotZone 顏色定義………………………………………………………….56 圖 3-43. HotZone 流程圖…………………………………………………………….57 圖 3-44. 熱區圖……………………………………………………………………...57 圖 3-45. ROI 功能……………………………………………………………………58 圖 3-46. 頭動式螢幕眼動儀攝影機位置…………………………………………...59 圖 3-47. Haarcascade eye detection…………………………………………………..60 圖 3-48. 眼睛 ROI……………………………………………………………………60 圖 3-49. 頭動式螢幕眼動儀校正示意圖……………………………………………61 圖 4-1. 測試點………………………………………………………………………..63 圖 4-2. 誤差角度計算………………………………………………………………..64 圖 4-3. 固定式螢幕眼動儀各點誤差角度…………………………………………..66 圖 4-4. 固定式螢幕眼動儀各點水平標準差………………………………………..68 圖 4-5. 固定式螢幕眼動儀各點垂直標準差………………………………………..70 圖 4-6. 頭動式螢幕眼動儀各點誤差角度…………………………………………..73 圖 4-7. 頭動式螢幕眼動儀各點水平標準差………………………………………..75 圖 4-8. 頭動式螢幕眼動儀各點垂直標準差………………………………………..77 表 1-1. 市售眼動儀比較………………………………………………………………4 表 2-1. 各方法比較表………………………………………………………………..13 表 2-2. 各參數定義………………………………………………………………….24 表 2-3. 眼動儀公司………………………………………………………………….26 表 4-1. 固定式螢幕眼動儀(上) ……………………………………………………..77 表 4-2. 固定式螢幕眼動儀(中) ……………………………………………………..78 表 4-3. 固定式螢幕眼動儀(下) ……………………………………………………..78 表 4-4. 頭動式螢幕眼動儀(上) ……………………………………………………..79 表 4-5. 頭動式螢幕眼動儀(中).. ……………………………………………………79 表 4-6. 頭動式螢幕眼動儀(下) ……………………………………………………..80 表 4-7. 實景眼動儀誤差角度………………………………………………………..80

    [1] A. Duchowski, Eye tracking methodology: Theory and practice vol. 373: Springer,
    2007.
    [2] J. Preece, Y. Rogers, H. Sharp, D. Benyon, S. Holland, and T. Carey, Human-computer
    interaction: Addison-Wesley Longman Ltd., 1994.
    [3] M. G. Calvo and L. Nummenmaa, "Eye-movement assessment of the time course in
    facial expression recognition: Neurophysiological implications," Cognitive, Affective,
    & Behavioral Neuroscience, vol. 9, pp. 398-411, 2009.
    [4] M.-J. Tsai, H.-T. Hou, M.-L. Lai, W.-Y. Liu, and F.-Y. Yang, "Visual attention for
    solving multiple-choice science problem: An eye-tracking analysis," Computers &
    Education, vol. 58, pp. 375-385, 2012.
    [5] D. Beymer, P. Z. Orton, and D. M. Russell, "An eye tracking study of how pictures
    influence online reading," in Human-Computer Interaction–INTERACT 2007, ed:
    Springer, 2007, pp. 456-460.
    [6] J. Kuisma, J. Simola, L. Uusitalo, and A. Ö örni, "The effects of animation and format
    on the perception and memory of online advertising," Journal of Interactive
    Marketing, vol. 24, pp. 269-282, 2010.
    [7] P. Catteeuw, W. Helsen, B. Gilis, E. Van Roie, and J. Wagemans, "Visual scan patterns
    and decision-making skills of expert assistant referees in offside situations," Journal of
    sport & exercise psychology, vol. 31, p. 786, 2009.
    [8] R. J. Jacob and K. S. Karn, "Eye tracking in human-computer interaction and usability
    research: Ready to deliver the promises," Mind, vol. 2, p. 4, 2003.
    [9] D. Giordano, C. Pino, C. Spampinato, M. Di Pietro, and A. Reibaldi, "Eye tracker
    based method for quantitative analysis of pathological nystagmus," in Computer-
    Based Medical Systems (CBMS), 2011 24th International Symposium on, 2011, pp. 1-
    6.
    [10] Visual Studio. Available: http://msdn.microsoft.com/en-US/vstudio
    [11] E. S. Kim, A. Naples, G. V. Gearty, Q. Wang, S. Wallace, C. Wall, et al.,
    "Development of an untethered, mobile, low-cost head-mounted eye tracker," in
    Proceedings of the Symposium on Eye Tracking Research and Applications, 2014, pp.
    247-250.
    [12] J. B. Bavelas, L. Coates, and T. Johnson, "Listener responses as a collaborative
    process: The role of gaze," Journal of Communication, vol. 52, pp. 566-580, 2002.
    [13] Tobii Technology. Available: http://www.tobii.com/
    [14] SMI. Available: http://www.smivision.com/en.html
    [15] J. E. Lebensohn, "LOUIS ÉMILE JAVAL 1839-1907: A CENTENARY TRIBUTE,"
    Archives of Ophthalmology, vol. 21, pp. 650-661, 1939. 83

    [16] E. B. Huey, The psychology and pedagogy of reading: The Macmillan Company,
    1908.
    [17] G. T. Buswell, How people look at pictures: University of Chicago Press Chicago,
    1935.
    [18] A. L. Yarbus, B. Haigh, and L. A. Rigss, Eye movements and vision vol. 2: Plenum
    press New York, 1967.
    [19] M. A. Just and P. A. Carpenter, "A theory of reading: From eye fixations to
    comprehension," Psychological review, vol. 87, pp. 329-354, 1980.
    [20] E. Iáñez, J. M. Azorin, and C. Perez-Vidal, "Using Eye Movement to Control a
    Computer: A Design for a Lightweight Electro-Oculogram Electrode Array and
    Computer Interface," PloS one, vol. 8, p. e67099, 2013.
    [21] Y. Chen and W. S. Newman, "A human-robot interface based on electrooculography,"
    in Robotics and Automation, 2004. Proceedings. ICRA'04. 2004 IEEE International
    Conference on, 2004, pp. 243-248.
    [22] R. S. Remmel, "An inexpensive eye movement monitor using the scleral search coil
    technique," Biomedical Engineering, IEEE Transactions on, pp. 388-390, 1984.
    [23] T. Imai, K. Sekine, K. Hattori, N. Takeda, I. Koizuka, K. Nakamae, et al., "Comparing
    the accuracy of video-oculography and the scleral search coil system in human eye
    movement analysis," Auris Nasus Larynx, vol. 32, pp. 3-9, 2005.
    [24] H. D. Crane and C. M. Steele, "Generation-V dual-Purkinje-image eyetracker,"
    Applied Optics, vol. 24, pp. 527-537, 1985.
    [25] D. R. Gitelman, T. B. Parrish, K. S. LaBar, and M. Mesulam, "Real-time monitoring
    of eye movements using infrared video-oculography during functional magnetic
    resonance imaging of the frontal eye fields," Neuroimage, vol. 11, pp. 58-65, 2000.
    [26] Z. Zhu and Q. Ji, "Eye gaze tracking under natural head movements," in Computer
    Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society
    Conference on, 2005, pp. 918-923.
    [27] D. Li, D. Winfield, and D. J. Parkhurst, "Starburst: A hybrid algorithm for video-based
    eye tracking combining feature-based and model-based approaches," in Computer
    Vision and Pattern Recognition-Workshops, 2005. CVPR Workshops. IEEE Computer
    Society Conference on, 2005, pp. 79-79.
    [28] K. Kanatani and P. Rangarajan, "Hyper least squares fitting of circles and ellipses,"
    Computational Statistics & Data Analysis, vol. 55, pp. 2197-2208, 2011.
    [29] W. Gander, G. H. Golub, and R. Strebel, "Least-squares fitting of circles and ellipses,"
    BIT Numerical Mathematics, vol. 34, pp. 558-578, 1994.
    [30] M. A. Fischler and R. C. Bolles, "Random sample consensus: a paradigm for model
    fitting with applications to image analysis and automated cartography,"
    Communications of the ACM, vol. 24, pp. 381-395, 1981. [31] N. Alioua, A. Amine, M. Rziza, and D. Aboutajdine, "Eye state analysis using iris
    detection based on Circular Hough Transform," in Multimedia Computing and Systems
    (ICMCS), 2011 International Conference on, 2011, pp. 1-5.
    [32] The eye tribe. Available: https://theeyetribe.com/
    [33] iMotions. Available: http://imotionsglobal.com/
    [34] Applied Science Laboratories. Available: http://www.asleyetracking.com/Site/
    [35] SR Research. Available: http://www.sr-research.com/
    [36] smarteye. Available: http://www.smarteye.se/
    [37] Arrington Research. Available: http://www.arringtonresearch.com/
    [38] Cambridge Research Systems. Available: http://www.crsltd.com/
    [39] Blickzentrum. Available: http://www.blickzentrum.eu/exe.htm
    [40] EyeTech Digital Systems. Available: http://www.eyetechds.com/
    [41] LC Technologies. Available: http://www.eyegaze.com/
    [42] Metrovision. Available: http://www.metrovision.fr/
    [43] NAC Image technology. Available: www.nacincproducts.com/
    [44] Primelec. Available: http://www.primelec.ch/
    [45] (2012).
    由田新技
    . Available: http://www.utechzone.com.tw/
    [46] Seeing Machines. Available: http://www.seeingmachines.com/
    [47] PS3. Available: http://us.playstation.com/ps3/accessories/playstation-eye-camera-
    ps3.html
    [48] GODDARD SPACE FLIGHT CENTER. Available:
    http://imagine.gsfc.nasa.gov/docs/science/know_l1/emspectrum.html
    [49] G. H. Golub and C. Reinsch, "Singular value decomposition and least squares
    solutions," Numerische Mathematik, vol. 14, pp. 403-420, 1970.
    [50] OpenCV. Available: http://opencv.org/
    [51] AForge.Net. Available: http://www.aforgenet.com/projects/gratf/

    QR CODE