Abstract
The aim of this paper is to review the literaturę associated with the use of eye-tracking in evaluating the usability of software. Evaluation of the usability is a difficult process because of a significant role played by individual characteristics and preferences of the users. These individuals are strong impediments in formulating general patterns. Eye-tracking consists of measuring the movements of the eyeballs and mapping them to the elements in the space where the user’s eyesight is directed. This process is one of the basic tools for evaluating the usability of software. This paper at first discusses the importance of the usability of software and methods of its evaluation. The relationship between usability metrics and eye-tracking metrics is presented. Later, the eyetracking methodology is discussed. The history of the eye-tracking research is mentioned, as well as recommended configuration standards of the test procedures. The basics of vision physics and exemplary measurements are described. Then various experiments are listed and fields for further study are indicated. Knowledge in this topic is already established but further work is still needed, among others, in the area of standardisation, validation of new technologies and the simultaneous use of additional data sources (eg. FaceReader).
References
Benbunan-Fich, R. (2001). Using protocol analysis to evaluate the usability of a commercial web site [online, dostęp: 2016-02-01]. Information & Management, 39(2), 151–163. Dostępny w Internecie: http://www. sciencedirect.com/science/article/pii/S0378720601000854.
View in Google Scholar
Broadbent, D.E. (1958). The effects of noise on behaviour [online, dostęp: 2016-02-01]. W: D.E. Broadbent. Perception and Communication (s. 81–107). Elmsford, NY: Pergamon Press. Dostępny w Internecie: http://psycnet.apa.org/index.cfm?fa=buy.optionToBuy&uid=2004-16224-005.
View in Google Scholar
Byrne, M., Anderson, J.R., Douglass, S., Matessa, M. (1999). Eye tracking the visual search of click-down menus. W: Proceedings CHI ’99 Proceedings of the SIGCHI conference on Human Factors in Computing Systems, 1999 (s. 402–409) [online, dostęp: 2016-02-01]. New York, NY: ACM. Dostępny w Internecie: http://dl.acm.org/citation.cfm?id=303118.
View in Google Scholar
Calisir, F., Calisir, F. (2004). The relation of interface usability characteristics, perceived usefulness, and perceived ease of use to end-user satisfaction with enterprise resource planning (ERP) systems [online, dostęp: 2016-02-01]. Computers in Human Behavior, 20(4), 505–515. Dostępny w Internecie: http://www.sciencedirect.com/science/article/pii/S0747563203000748.
View in Google Scholar
Carpenter, R.H.S. (1988). Pion Limited Movements of the eyes [online, dostęp: 2016-02-01]. W: R.H.S. Carpenter. Movements of the Eyes (s. 593). 2nd rev. & enlarged ed. London: Pion. ISBN 0850861098. Dostępny w Internecie: http://psycnet.apa.org/index.cfm?fa=search.displayRecord&uid=1988-98287-000.
View in Google Scholar
Chin, J., Diehl, V.A., Norman, K.L. (1988). Development of an instrument measuring user satisfaction of the human-computer interface [online, dostęp: 2016-02-01]. W: Proceedings CHI ’88 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (s. 213–218). New York, NY: ACM. Dostępny w Internecie: http://dl.acm.org/citation.cfm?id=57203.
View in Google Scholar
Chiou, W.-C., Lin, C.-C., Perng, C. (2010). A strategic framework for website evaluation based on a review of the literature from 1995–2006 [online, dostęp: 2016-02-01]. Information & Management, 47(5–6), 282–290. Dostępny w Internecie: http://www.sciencedirect.com/science/article/pii/S0378720610000510.
View in Google Scholar
Crosby, M., Peterson, W.W. (1991). Using eye movements to classify search strategies [online, dostęp: 2016-02-01]. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 35(20), 1476–1480. Dostępny w Internecie: http://pro.sagepub.com/content/35/20/1476.short.
View in Google Scholar
Cutrell, E., Guan, Z. (2007). What are you looking for?: an eye-tracking study of information usage in web search [online, dostęp: 2016-02-01]. W: Proceedings CHI ’07 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2007 (s. 407–416). New York, NY: ACM. ISBN 978-1-59593-593-9. Dostępny w Internecie: http://dl.acm.org/citation.cfm?id=1240690.
View in Google Scholar
Davenport, T., Beck, J.C. (2001). The Attention Economy: Understanding the New Currency of Business [online, dostęp: 2016-02-01]. Boston, MA: Harvard Business School Press. Dostępny w Internecie: https://books.google.pl/books?hl=en&lr=&id=FuuKd3on9psC&oi=fnd&pg=PR12&dq=The+attention+economy:+Understanding+the+new+currency+of+business&ots=RK0NJC-5Yw&sig=rLGdWYMMhXuhy-F68GfVEogM5Gzw&redir_esc=y#v=onepage&q=The%20attention%20economy%3A%20Understanding%20the%20new%20currency%20of%20business&f=false.
View in Google Scholar
Delabarre, E. (1898). A method of recording eye-movements [online, dostęp: 2016-02-01]. The American Journal of Psychology, 9(4), 572–574. Dostępny w Internecie: http://www.jstor.org/stable/1412191?seq=1#page_scan_tab_contents.
View in Google Scholar
Deutsch, J.A., Deutsch, D. (1963). Attention: some theoretical considerations [online, dostęp: 2016-02-01]. Psychological Review, 70(1), 80–90. Dostępny w Internecie: http://psycnet.apa.org/journals/rev/70/1/80/.
View in Google Scholar
Djamasbi, S., Seigel, M., Tullis, T. (2010). Generation Y, web design, and eye tracking [online, dostęp: 2016-02-01]. International Journal of Human-Computer Studies, 68(5), 307–323. Dostępny w Internecie: http://www.sciencedirect.com/science/article/pii/S1071581909001918.
View in Google Scholar
Dodge, R., Cline, T.S. (1901). The angle velocity of eye movements [online, dostęp: 2016-02-01]. Psychological Review, 8(2), 145–157. Dostępny w Internecie: http://psycnet.apa.org/journals/rev/8/2/145/.
View in Google Scholar
Duchowski, A. (2007). Eye Tracking Methodology: Theory and Practice [online, dostęp: 2016-02-01]. London: Springer. ISBN 978-1-84628-608-7. Dostępny w Internecie: https://books.google.pl/books?hl-=en&lr=&id=WtvVdNESRyIC&oi=fnd&pg=PR15&dq=Eye+tracking+methodology:+Theory+and +practice&ots=8lwf8xANbu&sig=w-pFUzX2JgDU6PLkYM75PiMJQT8&redir_esc=y#v=onepage-&q=Eye%20tracking%20methodology%3A%20Theory%20and%20practice&f=false.
View in Google Scholar
Gegenfurtner, A., Lehtinen, E., Säljö, R. (2011). Expertise differences in the comprehension of visualizations: A meta-analysis of eye-tracking research in professional domains [online, dostęp: 2016-02-01]. Educational Psychology Review, 23(4), 523–552. Dostępny w Internecie: http://link.springer.com/article/10.1007/s10648-011-9174-7.
View in Google Scholar
Goldberg, J.H., Kotval, X.P. (1999). Computer interface evaluation using eye movements: methods and constructs [online, dostęp: 2016-02-01]. International Journal of Industrial Ergonomics, 24(6), 631–645. Dostępny w Internecie: http://www.sciencedirect.com/science/article/pii/S0169814198000687.
View in Google Scholar
Guan, Z., Cutrell, E. (2007). An eye tracking study of the effect of target rank on web search [online, dostęp: 2016-02-01]. W: Proceedings CHI ’07 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (s. 417–420). New York, NY: ACM. ISBN 978-1-59593-593-9. Dostępny w Internecie: http://dl.acm.org/citation.cfm?id=1240691.
View in Google Scholar
Hervet, G., Guérard, K., Tremblay, S., Chtourou, M.S. (2011). Is banner blindness genuine? Eye tracking internet text advertising [online, dostęp: 2016-02-01]. Applied Cognitive Psychology, 25(5), 708–716. Dostępny w Internecie: http://onlinelibrary.wiley.com/doi/10.1002/acp.1742/full.
View in Google Scholar
Holmqvist, K. i in. (2011). Eye Tracking: A Comprehensive Guide to Methods and Measures [online, dostęp: 2016-02-01]. Oxford–New York: Oxford University Press. ISBN 978-0-19969708-3. Dostępny w Internecie: https://books.google.pl/books?hl=en&lr=&id=5rIDPV1EoLUC&oi=fnd&pg=PR12&dq=Eye+tracking:+A+comprehensive+guide+to+methods+and+measures&ots=_v3DWUqKoI&sig=SpovYioihsx8v7CAr37Qr-oPkhI&redir_esc=y#v=onepage&q=Eye%20tracking%3A%20A%20comprehensive%20guide%20to%20methods%20and%20measures&f=false.
View in Google Scholar
Huey, E.B. (1898). Preliminary experiments in the physiology and psychology of reading [online, dostęp: 2016-02-01]. The American Journal of Psychology, 9(4), 575–586. Dostępny w Internecie: http://www.jstor.org/stable/1412192?seq=1#page_scan_tab_contents.
View in Google Scholar
ISO 9241-210. (2010). Ergonomics of human-system interaction – Part 210: Human-centred design for interactive systems [online, dostęp: 2016-02-01]. Dostępny w Internecie: http://www.iso.org/iso/catalogue_detail.htm?csnumber=52075.
View in Google Scholar
ISO/IEC 25010. (2011). Systems and software engineering – Systems and software Quality Requirements and Evaluation (SQuaRE) – System and software quality models [online, dostęp: 2016-02-01]. Dostępny w Internecie: http://www.iso.org/iso/home/store/catalogue_ics/catalogue_detail_ics.htm?csnumber=35733.
View in Google Scholar
Just, M.A., Carpenter, P.A. (1976). Eye fixations and cognitive processes [online, dostęp: 2016-02-01]. Cognitive Psychology, 8(4), 441–480. Dostępny w Internecie: http://www.sciencedirect.com/science/article/pii/0010028576900153.
View in Google Scholar
Karn, K.S., Ellis, S., Juliano, C. (1999). The hunt for usability: Tracking eye movements [online, dostęp: 2016-02-01]. W: Proceedings CHI EA ’99 CHI ’99 Extended Abstracts on Human Factors in Computing Systems (s. 173). New York: ACM. ISBN 1-58113-158-5. Dostępny w Internecie: http://dl.acm.org/citation.cfm?id=632823.
View in Google Scholar
Lai, M.-L. i in. (2013). A review of using eye-tracking technology in exploring learning from 2000 to 2012 [online, dostęp: 2016-02-01]. Educational Research Review, 10, 90–115. Dostępny w Internecie: http://www.sciencedirect.com/science/article/pii/S1747938X13000316.
View in Google Scholar
Li, H., Sun, X., Zhang, K. (2007). Culture-centered design: Cultural factors in interface usability and usability tests [online, dostęp: 2016-02-01]. W: Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing (s. 1084–1088). ISBN 978-0-7695-2909-7. Dostępny w Internecie: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4288011&tag=1.
View in Google Scholar
MacLeod, M., Bowden, R., Bevan, N., Curson, I. (1997). The MUSiC Performance Measurement Method [online, dostęp: 2016-02-01]. Behaviour & Information Technology, 16(4–5), 279–293. Dostępny w Internecie: http://www.tandfonline.com/doi/abs/10.1080/014492997119842.
View in Google Scholar
McFarlane, D.C., Latorella, K.A. (2002). The scope and importance of human interruption in human-computer interaction design [online, dostęp: 2016-02-01]. Human-Computer Interaction, 17(1), 1–61. Dostępny w Internecie: http://dl.acm.org/citation.cfm?id=1464474.
View in Google Scholar
Noton, D., Stark, L. (1971). Scanpaths in saccadic eye movements while viewing and recognizing patterns [online, dostęp: 2016-02-01]. Vision Research, 11(9), 929–942. Dostępny w Internecie: http://www.sciencedirect.com/science/article/pii/0042698971902136.
View in Google Scholar
Posner, M.I. (1980). Orienting of attention [online, dostęp: 2016-02-01]. Quarterly Journal of Experimental Psychology, 32(1), 3–25. Dostępny w Internecie: http://www.tandfonline.com/doi/abs/10.1080/00335558008248231.
View in Google Scholar
Roth, R.E., Harrower, M. (2008). Addressing map interface usability: Learning from the lakeshore nature preserve interactive map [online, dostęp: 2016-02-01]. Cartographic Perspectives, 60, 46–66. Dostępny w Internecie: http://www.cartographicperspectives.org/carto/index.php/journal/article/view/cp60-roth-harrower.
View in Google Scholar
Tai, R.H., Loehr, J.F., Brigham, F.J. (2006). An exploration of the use of eye-gaze tracking to study problemsolving on standardized science assessments [online, dostęp: 2016-02-01]. International Journal of Research & Method in Education, 29(2), 185–208. Dostępny w Internecie: http://www.tandfonline.com/doi/abs/10.1080/17437270600891614.
View in Google Scholar
Tan, C.T., Rosser, D., Bakkes, S., Pisn, Y. (2012). A feasibility study in using facial expressions analysis to evaluate player experiences [online, dostęp: 2016-02-01]. W: Proceedings IE ’12 Proceedings of the 8th Australasian Conference on Interactive Entertainment: Playing the System (s. 40–49). New York: ACM. ISBN 978-1-4503-1410-7. Dostępny w Internecie: http://dl.acm.org/citation.cfm?id=2336732.
View in Google Scholar
Tory, M., Moller, T. (2005). Evaluating visualizations: do expert reviews work? [online, dostęp: 2016-02-01]. IEEE Computer Graphics and Applications, 25(5), 8–11. Dostępny w Internecie: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1510530&tag=1.
View in Google Scholar
Treisman, A.M., Gelade, G. (1980). A feature-integration theory of attention [online, dostęp: 2016-02-01]. Cognitive Psychology, 12(1), 97–136. Dostępny w Internecie: http://www.sciencedirect.com/science/article/pii/0010028580900055.
View in Google Scholar
Tuch, A.N. i in. (2012). Is beautiful really usable? Toward understanding the relation between usability, aesthetics, and affect in HCI [online, dostęp: 2016-02-01]. Computers in Human Behavior, 28(5), 1596–1607. Dostępny w Internecie: http://www.sciencedirect.com/science/article/pii/S0747563212000908.
View in Google Scholar
Wade, N., Tatler, B.W. (2005). The Moving Tablet of the Eye. The Origins of Modern Eye Movement Research [online, dostęp: 2016-02-01]. Oxford: Oxford University Press. ISBN 0-19-856616-6. Dostępny w Internecie: http://apps.usd.edu/coglab/schieber/docs/Wade-Tatler-2005.pdf.
View in Google Scholar
Weber, A., Braun, B., Crocker, M.W. (2006). Finding referents in time: eye-tracking evidence for the role of contrastive accents [online, dostęp: 2016-02-01]. Language and Speech, 49(3), 367–392. Dostępny w Internecie: http://las.sagepub.com/content/49/3/367.short.
View in Google Scholar
Westfall, L. (2005). 12 Steps to Useful Software Metrics [online, dostęp: 2016-02-01]. Information and Software Technology. Dostępny w Internecie: http://www.win.tue.nl/~wstomv/edu/2ip30/references/Metrics_in_12_steps_paper.pdf.
View in Google Scholar
Whitley, B.E. (1997). Gender differences in computer-related attitudes and behavior: A meta-analysis [online, dostęp: 2016-02-01]. Computers in Human Behavior, 13(1), 1–22. Dostępny w Internecie: http://www.sciencedirect.com/science/article/pii/S074756329600026X.
View in Google Scholar
Wichansky, A.M. (2000). Usability testing in 2000 and beyond [online, dostęp: 2016-02-01]. Ergonomics, 43(7), 998–1006. Dostępny w Internecie: http://www.tandfonline.com/doi/abs/10.1080/001401300409170.
View in Google Scholar
Yarbus, A.L. (1967). Eye movements during perception of complex objects [online, dostęp: 2016-02-01]. W: A.L. Yarbus. Eye Movements and Vision (s. 171–211). New York: Plenum Press. Dostępny w Internecie: http://link.springer.com/chapter/10.1007/978-1-4899-5379-7_8.
View in Google Scholar
© Copyright by Małopolska School of Economics in Tarnów. The articles are available under the Creative Commons Attribution NonCommercial-NoDerivatives 4.0 International License
