Improving Eye Gaze Controlled Car Dashboard using Simulated Annealing

This paper proposes and evaluates a new algorithm to improve performance of pointing and selec-tion tasks in an eye gaze controlled graphical user interface in automotive environment. The algo-rithm aims to reduce number of wrong selection of targets due to inaccuracy of either the eye gaze tracker or the calibration routine. The proposed method does not require changing layout of the inter-face rather puts a set of hotspots on clickable targets using Simulated Annealing algorithm. A couple of user studies involving a driving simulator and ISO 26022 lane changing task found that the pro-posed method can reduce number of wrong selection and can also improve driving performance compared to an existing touchscreen system.

Content

Author and article information

Contributors

Pradipta Biswas

Gowdham Prabhakar

J. Rajesh

Kavesh Pandit

Ankit Halder

Conference

Publication date: July 2017

Publication date (Print): July 2017

Pages: 1-12

Affiliations

[ ¹ ]Centre for Product Design and Manufacturing

Indian Institute of Science

Bangalore 560012, India

[ ² ]Manipal Institute of Technology

Manipal University

Manipal 576104, India

Article

DOI: 10.14236/ewic/HCI2017.39

SO-VID: 9365f8a8-aca6-46df-a6aa-f0c5590cff40

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Proceedings of the 31st International BCS Human Computer Interaction Conference (HCI 2017)

Conference acronym: HCI

Conference number: 31

Conference location: Sunderland, UK

Conference date: 3 - 6 July 2017

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: digital make-believe, with delegates considering our expansive

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2017.39

Self URI (journal page): https://ewic.bcs.org/

REFERENCES

M. AshdownK. OkaY. Sato 2005 Combining Head Tracking and Mouse Input for a GUI on Multiple Monitors CHI Late breaking Result
R. Bates 1999 Multimodal Eye-Based Interaction for Zoomed Target Selection on a Standard Graphical User Interface Proceedings of INTERACT 1999
P. BiswasP. Langdon 2015 Multimodal Intelligent Eye-Gaze Tracking System International Journal of Human-Computer Interaction 31 4 Taylor & Francis Print ISSN:1044-7318
BiswasP. Biswas Exploring the use of Eye Gaze Controlled Interfaces in Automotive Environments Springer 2016 ISBN: 978-3-319-40708-1
CameraMouse 2013 CameraMouse Available at http://www.cameramouse.com 22nd September 2013
S. CardT. MoranA. Newell "The Psychology of Human-Computer Interaction." Hillsdale, NJ, USA Lawrence Erlbaum Associates 1983
W. ChangW. HwangY. G. Ji 2011 Haptic Seat Interfaces for Driver Information and Warning Systems International Journal of Human-Computer Interaction,27:12 1119 1132 DOI: 10.1080/10447318.2011.555321
J. DostalP.O. KristenssonA. Quigley 2013 Subtle Gaze-Dependent Techniques for Visualising Display Changes in Multi-Display Environments ACM International Conference of Intelligent User Interfaces (IUI) 2013
R.S. DuarteB.F. Oliveira Comparing The Glance Time Required To Operate Standart Interface Devices And Touchscreen Devices In Automobiles Proceedings of ACM INTERACCIÓN 2014
A.T. Duchowski 2007 Eye Tracking Methodology Springer 2007
S. FarrellS. Zhai 2005 System and method for selectively expanding or contracting a portion of a display using eye-gaze tracking US Patent No.: 20050047629 A1
M. Fejtova et. al 2009 Hands-free interaction with a computer and other technologies Universal Access in the Information Society 8
M. FeldG. MeixnerA. MahrM. SeisslerB. Kalyanasundaram 2013 Generating a Personalized UI for the Car: A User-Adaptive Rendering Architecture UMAP 2013, LNCS 7899 344 346
P.M. Fitts 1954 The Information Capacity of The Human Motor System In Controlling The Amplitude of Movement Journal of Experimental Psychology 47 381 391
Y FuT.S. Huang 2007 hMouse: Head Tracking Driven Virtual Computer Mouse IEEE Workshop on Applications of Computer Vision
M. GrandtC. PfendlerO. Mooshage Empirical Comparison of Five Input Devices for Anti-Air Warfare Operators Available at http://dodccrp.org/events/8th_ICCRTS/pdf/035.pdf 30 11 2013
R.J. JagacinskiD.L. Monk 1985 Fitts' Law in Two Dimensions with Hand and Head Movements oJournal of Motor Behaviour 17 1 1985 77 95
D. KernA. MahrS. CastronovoA. SchmidtC. Müller 2010 Making Use of Drivers’ Glances onto the Screen for Explicit Gaze-Based Interaction Proceedings of the Second International Conference on Automotive User Interfaces and Interactive Vehicular Applications
J. KimJ. LimC. JoK. Kim 2015 Utilization of Visual Information Perception Characteristics to Improve Classification Accuracy of Driver’s Visual Search Intention for Intelligent Vehicle International Journal of Human-Computer Interaction DOI: 10.1080/10447318.2015.1070561
D. LargeG. BurnettE. CrundallG. LawsonL. Skrypchuk Twist It, Touch It, Push It, Swipe It: Evaluating Secondary Input Devices for Use with an Automotive Touchscreen HMI Proceedings of ACM AutoUI 2016
C. LutterothM. PenkarG. Weber Gaze vs.Mouse: A Fast and Accurate Gaze-Only Click Alternative Proceedings of ACM UIST 2015
I. S. MacKenzieA. SellenW. Buxton 1991 A comparison of input devices in elemental pointing and dragging tasks Proceedings of the CHI '91 Conference on Human Factors in Computing Systems 161 166 New York ACM
K.R. MayB.N. WalkerT.M. Gable A Multimodal Air Gesture Interface for In Vehicle Menu Navigation Adjunct Proceedings of ACM Automotive UI2014
D. Miniotas 2001 Application of Fitts' Law to Eye Gaze Interaction Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) 2001 339 340
C.K. MondragonB. Bleacher Eye tracking control of vehicle entertainment systems Patent No. WO2013036632
C.J. Normark 2015 Design and Evaluation of a Touch-Based Personalizable Invehicle User Interface International Journal of Human-Computer Interaction DOI: 10.1080/10447318.2015.1045240
E. Ohn-BarM. Trivedi 2014 Hand Gesture Recognition in Real-Time for Automotive Interfaces: A Multimodal Vision-based Approach and Evaluations IEEE Transactions on Intelligent Transportation Systems
A.M. PenkarC. LutterothG. Weber Designing for the Eye - Design Parameters for Dwell in Gaze Interaction OZCHI 2012
K. PfeufferH. Gellersen 2016 October Gaze and Touch Interaction on Tablets Proceedings of the 29th Annual Symposium on User Interface Software and Technology 301 311 ACM
T. PoitschkeF. LaquaiS. Stambo-lievG. Rigoll 2011 Gaze-based interaction on multiple displays in an automotive environment IEEE International Conference on Systems Man, and Cybernetics (SMC) 2011 543 548 ISSN : 1062-922X
T.A. SederJ.F. SzczerbaD. Cui Virtual cursor for road scene object lelection on full windshield head-up display Patent No.: US20120174004
System Usability Scale Available at http://en.wikipedia.org/wiki/System_usability_scale 12 07 2014
Tobii EyeX Eye Tracker Available at http://www.tobii.com/xperience/ 31st August 2015
R. Vertegaal 2008 A Fitts' Law Comparison of Eye Tracking and Manual Input in the Selection of Visual Targets Proceedings of the International Conference of Multimodal Interaction 2008 241 248
S. VoelkerA. MatviienkoJ. SchöningJ. Borchers 2015 Combining Direct and Indirect Touch Input for Interactive Desktop Workspaces using Gaze Input
D.J. WardA.F. BlackwellD.J. MacKay Dasher- a Data Entry Interface Using Continuous Gestures and Language Models In proceedings UIST 2000
C. WareH. M Mikaelian 1987 An Evaluation of an Eye Tracker as a Device for Computer Input Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) 1987 183 187
G. WeinbergA. KnowlesP. Langer BullsEye: An Au Automotive Touch Interface that's always on Target Adjunct Proceedings of ACM Automotive UI 2014
T.O. ZanderaM. GaertneraC. KotheaR. Vilimek 2010 Combining Eye Gaze Input With a Brain-Computer Interface for Touchless Human-Computer Interaction International Journal of Human-Computer Interaction 27 1
S. ZhaiC. MorimotoS. Ihde 1999 Manual and Gaze Input Cascaded (MAGIC) Pointing ACM SIGCHI Conference on Human Factors in Computing System (CHI) 1999
S. ZhaiM. HunterB.A. Smith The Metropols Keyboard- An Exploration of Quantitative Techniques for Virtual Keyboard Design Proceedings of ACM Symposium on User Interface Software and Technology (UIST 2000) November 5-8 2000
Y. ZhangA. BullingH. Gellersen 2013 SideWays: A Gaze Interface for Spontaneous Interaction with Situated Displays ACM SIGCHI Conference on Human Factors in Computing System (CHI) 2013

Comments

Comment on this article

[1] M. AshdownK. OkaY. Sato 2005 Combining Head Tracking and Mouse Input for a GUI on Multiple Monitors CHI Late breaking Result

[2] R. Bates 1999 Multimodal Eye-Based Interaction for Zoomed Target Selection on a Standard Graphical User Interface Proceedings of INTERACT 1999

[3] P. BiswasP. Langdon 2015 Multimodal Intelligent Eye-Gaze Tracking System International Journal of Human-Computer Interaction 31 4 Taylor & Francis Print ISSN:1044-7318

[4] BiswasP. Biswas Exploring the use of Eye Gaze Controlled Interfaces in Automotive Environments Springer 2016 ISBN: 978-3-319-40708-1

[5] CameraMouse 2013 CameraMouse Available at http://www.cameramouse.com 22nd September 2013

[6] S. CardT. MoranA. Newell "The Psychology of Human-Computer Interaction." Hillsdale, NJ, USA Lawrence Erlbaum Associates 1983

[7] W. ChangW. HwangY. G. Ji 2011 Haptic Seat Interfaces for Driver Information and Warning Systems International Journal of Human-Computer Interaction,27:12 1119 1132 DOI: 10.1080/10447318.2011.555321

[8] J. DostalP.O. KristenssonA. Quigley 2013 Subtle Gaze-Dependent Techniques for Visualising Display Changes in Multi-Display Environments ACM International Conference of Intelligent User Interfaces (IUI) 2013

[9] R.S. DuarteB.F. Oliveira Comparing The Glance Time Required To Operate Standart Interface Devices And Touchscreen Devices In Automobiles Proceedings of ACM INTERACCIÓN 2014

[10] A.T. Duchowski 2007 Eye Tracking Methodology Springer 2007

[11] S. FarrellS. Zhai 2005 System and method for selectively expanding or contracting a portion of a display using eye-gaze tracking US Patent No.: 20050047629 A1

[12] M. Fejtova et. al 2009 Hands-free interaction with a computer and other technologies Universal Access in the Information Society 8

[13] M. FeldG. MeixnerA. MahrM. SeisslerB. Kalyanasundaram 2013 Generating a Personalized UI for the Car: A User-Adaptive Rendering Architecture UMAP 2013, LNCS 7899 344 346

[14] P.M. Fitts 1954 The Information Capacity of The Human Motor System In Controlling The Amplitude of Movement Journal of Experimental Psychology 47 381 391

[15] Y FuT.S. Huang 2007 hMouse: Head Tracking Driven Virtual Computer Mouse IEEE Workshop on Applications of Computer Vision

[16] M. GrandtC. PfendlerO. Mooshage Empirical Comparison of Five Input Devices for Anti-Air Warfare Operators Available at http://dodccrp.org/events/8th_ICCRTS/pdf/035.pdf 30 11 2013

[17] R.J. JagacinskiD.L. Monk 1985 Fitts' Law in Two Dimensions with Hand and Head Movements oJournal of Motor Behaviour 17 1 1985 77 95

[18] D. KernA. MahrS. CastronovoA. SchmidtC. Müller 2010 Making Use of Drivers’ Glances onto the Screen for Explicit Gaze-Based Interaction Proceedings of the Second International Conference on Automotive User Interfaces and Interactive Vehicular Applications

[19] J. KimJ. LimC. JoK. Kim 2015 Utilization of Visual Information Perception Characteristics to Improve Classification Accuracy of Driver’s Visual Search Intention for Intelligent Vehicle International Journal of Human-Computer Interaction DOI: 10.1080/10447318.2015.1070561

[20] D. LargeG. BurnettE. CrundallG. LawsonL. Skrypchuk Twist It, Touch It, Push It, Swipe It: Evaluating Secondary Input Devices for Use with an Automotive Touchscreen HMI Proceedings of ACM AutoUI 2016

[21] C. LutterothM. PenkarG. Weber Gaze vs.Mouse: A Fast and Accurate Gaze-Only Click Alternative Proceedings of ACM UIST 2015

[22] I. S. MacKenzieA. SellenW. Buxton 1991 A comparison of input devices in elemental pointing and dragging tasks Proceedings of the CHI '91 Conference on Human Factors in Computing Systems 161 166 New York ACM

[23] K.R. MayB.N. WalkerT.M. Gable A Multimodal Air Gesture Interface for In Vehicle Menu Navigation Adjunct Proceedings of ACM Automotive UI2014

[24] D. Miniotas 2001 Application of Fitts' Law to Eye Gaze Interaction Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) 2001 339 340

[25] C.K. MondragonB. Bleacher Eye tracking control of vehicle entertainment systems Patent No. WO2013036632

[26] C.J. Normark 2015 Design and Evaluation of a Touch-Based Personalizable Invehicle User Interface International Journal of Human-Computer Interaction DOI: 10.1080/10447318.2015.1045240

[27] E. Ohn-BarM. Trivedi 2014 Hand Gesture Recognition in Real-Time for Automotive Interfaces: A Multimodal Vision-based Approach and Evaluations IEEE Transactions on Intelligent Transportation Systems

[28] A.M. PenkarC. LutterothG. Weber Designing for the Eye - Design Parameters for Dwell in Gaze Interaction OZCHI 2012

[29] K. PfeufferH. Gellersen 2016 October Gaze and Touch Interaction on Tablets Proceedings of the 29th Annual Symposium on User Interface Software and Technology 301 311 ACM

[30] T. PoitschkeF. LaquaiS. Stambo-lievG. Rigoll 2011 Gaze-based interaction on multiple displays in an automotive environment IEEE International Conference on Systems Man, and Cybernetics (SMC) 2011 543 548 ISSN : 1062-922X

[31] T.A. SederJ.F. SzczerbaD. Cui Virtual cursor for road scene object lelection on full windshield head-up display Patent No.: US20120174004

[32] System Usability Scale Available at http://en.wikipedia.org/wiki/System_usability_scale 12 07 2014

[33] Tobii EyeX Eye Tracker Available at http://www.tobii.com/xperience/ 31st August 2015

[34] R. Vertegaal 2008 A Fitts' Law Comparison of Eye Tracking and Manual Input in the Selection of Visual Targets Proceedings of the International Conference of Multimodal Interaction 2008 241 248

[35] S. VoelkerA. MatviienkoJ. SchöningJ. Borchers 2015 Combining Direct and Indirect Touch Input for Interactive Desktop Workspaces using Gaze Input

[36] D.J. WardA.F. BlackwellD.J. MacKay Dasher- a Data Entry Interface Using Continuous Gestures and Language Models In proceedings UIST 2000

[37] C. WareH. M Mikaelian 1987 An Evaluation of an Eye Tracker as a Device for Computer Input Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) 1987 183 187

[38] G. WeinbergA. KnowlesP. Langer BullsEye: An Au Automotive Touch Interface that's always on Target Adjunct Proceedings of ACM Automotive UI 2014

[39] T.O. ZanderaM. GaertneraC. KotheaR. Vilimek 2010 Combining Eye Gaze Input With a Brain-Computer Interface for Touchless Human-Computer Interaction International Journal of Human-Computer Interaction 27 1

[40] S. ZhaiC. MorimotoS. Ihde 1999 Manual and Gaze Input Cascaded (MAGIC) Pointing ACM SIGCHI Conference on Human Factors in Computing System (CHI) 1999

[41] S. ZhaiM. HunterB.A. Smith The Metropols Keyboard- An Exploration of Quantitative Techniques for Virtual Keyboard Design Proceedings of ACM Symposium on User Interface Software and Technology (UIST 2000) November 5-8 2000

[42] Y. ZhangA. BullingH. Gellersen 2013 SideWays: A Gaze Interface for Spontaneous Interaction with Situated Displays ACM SIGCHI Conference on Human Factors in Computing System (CHI) 2013

Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65