The Effect of BiSensory Feedback Using the Eye Movement Sonification on Decision-Making: Challenging on Specificity of Learning Hypothesis

Authors

1 Department of Sports Coaching, Faculty of Sport Sciences and Health, University of Tehran, Tehran, Iran.

2 Department of Cognitive and Behavioral Science and Technology in Sport, Faculty of Sport Sciences and Health, Shahid Beheshti University, Tehran, Iran.

3 Department for Life Quality Studies, University of Bologna, Bologna, Italy.

Abstract
Objectives: Using auditory concurrent feedback with the goal of gaze path learning is a novel method in the attention field. The present study aimed to determine the effect of bisensory feedback using eye movement sonification on the decision-making of the badminton clear shot direction.

Method: In a semi-experimental strategy, with pre-post design without a control group and clinical method, participants performed recognizing the direction of the shot under unisensory and bisensory training conditions. Response accuracy, response time, and fixation duration were measured in the pre-test, immediate retention, and delayed retention.

Results: The results showed that in the immediate and delayed retention, the bisensory group had higher response accuracy and shorter response time than the unisensory group. The bisensory group had a longer fixation duration in key areas than the unisensory group in both times.

Conclusion: The use of auditory feedback can probably be considered as a way to improve decision-making skills at the novice level.



Keywords


Smith SM, Krajbich Ps. Gaze amplifies value in decision making. Psychological science. 2019;30(1):116-28. [DOI:10.1177/0956797618810521]
Smith SM, Krajbich Ps. Gaze amplifies value in decision making. Psychological science. 2019;30(1):116-28. [DOI:10.1177/0956797618810521]
Williams AM, Jackson RS. Anticipation in sport: Fifty years on, what have we learned and what research still needs to be undertaken? Psychology of Sport and Exercise. 2019;42:16-24. [DOI:10.1016/j.psychsport.2018.11.014]
Williams AM, Jackson RS. Anticipation in sport: Fifty years on, what have we learned and what research still needs to be undertaken? Psychology of Sport and Exercise. 2019;42:16-24. [DOI:10.1016/j.psychsport.2018.11.014]
Hancock DJ, Ste-Marie D. Gaze behaviors and decision making accuracy of higher-and lower-level ice hockey referees. Psychology of Sport and Exercise. 2013;14(1):66-71. [DOI:10.1016/j.psychsport.2012.08.002]
Hancock DJ, Ste-Marie D. Gaze behaviors and decision making accuracy of higher-and lower-level ice hockey referees. Psychology of Sport and Exercise. 2013;14(1):66-71. [DOI:10.1016/j.psychsport.2012.08.002]
Dyer JF, Stapleton P, Rodger M. Mapping sonification for perception and action in motor skill learning. Frontiers in neuroscience. 2017;11:463. [DOI:10.3389/fnins.2017.00463]
Dyer JF, Stapleton P, Rodger M. Mapping sonification for perception and action in motor skill learning. Frontiers in neuroscience. 2017;11:463. [DOI:10.3389/fnins.2017.00463]
Schnyder U, Koedijker JM, Kredel R, Hossner EJ. Gaze behaviour in offside decision-making in football. German journal of exercise and sport research. 2017;2(47):103-9. 10.1007/s12662-017-0449-0 [DOI:10.1007/s12662-017-0449-0]
Schnyder U, Koedijker JM, Kredel R, Hossner EJ. Gaze behaviour in offside decision-making in football. German journal of exercise and sport research. 2017;2(47):103-9. 10.1007/s12662-017-0449-0 [DOI:10.1007/s12662-017-0449-0]
Raab M, Bar-Eli M, Plessner H, Araújo D. The past, present and future of research on judgment and decision making in sport. Psychology of Sport and Exercise. 2019;42:25-32. [DOI:10.1016/j.psychsport.2018.10.004]
Raab M, Bar-Eli M, Plessner H, Araújo D. The past, present and future of research on judgment and decision making in sport. Psychology of Sport and Exercise. 2019;42:25-32. [DOI:10.1016/j.psychsport.2018.10.004]
Orquin JL, Loose SM. Attention and choice: A review on eye movements in decision making. Acta psychologica. 2013;144(1):190-206. [DOI:10.1016/j.actpsy.2013.06.003]
Orquin JL, Loose SM. Attention and choice: A review on eye movements in decision making. Acta psychologica. 2013;144(1):190-206. [DOI:10.1016/j.actpsy.2013.06.003]
Hagemann N, Strauss B, Cañal-Bruland R. Training perceptual skill by orienting visual attention. Journal of sport and exercise psychology. 2006;28(2):143-58. [DOI:10.1123/jsep.28.2.143]
Hagemann N, Strauss B, Cañal-Bruland R. Training perceptual skill by orienting visual attention. Journal of sport and exercise psychology. 2006;28(2):143-58. [DOI:10.1123/jsep.28.2.143]
Alder D, Ford PR, Causer J, Williams AM. The coupling between gaze behavior and opponent kinematics during anticipation of badminton shots. Human movement science. 2014;37:167-79. [DOI:10.1016/j.humov.2014.07.002]
Alder D, Ford PR, Causer J, Williams AM. The coupling between gaze behavior and opponent kinematics during anticipation of badminton shots. Human movement science. 2014;37:167-79. [DOI:10.1016/j.humov.2014.07.002]
Sigrist R, Rauter G, Riener R, Wolf P. Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review. Psychonomic bulletin & review. 2013;20(1):21-53. [DOI:10.3758/s13423-012-0333-8]
Sigrist R, Rauter G, Riener R, Wolf P. Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review. Psychonomic bulletin & review. 2013;20(1):21-53. [DOI:10.3758/s13423-012-0333-8]
Chen S, Shi Z, Müller HJ, Geyer T. Multisensory visuo-tactile context learning enhances the guidance of unisensory visual search. Scientific reports. 2021;11(1):1-15. [DOI:10.1038/s41598-021-88946-6]
Chen S, Shi Z, Müller HJ, Geyer T. Multisensory visuo-tactile context learning enhances the guidance of unisensory visual search. Scientific reports. 2021;11(1):1-15. [DOI:10.1038/s41598-021-88946-6]
Sigrist R, Rauter G, Marchal-Crespo L, Riener R, Wolf P. Sonification and haptic feedback in addition to visual feedback enhances complex motor task learning. Experimental brain research. 2015;233(3):909-25. [DOI:10.1007/s00221-014-4167-7]
Sigrist R, Rauter G, Marchal-Crespo L, Riener R, Wolf P. Sonification and haptic feedback in addition to visual feedback enhances complex motor task learning. Experimental brain research. 2015;233(3):909-25. [DOI:10.1007/s00221-014-4167-7]
Schmidt RA. Frequent augmented feedback can degrade learning: Evidence and interpretations. Tutorials in motor neuroscience: Springer; 1991. p. 59-75. [DOI:10.1016/j.humov.2014.07.002]
Schmidt RA. Frequent augmented feedback can degrade learning: Evidence and interpretations. Tutorials in motor neuroscience: Springer; 1991. p. 59-75. [DOI:10.1016/j.humov.2014.07.002]
Wolpert DM, Diedrichsen J, Flanagan J. Principles of sensorimotor learning. Nature Reviews Neuroscience. 2011;12(12):739-51. doi:10.1038/nrn3112 [DOI:10.1038/nrn3112]
Wolpert DM, Diedrichsen J, Flanagan J. Principles of sensorimotor learning. Nature Reviews Neuroscience. 2011;12(12):739-51. doi:10.1038/nrn3112 [DOI:10.1038/nrn3112]
Coutrot A, Guyader N, Ionescu G, Caplier A. Influence of soundtrack on eye movements during video exploration. Journal of Eye Movement Research. 2012;5(4):2. https://hal.science/hal-00723883v1 [DOI:10.16910/jemr.5.4.2]
Coutrot A, Guyader N, Ionescu G, Caplier A. Influence of soundtrack on eye movements during video exploration. Journal of Eye Movement Research. 2012;5(4):2. https://hal.science/hal-00723883v1 [DOI:10.16910/jemr.5.4.2]
Khalaji M, Aghdaei M, Farsi A, Piras A. The effect of eye movement sonification on visual search patterns and anticipation in novices. Journal on Multimodal User Interfaces. 2022. 1:1-0. [DOI:10.1007/s12193-021-00381-z]
Khalaji M, Aghdaei M, Farsi A, Piras A. The effect of eye movement sonification on visual search patterns and anticipation in novices. Journal on Multimodal User Interfaces. 2022. 1:1-0. [DOI:10.1007/s12193-021-00381-z]
Al Fayyadh MJ, Hassan RA, Tran ZK, Kempenich JW, Bunegin L, Dent DL, Willis RE. Immediate auditory feedback is superior to other types of feedback for basic surgical skills acquisition. Journal of surgical education. 2017;74(6):55-61. [DOI:10.1016/j.jsurg.2017.08.005]
Al Fayyadh MJ, Hassan RA, Tran ZK, Kempenich JW, Bunegin L, Dent DL, Willis RE. Immediate auditory feedback is superior to other types of feedback for basic surgical skills acquisition. Journal of surgical education. 2017;74(6):55-61. [DOI:10.1016/j.jsurg.2017.08.005]
Hildebrandt A, Cañal-Bruland R. Effects of auditory feedback on gait behavior, gaze patterns and outcome performance in long jumping. Human Movement Science. 2021;78:102-127. [DOI:10.1016/j.humov.2021.102827]
Hildebrandt A, Cañal-Bruland R. Effects of auditory feedback on gait behavior, gaze patterns and outcome performance in long jumping. Human Movement Science. 2021;78:102-127. [DOI:10.1016/j.humov.2021.102827]
Proteau LJAip. On the specificity of learning and the role of visual information for movement control. Advances in psychology. 1992;85:67-103. [DOI:10.1016/S0166-4115(08)62011-7]
Proteau LJAip. On the specificity of learning and the role of visual information for movement control. Advances in psychology. 1992;85:67-103. [DOI:10.1016/S0166-4115(08)62011-7]
Mann DL, Causer J, Nakamoto H, Runswick OR. Visual search behaviours in expert perceptual judgements. In Anticipation and decision making in sport. 2019. p. 59-78. [DOI:10.4324/9781315146270-4]
Mann DL, Causer J, Nakamoto H, Runswick OR. Visual search behaviours in expert perceptual judgements. In Anticipation and decision making in sport. 2019. p. 59-78. [DOI:10.4324/9781315146270-4]
Jakus G, Stojmenova K, Tomažič S, Sodnik J. A system for efficient motor learning using multimodal augmented feedback. Multimedia Tools and Applications. 2017;76(20):20409-21. DOI 10.1007/s11042-016-3774-7 [DOI:10.1007/s11042-016-3774-7]
Jakus G, Stojmenova K, Tomažič S, Sodnik J. A system for efficient motor learning using multimodal augmented feedback. Multimedia Tools and Applications. 2017;76(20):20409-21. DOI 10.1007/s11042-016-3774-7 [DOI:10.1007/s11042-016-3774-7]