Vibe or Light? Someone or All?: Effects of Feedback Modality and Who Receives Feedback on Meeting Support

We explore how meeting members modify their responses to feedback according to the feedback modality and who receives the feedback. We conducted a field study and compared four feedback conditions: three using vibrotactile modality (chair vibration) and one using visual modality (spotlight flashing). The three vibrotactile conditions differ in the feedback recipients: potential speaker (a member whom other members would like to hear speak next, or a member who is willing to speak next), current speaker, and all members. Regarding the modality, the vibrotactile modality provided a moderate level of distraction of members (while the visual modality was low enough to be ignored) and led to more turn-taking than the visual modality. Regarding the recipients, members felt more positively about feedback when potential speaker, rather than current speaker, received feedback. Also members resulted in more turn-taking when all members or current speaker, rather than potential speaker, received feedback.

Content

Author and article information

Contributors

Junko Ichino

Yoshiko Yagi

Teru Ozawa

Conference

Publication date: July 2021

Publication date (Print): July 2021

Pages: 312-323

Affiliations

[0001]Tokyo City University

Yokohama, JAPAN

[0002]ITOKI CORPORATION

Tokyo, JAPAN

Article

DOI: 10.14236/ewic/HCI2021.34

SO-VID: 1c93852d-8a24-4f63-b4f9-28ab9bb22652

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: 34th British HCI Conference

Conference acronym: HCI2021

Conference number: 34

Conference location: London, UK

Conference date: 20th - 21st July 2021

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Post-pandemic HCI – Living Digitally

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2021.34

Self URI (journal page): https://ewic.bcs.org/

REFERENCES

F.H. Allport (1924) Social psychology. Reverside Press, Cambridge, MA, USA.
E. Awaji and Y. Okabe (1932) The Introversion-Extroversion Test. The Japanese Journal of Psychology, 7, 1, 2–10.
M. Balaam, G. Fitzpatrick, J. Good and E. Harris (2011) Enhancing interactional synchrony with an ambient display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, NewYork, NY, USA, 867–876.
K. Bachour, F. Kaplan and P. Dillenbourg (2010) An interactive table for supporting participation balance in face-to-face collaborative learning, IEEE Transactions on Learning Technologies 3, 3, 203-213.
T Bergstrom and K. Karahalios (2007) Seeing more: Visualizing audio cues. In Proceedings of the 11th IFIP TC.13 International Conference on Human-Computer Interaction (INTERACT 2007), Springer, 29–42.
J. BirnholtzD. Gergle, N. Liebman and S. Sinclair (2015) Feeling Aware: Investigating the Use of a Mobile Variable-Friction Tactile Display for Awareness Information. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15). ACM, NewYork, NY, USA, 16–25.
J.R. Blum and J.R. Cooperstock (2016) Expressing Human State via Parameterized Haptic Feedback for Mobile Remote Implicit Communication. In Proceedings of the 7th Augmented Human International Conference 2016 (AH '16). ACM, NewYork, NY, USA, 41.
G. Burns (1995) The secrets of team facilitation. Training and Development 49, 6, 46-52.
E. Dagan, E.M. Segura, M. Flores and K. Isbister (2018) “Not Too Much, Not Too Little” Wearables For Group Discussions. In Proceeding CHI EA '18 Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA ’18). ACM, NewYork, NY, USA, LBW129.
E. Dagan, E.M. Segura, F.A. Bertran, M. Flores, R. Mitchell and K. Isbister (2019) Design Framework for Social Wearables Proceeding. In Proceedings of the 2019 on Designing Interactive Systems Conference (DIS '19). ACM, NewYork, NY, USA, 1001–1015.
Y. Den, N. Yoshida, K. Takanashi and H. Koiso (2011) Annotation of japanese response tokens and preliminary analysis on their distribution in three-party conversations. In Proceedings of the 14th Oriental COCOSDA (O-COCOSDA 2011). IEEE, 168–173.
J.M. DiMicco, A. Pandolfo and W. Bender (2004) Influencing group participation with a shared display. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW ’04). ACM, NewYork, NY, USA, 614–623.
J.M. DiMicco, K.J. Hollenbach, A. Pandolfo and W. Bender (2007) The Impact of Increased Awareness While Face-to-Face. Human-Computer Interaction, 22, 47–96.
M. Doyle and D. Straus (1993) How to make meetings work: The new interaction method. Berkley Trade, NewYork, NY, USA.
H. Hornecker and E. Nicol (2012) What do lab-based user studies tell us about in-the-wild behavior? : insights from a study of museum interactives. In Proceedings of Designing Interactive Systems (DIS '12). ACM, New York, USA, 358–367.
T. Kim, A. Chang, L. Holland and A.S. Pentland (2008) Meeting mediator: enhancing group collaboration using sociometric feedback. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work (CSCW '08). ACM, New York, NY, 457–466.
B. Latané and J.M. Darley (1970) The unresponsive bystander: Why doesn't he help? Appleton-Century-Crofts, New York.
B. Latané, K. Williams and S. Harkins (1979) Many hands make light the work: The causes and consequences of social loafing. Journal of Personality and Social Psychology 37, 6, 822–832.
G. Leshed, D. Perez, J.T. Hancock, D. Cosley, J. Birnholtz, S. Lee, P.L. McLeod and G. Gay (2009) Visualizing real-time language-based feedback on teamwork behavior in computer-mediated groups. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, NewYork, NY, USA, 537–546.
A. Meier, D.J.C. Matthies, B. Urban and R. Wettach (2015) Exploring vibrotactile feedback on the body and foot for the purpose of pedestrian navigation. In Proceedings of the 2nd international Workshop on Sensor-based Activity Recognition and Interaction (iWOAR '15). ACM, NewYork, NY, USA, 11.
M. Nowak, J. Kim, N.W. Kim and C. Nass (2012) Social visualization and negotiation: effects of feedback configuration and status. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work (CSCW '12). ACM, NewYork, NY, USA, 1081–1090.
V. Occhialini, H.v. Essen and B. Eggen (2011) Design and Evaluation of an Ambient Display to Support Time Management during Meetings. In Proceedings of the 13th IFIP TC 13 international Conference on Human-computer interaction (INTERACT '11). Springer-Verlag Berlin, Heidelberg, 263-280.
N.L. Oxley, M.T. Dzindolet and P.B. Paulus (1996) The effects of facilitators on the performance of brainstorming groups. Journal of Social Behavior and Personality, 11, 4, 633–646. Select Press, Corte Madera, CA, USA.
M. Pielot and R. Oliveira (2013) Peripheral Vibro-Tactile Displays. In Proceedings of the 15th international Conference on Human-computer interaction with mobile devices and services (MobileHCI '13). ACM, NewYork, NY, USA, 1–10.
B. Reeves and C. Nass (1996) The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. Chicago, IL, US: Center for the Study of Language and Information, New York, NY, US: Cambridge University Press.
H. Sacks, E.A. Schegloff and G. Jefferson (1974) A simplest systematics for the organization of turn-taking in conversation. Language 50, 4, 696–735.
B. Saket, C. Prasojo, Y. Huang and S. Zhao (2013) Designing an Effective Vibration-Based Notification Interface for Mobile Phones. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (CSCW '13). ACM, NewYork, NY, USA, 1499–1504.
D. Sanchez-Cortes, O. Aran, M.S. Mast and D. Gatica-Perez (2012) A Nonverbal Behavior Approach to Identify Emergent Leaders in Small Groups. IEEE Transactions on Multimedia 14, 3, 816–832.
G. Schiavo, A. Cappelletti, E. Mencarini, O. Stock and M. Zancanaro (2014) Overt or subtle? Supporting group conversations with automatically targeted directives. In Proceedings of the 19th international Conference on Intelligent User Interfaces (IUI '14). ACM, NewYork, NY, USA, 225–234.
O.S. Schneider, H. Seifi, S. Kashani, M. Chun and K.E. MacLean (2016) HapTurk Crowdsourcing Affective Ratings of Vibrotactile Icons. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NewYork, NY, USA, 3248–3260.
J. Snyder, M. Matthews, J.T. Chien, P.F. Chang, E. Sun, S. Abdullah and G. Gay (2015) MoodLight: Exploring Personal and Social Implications of Ambient Display of Biosensor Data. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM, NewYork, NY, USA, 143–153.
A. Soller, A. Martínez, P. Jermann and M. Muehlenbrock (2005) From Mirroring to Guiding: A Review of State of the Art Technology for Supporting Collaborative Learning. International Journal of Artificial Intelligence in Education, 15, 4, 261–290.
S. Streng, K. Stegmann, H. Hußmann and F. Fischer (2009) Metaphor or diagram? Comparing different representations for group mirrors. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group (OZCHI '09). ACM, NewYork, NY, USA, 249–256. http://doi.org/10.1145/1738826.1738866
S. Tausch, D. Hausen, I. Kosan, A. Raltchev and H. Hussmann (2014) Groupgarden: Supporting Brainstorming through a Metaphorical Group Mirror on Table or Wall. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction (NordiCHI '14). ACM, NewYork, NY, USA, 26–30.
Stephanie Ta Sarah Tausch and Heinrich Hussmann. (2016) A Comparison of Cooperative and Competitive Visualizations for Co-located Collaboration. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NewYork, NY, USA, 5034–5039.
Y.R. Tausczik and J.W. Pennebaker (2013) Improving teamwork using real-time language feedback. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, NewYork, NY, USA, 459–468.
J. Terken and J. Sturm (2010) Multimodal Support for Social Dynamics in Co-located Meetings. Personal Ubiquitous Computing 14, 8. Springer-Verlag London, UK, 703–714.
N. Triplett (1898) The dynamogenic factors in pacemaking and Competition. American Journal of Psychology 9, 507–533.
S.P. Weisband, S.K. Schneider and T. Connolly (1995) Computer-Mediated Communication and Social Information: Status Salience and Status Differences. Academy of Management Journal 38, 4, 1124–1151.
K.D. Williams and S.J. Karau (1991) Social loafing and social compensation: The effects of expectations of co-worker performance. Journal of Personality and Social Psychology 61, 4, 570–581.

Comments

Comment on this article

[1] F.H. Allport (1924) Social psychology. Reverside Press, Cambridge, MA, USA.

[2] E. Awaji and Y. Okabe (1932) The Introversion-Extroversion Test. The Japanese Journal of Psychology, 7, 1, 2–10.

[3] M. Balaam, G. Fitzpatrick, J. Good and E. Harris (2011) Enhancing interactional synchrony with an ambient display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, NewYork, NY, USA, 867–876.

[4] K. Bachour, F. Kaplan and P. Dillenbourg (2010) An interactive table for supporting participation balance in face-to-face collaborative learning, IEEE Transactions on Learning Technologies 3, 3, 203-213.

[5] T Bergstrom and K. Karahalios (2007) Seeing more: Visualizing audio cues. In Proceedings of the 11th IFIP TC.13 International Conference on Human-Computer Interaction (INTERACT 2007), Springer, 29–42.

[6] J. BirnholtzD. Gergle, N. Liebman and S. Sinclair (2015) Feeling Aware: Investigating the Use of a Mobile Variable-Friction Tactile Display for Awareness Information. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15). ACM, NewYork, NY, USA, 16–25.

[7] J.R. Blum and J.R. Cooperstock (2016) Expressing Human State via Parameterized Haptic Feedback for Mobile Remote Implicit Communication. In Proceedings of the 7th Augmented Human International Conference 2016 (AH '16). ACM, NewYork, NY, USA, 41.

[8] G. Burns (1995) The secrets of team facilitation. Training and Development 49, 6, 46-52.

[9] E. Dagan, E.M. Segura, M. Flores and K. Isbister (2018) “Not Too Much, Not Too Little” Wearables For Group Discussions. In Proceeding CHI EA '18 Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA ’18). ACM, NewYork, NY, USA, LBW129.

[10] E. Dagan, E.M. Segura, F.A. Bertran, M. Flores, R. Mitchell and K. Isbister (2019) Design Framework for Social Wearables Proceeding. In Proceedings of the 2019 on Designing Interactive Systems Conference (DIS '19). ACM, NewYork, NY, USA, 1001–1015.

[11] Y. Den, N. Yoshida, K. Takanashi and H. Koiso (2011) Annotation of japanese response tokens and preliminary analysis on their distribution in three-party conversations. In Proceedings of the 14th Oriental COCOSDA (O-COCOSDA 2011). IEEE, 168–173.

[12] J.M. DiMicco, A. Pandolfo and W. Bender (2004) Influencing group participation with a shared display. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW ’04). ACM, NewYork, NY, USA, 614–623.

[13] J.M. DiMicco, K.J. Hollenbach, A. Pandolfo and W. Bender (2007) The Impact of Increased Awareness While Face-to-Face. Human-Computer Interaction, 22, 47–96.

[14] M. Doyle and D. Straus (1993) How to make meetings work: The new interaction method. Berkley Trade, NewYork, NY, USA.

[15] H. Hornecker and E. Nicol (2012) What do lab-based user studies tell us about in-the-wild behavior? : insights from a study of museum interactives. In Proceedings of Designing Interactive Systems (DIS '12). ACM, New York, USA, 358–367.

[16] T. Kim, A. Chang, L. Holland and A.S. Pentland (2008) Meeting mediator: enhancing group collaboration using sociometric feedback. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work (CSCW '08). ACM, New York, NY, 457–466.

[17] B. Latané and J.M. Darley (1970) The unresponsive bystander: Why doesn't he help? Appleton-Century-Crofts, New York.

[18] B. Latané, K. Williams and S. Harkins (1979) Many hands make light the work: The causes and consequences of social loafing. Journal of Personality and Social Psychology 37, 6, 822–832.

[19] G. Leshed, D. Perez, J.T. Hancock, D. Cosley, J. Birnholtz, S. Lee, P.L. McLeod and G. Gay (2009) Visualizing real-time language-based feedback on teamwork behavior in computer-mediated groups. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, NewYork, NY, USA, 537–546.

[20] A. Meier, D.J.C. Matthies, B. Urban and R. Wettach (2015) Exploring vibrotactile feedback on the body and foot for the purpose of pedestrian navigation. In Proceedings of the 2nd international Workshop on Sensor-based Activity Recognition and Interaction (iWOAR '15). ACM, NewYork, NY, USA, 11.

[21] M. Nowak, J. Kim, N.W. Kim and C. Nass (2012) Social visualization and negotiation: effects of feedback configuration and status. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work (CSCW '12). ACM, NewYork, NY, USA, 1081–1090.

[22] V. Occhialini, H.v. Essen and B. Eggen (2011) Design and Evaluation of an Ambient Display to Support Time Management during Meetings. In Proceedings of the 13th IFIP TC 13 international Conference on Human-computer interaction (INTERACT '11). Springer-Verlag Berlin, Heidelberg, 263-280.

[23] N.L. Oxley, M.T. Dzindolet and P.B. Paulus (1996) The effects of facilitators on the performance of brainstorming groups. Journal of Social Behavior and Personality, 11, 4, 633–646. Select Press, Corte Madera, CA, USA.

[24] M. Pielot and R. Oliveira (2013) Peripheral Vibro-Tactile Displays. In Proceedings of the 15th international Conference on Human-computer interaction with mobile devices and services (MobileHCI '13). ACM, NewYork, NY, USA, 1–10.

[25] B. Reeves and C. Nass (1996) The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. Chicago, IL, US: Center for the Study of Language and Information, New York, NY, US: Cambridge University Press.

[26] H. Sacks, E.A. Schegloff and G. Jefferson (1974) A simplest systematics for the organization of turn-taking in conversation. Language 50, 4, 696–735.

[27] B. Saket, C. Prasojo, Y. Huang and S. Zhao (2013) Designing an Effective Vibration-Based Notification Interface for Mobile Phones. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (CSCW '13). ACM, NewYork, NY, USA, 1499–1504.

[28] D. Sanchez-Cortes, O. Aran, M.S. Mast and D. Gatica-Perez (2012) A Nonverbal Behavior Approach to Identify Emergent Leaders in Small Groups. IEEE Transactions on Multimedia 14, 3, 816–832.

[29] G. Schiavo, A. Cappelletti, E. Mencarini, O. Stock and M. Zancanaro (2014) Overt or subtle? Supporting group conversations with automatically targeted directives. In Proceedings of the 19th international Conference on Intelligent User Interfaces (IUI '14). ACM, NewYork, NY, USA, 225–234.

[30] O.S. Schneider, H. Seifi, S. Kashani, M. Chun and K.E. MacLean (2016) HapTurk Crowdsourcing Affective Ratings of Vibrotactile Icons. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NewYork, NY, USA, 3248–3260.

[31] J. Snyder, M. Matthews, J.T. Chien, P.F. Chang, E. Sun, S. Abdullah and G. Gay (2015) MoodLight: Exploring Personal and Social Implications of Ambient Display of Biosensor Data. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM, NewYork, NY, USA, 143–153.

[32] A. Soller, A. Martínez, P. Jermann and M. Muehlenbrock (2005) From Mirroring to Guiding: A Review of State of the Art Technology for Supporting Collaborative Learning. International Journal of Artificial Intelligence in Education, 15, 4, 261–290.

[33] S. Streng, K. Stegmann, H. Hußmann and F. Fischer (2009) Metaphor or diagram? Comparing different representations for group mirrors. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group (OZCHI '09). ACM, NewYork, NY, USA, 249–256. http://doi.org/10.1145/1738826.1738866

[34] S. Tausch, D. Hausen, I. Kosan, A. Raltchev and H. Hussmann (2014) Groupgarden: Supporting Brainstorming through a Metaphorical Group Mirror on Table or Wall. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction (NordiCHI '14). ACM, NewYork, NY, USA, 26–30.

[35] Stephanie Ta Sarah Tausch and Heinrich Hussmann. (2016) A Comparison of Cooperative and Competitive Visualizations for Co-located Collaboration. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NewYork, NY, USA, 5034–5039.

[36] Y.R. Tausczik and J.W. Pennebaker (2013) Improving teamwork using real-time language feedback. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, NewYork, NY, USA, 459–468.

[37] J. Terken and J. Sturm (2010) Multimodal Support for Social Dynamics in Co-located Meetings. Personal Ubiquitous Computing 14, 8. Springer-Verlag London, UK, 703–714.

[38] N. Triplett (1898) The dynamogenic factors in pacemaking and Competition. American Journal of Psychology 9, 507–533.

[39] S.P. Weisband, S.K. Schneider and T. Connolly (1995) Computer-Mediated Communication and Social Information: Status Salience and Status Differences. Academy of Management Journal 38, 4, 1124–1151.

[40] K.D. Williams and S.J. Karau (1991) Social loafing and social compensation: The effects of expectations of co-worker performance. Journal of Personality and Social Psychology 61, 4, 570–581.

Studying business & IT? Drive your professional career forwards with BCS books - for a 20% discount click here: shop.bcs.org