Towards an Approach for Analysing External Representations Created During Sensemaking Using Generative Grammar

During sensemaking, users often create external representations to help them make sense of what they know, and what they need to know. In doing so, they necessarily adopt or construct some form of representational language using the tools at hand. By describing such languages implicit in representations we believe that we are better able to describe and differentiate what users do and better able to describe and differentiate interfaces that might support them. Drawing on approaches to the analysis of language, and in particular, Mann and Thompson’s Rhetorical Structure Theory, we analyse the representations that users create to expose their underlying ‘visual grammar’. We do this in the context of a user study involving evidential reasoning. Participants were asked to address an adapted version of IEEE VAST 2011 mini challenge 3 (interpret a potential terrorist plot implicit in a set of news reports). We show how our approach enables the unpacking of the heterogeneous and embedded nature of user-generated representations and allows us to show how visual grammars evolve and become more complex over time in response to evolving sensemaking needs.

Content

Author and article information

Contributors

Efeosasere Okoro

Simon Attfield

Conference

Publication date: July 2016

Publication date (Print): July 2016

Pages: 1-9

Affiliations

[0001]National Institute of Construction Technology

Edo State, Nigeria

[0002]Middlesex University

London, UK

Article

DOI: 10.14236/ewic/HCI2016.31

SO-VID: c9f06bb1-bed1-48f8-b415-eef08f2c929e

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Proceedings of the 30th International BCS Human Computer Interaction Conference

Conference acronym: HCI

Conference number: 30

Conference location: Bournemouth University, Poole, UK

Conference date: 11 - 15 July 2016

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Fusion

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2016.31

Self URI (journal page): https://ewic.bcs.org/

REFERENCES

S. AttfieldA. Blandford 2011 Making sense of digital footprints in team-based legal investigations: The acquisition of focus Human – Computer Interaction 26 1-2 38 71
F. J. Bex 2009 Evidence for a good story: a hybrid theory of arguments, stories and criminal evidence (Doctoral dissertation, University of Groningen
F. J. BexP. J. Van KoppenH. PrakkenB. Verheij 2010 A hybrid formal theory of arguments, stories and criminal evidence Artificial Intelligence and Law 18 2 123 152
A. BlandfordS. FaisalS. Attfield 2014 Conceptual design for sensemaking Handbook of Human Centric Visualization 253 283 Springer New York
L. ChapinS. AttfieldE Okoro 2013 Predictive Coding, Storytelling and God:Narrative Understanding in E-Discovery Workshop on Standards for Using Predictive Coding, Machine Learning, and Other Advanced Search and Review Methods in E-Discovery (DESI V)
S. B. Chatman 1980 Story and discourse Narrative structure in fiction and film Cornell University Press
L. CyraJ. Górski 2011 Support for argument structures review and assessment Reliability Engineering & System Safety 96 1 26 37
A. Fisher 2004 The logic of real arguments Cambridge University Press
D. Kirsh 2009 Interaction, External Representation and Sense Making Proceedings of the Thirty-First Annual Conference of the Cognitive Science Society Mahwah, NJ
D. KirshP. Maglio 1994 On distinguishing epistemic from pragmatic action Cognitive science 18 4 513 549
G. KleinB. MoonR. R. Hoffman 2006 Making sense of sensemaking 2: A macrocognitive model IEEE Intelligent Systems/ 21 5 88 92
G. KleinJ. K. PhillipsE. L. RallD. A. Peluso 2007 A data-frame theory of sensemaking. In Expertise out of context Proceedings of the sixth international conference on naturalistic decision making/ 113 155 New York, NY, USA Lawrence Erlbaum
N. T. LeS. NiebuhrD. DrexlerN. Pinkwart 2013 July Scaffolding computer supported argumentation processes through mini map based interaction techniques International Conference of Design, User Experience, and Usability/ 533 542 Springer Berlin Heidelberg
F. MacagnoC. ReedD. Walton 2007 Argument Diagramming in Logic, Artificial Intelligence, and Law Artificial Intelligence, and Law/ 87 109
W. C. MannS. A. Thompson 1987 Rhetorical structure theory A theory of text organization/ 87 190 University of Southern California Information Sciences Institute
W. C. MannS. A. Thompson 1988 Rhetorical structure theory: Toward a functional theory of text organization Text-Interdisciplinary Journal for the Study of Discourse/ 8 3 243 281
J. I. M. McElhaney 2009 Arsenal of Persuasion The. ABAJ/ 95 24
N. PenningtonR. Hastie 1986 Evidence evaluation in complex decision making Journal of Personality and Social Psychology/ 51 2 242
N. PenningtonR. Hastie 1992 Explaining the evidence: Tests of the Story Model for juror decision making Journal of personality and social psychology/ 62 2 189
N. PenningtonR. Hastie 1991 Cognitive theory of juror decision making The story model, A. Cardozo L. Rev/ 13 519
D. M. RussellM. J. StefikP. PirolliS.K. Card 1993 May The cost structure of sensemaking Proceedings of the INTERACT’93 and CHI’93 conference on Human factors in computing systems/ 269 276 ACM
P. SbarskiT. van GelderK. MarriottD. PragerA. Bulka 2008 December Visualizing argument structure International Symposium on Visual Computing/ 129 138 Springer Berlin Heidelberg
S. E. Toulmin 2003 The uses of argument Cambridge University Press
C. Twardy 2004 Argument maps improve critical thinking Teaching Philosophy/ 27 2 95 116
T. Van Gelder 2002 Argument mapping with reason! able The American Philosophical Association Newsletter on Philosophy and Computers/ 2 1 85 90
W. A. WagenaarP. J. Van KoppenH. F. Crombag 1993 Anchored narratives The psychology of criminal evidence/ St Martin’s Press
J. H. Wigmore 1913 The principles of judicial proof: as given by logic, psychology, and general experience, and illustrated in judicial trials 1 Little, Brown/
B. W. WongM. Varga 2012 September Black holes, keyholes and brown worms: Challenges in sense making Proceedings of the Human Factors and Ergonomics Society Annual Meeting/ 56 1 287 291 SAGE Publications
X. ZhangY. QuC. L. GilesP. Song 2008 April CiteSense: supporting sensemaking of research literature Proceedings of the SIGCHI Conference on Human Factors in Computing Systems/ 677 680 ACM

Comments

Comment on this article

[1] S. AttfieldA. Blandford 2011 Making sense of digital footprints in team-based legal investigations: The acquisition of focus Human – Computer Interaction 26 1-2 38 71

[2] F. J. Bex 2009 Evidence for a good story: a hybrid theory of arguments, stories and criminal evidence (Doctoral dissertation, University of Groningen

[3] F. J. BexP. J. Van KoppenH. PrakkenB. Verheij 2010 A hybrid formal theory of arguments, stories and criminal evidence Artificial Intelligence and Law 18 2 123 152

[4] A. BlandfordS. FaisalS. Attfield 2014 Conceptual design for sensemaking Handbook of Human Centric Visualization 253 283 Springer New York

[5] L. ChapinS. AttfieldE Okoro 2013 Predictive Coding, Storytelling and God:Narrative Understanding in E-Discovery Workshop on Standards for Using Predictive Coding, Machine Learning, and Other Advanced Search and Review Methods in E-Discovery (DESI V)

[6] S. B. Chatman 1980 Story and discourse Narrative structure in fiction and film Cornell University Press

[7] L. CyraJ. Górski 2011 Support for argument structures review and assessment Reliability Engineering & System Safety 96 1 26 37

[8] A. Fisher 2004 The logic of real arguments Cambridge University Press

[9] D. Kirsh 2009 Interaction, External Representation and Sense Making Proceedings of the Thirty-First Annual Conference of the Cognitive Science Society Mahwah, NJ

[10] D. KirshP. Maglio 1994 On distinguishing epistemic from pragmatic action Cognitive science 18 4 513 549

[11] G. KleinB. MoonR. R. Hoffman 2006 Making sense of sensemaking 2: A macrocognitive model IEEE Intelligent Systems/ 21 5 88 92

[12] G. KleinJ. K. PhillipsE. L. RallD. A. Peluso 2007 A data-frame theory of sensemaking. In Expertise out of context Proceedings of the sixth international conference on naturalistic decision making/ 113 155 New York, NY, USA Lawrence Erlbaum

[13] N. T. LeS. NiebuhrD. DrexlerN. Pinkwart 2013 July Scaffolding computer supported argumentation processes through mini map based interaction techniques International Conference of Design, User Experience, and Usability/ 533 542 Springer Berlin Heidelberg

[14] F. MacagnoC. ReedD. Walton 2007 Argument Diagramming in Logic, Artificial Intelligence, and Law Artificial Intelligence, and Law/ 87 109

[15] W. C. MannS. A. Thompson 1987 Rhetorical structure theory A theory of text organization/ 87 190 University of Southern California Information Sciences Institute

[16] W. C. MannS. A. Thompson 1988 Rhetorical structure theory: Toward a functional theory of text organization Text-Interdisciplinary Journal for the Study of Discourse/ 8 3 243 281

[17] J. I. M. McElhaney 2009 Arsenal of Persuasion The. ABAJ/ 95 24

[18] N. PenningtonR. Hastie 1986 Evidence evaluation in complex decision making Journal of Personality and Social Psychology/ 51 2 242

[19] N. PenningtonR. Hastie 1992 Explaining the evidence: Tests of the Story Model for juror decision making Journal of personality and social psychology/ 62 2 189

[20] N. PenningtonR. Hastie 1991 Cognitive theory of juror decision making The story model, A. Cardozo L. Rev/ 13 519

[21] D. M. RussellM. J. StefikP. PirolliS.K. Card 1993 May The cost structure of sensemaking Proceedings of the INTERACT’93 and CHI’93 conference on Human factors in computing systems/ 269 276 ACM

[22] P. SbarskiT. van GelderK. MarriottD. PragerA. Bulka 2008 December Visualizing argument structure International Symposium on Visual Computing/ 129 138 Springer Berlin Heidelberg

[23] S. E. Toulmin 2003 The uses of argument Cambridge University Press

[24] C. Twardy 2004 Argument maps improve critical thinking Teaching Philosophy/ 27 2 95 116

[25] T. Van Gelder 2002 Argument mapping with reason! able The American Philosophical Association Newsletter on Philosophy and Computers/ 2 1 85 90

[26] W. A. WagenaarP. J. Van KoppenH. F. Crombag 1993 Anchored narratives The psychology of criminal evidence/ St Martin’s Press

[27] J. H. Wigmore 1913 The principles of judicial proof: as given by logic, psychology, and general experience, and illustrated in judicial trials 1 Little, Brown/

[28] B. W. WongM. Varga 2012 September Black holes, keyholes and brown worms: Challenges in sense making Proceedings of the Human Factors and Ergonomics Society Annual Meeting/ 56 1 287 291 SAGE Publications

[29] X. ZhangY. QuC. L. GilesP. Song 2008 April CiteSense: supporting sensemaking of research literature Proceedings of the SIGCHI Conference on Human Factors in Computing Systems/ 677 680 ACM

Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65