A Collaborative Artefact Reconstruction Environment

A novel collaborative artefact reconstruction environment design is presented that is informed by experimental task observation and participatory design. The motivation for the design was to enable collaborative human and computer effort in the reconstruction of fragmented cuneiform tablets: millennia-old clay tablets used for written communication in early human civilisation. Thousands of joining cuneiform tablet fragments are distributed within and between worldwide collections. The reconstruction of the tablets poses a complex 3D jigsaw puzzle with no physically tractable solution. In reconstruction experiments, participants collaborated synchronously and asynchronously on virtual and physical reconstruction tasks. Results are presented that demonstrate the difficulties experienced by human reconstructors in virtual tasks compared to physical tasks. Unlike computer counterparts, humans have difficulty identifying joins in virtual environments but, unlike computers, humans are averse to making incorrect joins. A successful reconstruction environment would marry the opposing strengths and weaknesses of humans and computers, and provide tools to support the communications and interactions of successful physical performance, in the virtual setting. The paper presents a taxonomy of the communications and interactions observed in successful physical and synchronous collaborative reconstruction tasks. Tools for the support of these communications and interactions were successfully incorporated in the “i3D” virtual environment design presented.

Content

Author and article information

Contributors

Sandra I. Woolley

Eugene Ch’ng

Luis Hernandez-Munoz

Erlend Gehlken

Tim Collins

David Nash

Andrew Lewis

Laurence Hanes

Conference

Publication date: July 2017

Publication date (Print): July 2017

Pages: 1-11

Affiliations

[0001]Keele University

Staffordshire, UK

[0002]University of Nottingham Ningbo

Ningbo, China

[0003]Birmingham City University

Birmingham, UK

[0004]Institut für Archaeologische

Wissenschaften

Goethe-Universitüt, Germany

[0005]Manchester Metropolitan University

Manchester, UK

[0006]University of Birmingham

Birmingham, UK

[0007]York University

York, UK

Article

DOI: 10.14236/ewic/HCI2017.53

SO-VID: 5c88e406-13aa-427e-adc5-240497398e40

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Proceedings of the 31st International BCS Human Computer Interaction Conference

Conference acronym: HCI

Conference number: 31

Conference location: Sunderland, UK

Conference date: 3-6 July 2017

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Digital Make-Believe

History

ScienceOpen disciplines: Applied computer science,Computer science,Security & Cryptology,Graphics & Multimedia design,General computer science,Human-computer-interaction

Keywords: Artefact Reconstruction,Virtual Environment,Collaboration

References

A. AdánS. SalamancaP. Merchán 2012 A Hybrid Human-Computer Approach for Recovering Incomplete Cultural Heritage Pieces. Computers & Graphics 36 1 1 15
J. Aron 2012 Jigsaw-solving Computer Kicks Puny Humans Aside. New Scientist 214 2869 24
T. N. ArvanitisT. DavisA. LivingstoneJ. Pinilla-DutoitS. I. Woolley 2002 The Digital Classification of Ancient near Eastern Cuneiform Data British Archaeological Review, BAR International Series 1075
C. S. BelenguerE. V. Vidal 2012 Archaeological Fragment Characterization and 3D Reconstruction Based on Projective GPU Depth Maps, IEEE Virtual Systems and Multimedia Milan 275 282
A. BeznosykC. RaymaekersK. ConinxP. QuaxW. Lamotte 2010 Investigating the Influence of Communication and Input Devices on Collaboration in Virtual Environments. Proc. Computer Graphics Theory and Applications 341 346
A. BlacklerV. PopovicD. Mahar 2010 Investigating Users’ Intuitive Interaction with Complex Artefacts Applied Ergonomics 41 1 72 92
E. Budge 1925 The Rise and Progress of Assyriology M. Hopkinson & Co. Ltd UK
D. BurkolterB. WeyersA. KlugeW. Luther 2014 Customization of User Interfaces to Reduce Errors and Enhance User Acceptance Applied Ergonomics 45 2 346 353
E. Ch’ngA. LewisR. E. GehlkenS. I. Woolley 2013 A Theoretical Framework for Stigmergetic Reconstruction of Ancient Text Visual Heritage in the Digital Age 43 65
T. CollinsS. I. WoolleyE. Ch’ngA. W. LewisE. GehlkenL. Hernandez Munoz 2014 sComputer-Assisted Reconstruction of Virtual Fragmented Cuneiform Tablets. IEEE Virtual Systems and Multimedia Hong Kong 70 77
T. CollinsE. GehlkenS. I. WoolleyL. HanesA. LewisL. Hernandez-MunozE. Ch'ng 2016 From Uruk to Ur: Automated Matching of Virtual Tablet Fragments. 62nd Rencontre Assyriologique Internationale Philadelphia
CDLI Cuneiform Digital Library Initiative http://cdli.ucla.edu/ retrieved 01 01 17
E. GehlkenT. CollinsS. I. WoolleyE. Ch'ngL. HanesA. LewisL. Hernandez-Munoz 2017 Searching the Past in the Future - Joining Cuneiform Tablet Fragments in Virtual Collections. 63rd Rencontre Assyriologique Internationale Marburg, Germany
I. HeldalA. SteedR. Schroeder 2005 Evaluating Collaboration in Distributed Virtual Environments for a Puzzle-Solving Task. Proc. Human Computer Interaction 2005 Las Vegas 22 27
I. HeldalM. SpanteM. Connell 2006 Are Two Heads Better Than One?: Object-Focused Work in Physical and in Virtual Environments. Proc. ACM Symposium on Virtual Reality Software and Technology 287 296
Q. X. HuangS. FlöryN. GelfandM. HoferH. Pottmann 2006 Reassembling Fractured Objects By Geometric Matching ACM Transactions on Graphics 25 3 569 578
M. KampelR. Sablatnig 2004 3D Puzzling of Archeological Fragments. Proc. 9th Computer Vision Winter Workshop Piran, Slovenia 31 40
I. KaraseitanidisA. AmditisH. PatelS. SharplesE. BekiarisA. BullingerJ. Tromp 2006 Evaluation of Virtual Reality Products and Applications from Individual, Organizational and Societal Perspectives—The“VIEW”Case Study. International Journal of Human-Computer Studies 64 3 251 266
A. LewisS. WoolleyE. Ch'ngE. Gehlken 2015 Observed Methods of Cuneiform Tablet Reconstruction in Virtual and Real World Environments Journal of Archaeological Science 53 156 165
A. LewisE. Ch’ng 2012 A Photogrammetric Analysis of Cuneiform Tablets for the Purpose of Digital Reconstruction. Cultural Heritage in the Digital Era 1 1 49 53
M. J. Muller 1991 PICTIVE - An Exploration in Participatory Design. Proc. ACM SIGCHI Conference on Human Factors in Computing Systems 225 231
NASA 2003 NASA TLX: Task Load Index. NASA http://humansystems.arc.nasa.gov/groups/TLX/ retrieved 01 01 17
G. PapaioannouE. A. KarabassiT. Theoharis 2001 Virtual archaeologist: Assembling the past. IEEE Computer Graphics and Applications 21 2 53 59
G. PapaioannouT. SchreckA. AndreadisP. MavridisR. GregorI. SipiranK. Vardis 2017 From Reassembly to Object Completion: A Complete Systems Pipeline Journal on Computing and Cultural Heritage 10 2 8
H. PatelM. PettittJ. R. Wilson 2012 Factors of Collaborative Working: A Framework for a Collaboration Model Applied Ergonomics 43 1 1 26
VCTR The Virtual Cuneiform Tablet Recon struction Project http://virtualcuneiform.org retrieved 01 01 17
P. VinkE. A. KoningsveldJ. F. Molenbroek 2006 Positive Outcomes of Participatory Ergonomics in Terms of Greater Comfort and Higher Productivity Applied Ergonomics 37 4 537 546
P. VinkA. S. ImadaK. J. Zink 2008 Defining Stakeholder Involvement in Participatory Design Processes Applied Ergonomics 39 4 519 526
A. R. WillisB. D. Cooper 2008 Computational Reconstruction of Ancient Artifacts IEEE Signal Processing Magazine 25 4 65 83
R. WolffD. J. RobertsA. SteedO. Otto 2007 A Review of Telecollaboration Technologies with Respect to Closely Coupled Collaboration International Journal of Computer Applications in Technology 29 1 11 26
S. I. WoolleyT. R. DavisN. J. FlowersJ. Pinilla-DutoitA. LivingstoneT. N. Arvanitis 2002 Communicating Cuneiform: The Evolution of a Multimedia Cuneiform Database Journal of Visible Language 36 3 308 324
S. I. WoolleyN. J. FlowersT. N. ArvanitisA. LivingstoneT. R. DavisJ. Ellison 2001 3D Capture, Representation and Manipulation of Cuneiform Tablets. Proc. SPIE - ThreeDimensional Image Capture and Applications IV San Jose 103 110

Comments

Comment on this article

[1] A. AdánS. SalamancaP. Merchán 2012 A Hybrid Human-Computer Approach for Recovering Incomplete Cultural Heritage Pieces. Computers & Graphics 36 1 1 15

[2] J. Aron 2012 Jigsaw-solving Computer Kicks Puny Humans Aside. New Scientist 214 2869 24

[3] T. N. ArvanitisT. DavisA. LivingstoneJ. Pinilla-DutoitS. I. Woolley 2002 The Digital Classification of Ancient near Eastern Cuneiform Data British Archaeological Review, BAR International Series 1075

[4] C. S. BelenguerE. V. Vidal 2012 Archaeological Fragment Characterization and 3D Reconstruction Based on Projective GPU Depth Maps, IEEE Virtual Systems and Multimedia Milan 275 282

[5] A. BeznosykC. RaymaekersK. ConinxP. QuaxW. Lamotte 2010 Investigating the Influence of Communication and Input Devices on Collaboration in Virtual Environments. Proc. Computer Graphics Theory and Applications 341 346

[6] A. BlacklerV. PopovicD. Mahar 2010 Investigating Users’ Intuitive Interaction with Complex Artefacts Applied Ergonomics 41 1 72 92

[7] E. Budge 1925 The Rise and Progress of Assyriology M. Hopkinson & Co. Ltd UK

[8] D. BurkolterB. WeyersA. KlugeW. Luther 2014 Customization of User Interfaces to Reduce Errors and Enhance User Acceptance Applied Ergonomics 45 2 346 353

[9] E. Ch’ngA. LewisR. E. GehlkenS. I. Woolley 2013 A Theoretical Framework for Stigmergetic Reconstruction of Ancient Text Visual Heritage in the Digital Age 43 65

[10] T. CollinsS. I. WoolleyE. Ch’ngA. W. LewisE. GehlkenL. Hernandez Munoz 2014 sComputer-Assisted Reconstruction of Virtual Fragmented Cuneiform Tablets. IEEE Virtual Systems and Multimedia Hong Kong 70 77

[11] T. CollinsE. GehlkenS. I. WoolleyL. HanesA. LewisL. Hernandez-MunozE. Ch'ng 2016 From Uruk to Ur: Automated Matching of Virtual Tablet Fragments. 62nd Rencontre Assyriologique Internationale Philadelphia

[12] CDLI Cuneiform Digital Library Initiative http://cdli.ucla.edu/ retrieved 01 01 17

[13] E. GehlkenT. CollinsS. I. WoolleyE. Ch'ngL. HanesA. LewisL. Hernandez-Munoz 2017 Searching the Past in the Future - Joining Cuneiform Tablet Fragments in Virtual Collections. 63rd Rencontre Assyriologique Internationale Marburg, Germany

[14] I. HeldalA. SteedR. Schroeder 2005 Evaluating Collaboration in Distributed Virtual Environments for a Puzzle-Solving Task. Proc. Human Computer Interaction 2005 Las Vegas 22 27

[15] I. HeldalM. SpanteM. Connell 2006 Are Two Heads Better Than One?: Object-Focused Work in Physical and in Virtual Environments. Proc. ACM Symposium on Virtual Reality Software and Technology 287 296

[16] Q. X. HuangS. FlöryN. GelfandM. HoferH. Pottmann 2006 Reassembling Fractured Objects By Geometric Matching ACM Transactions on Graphics 25 3 569 578

[17] M. KampelR. Sablatnig 2004 3D Puzzling of Archeological Fragments. Proc. 9th Computer Vision Winter Workshop Piran, Slovenia 31 40

[18] I. KaraseitanidisA. AmditisH. PatelS. SharplesE. BekiarisA. BullingerJ. Tromp 2006 Evaluation of Virtual Reality Products and Applications from Individual, Organizational and Societal Perspectives—The“VIEW”Case Study. International Journal of Human-Computer Studies 64 3 251 266

[19] A. LewisS. WoolleyE. Ch'ngE. Gehlken 2015 Observed Methods of Cuneiform Tablet Reconstruction in Virtual and Real World Environments Journal of Archaeological Science 53 156 165

[20] A. LewisE. Ch’ng 2012 A Photogrammetric Analysis of Cuneiform Tablets for the Purpose of Digital Reconstruction. Cultural Heritage in the Digital Era 1 1 49 53

[21] M. J. Muller 1991 PICTIVE - An Exploration in Participatory Design. Proc. ACM SIGCHI Conference on Human Factors in Computing Systems 225 231

[22] NASA 2003 NASA TLX: Task Load Index. NASA http://humansystems.arc.nasa.gov/groups/TLX/ retrieved 01 01 17

[23] G. PapaioannouE. A. KarabassiT. Theoharis 2001 Virtual archaeologist: Assembling the past. IEEE Computer Graphics and Applications 21 2 53 59

[24] G. PapaioannouT. SchreckA. AndreadisP. MavridisR. GregorI. SipiranK. Vardis 2017 From Reassembly to Object Completion: A Complete Systems Pipeline Journal on Computing and Cultural Heritage 10 2 8

[25] H. PatelM. PettittJ. R. Wilson 2012 Factors of Collaborative Working: A Framework for a Collaboration Model Applied Ergonomics 43 1 1 26

[26] VCTR The Virtual Cuneiform Tablet Recon struction Project http://virtualcuneiform.org retrieved 01 01 17

[27] P. VinkE. A. KoningsveldJ. F. Molenbroek 2006 Positive Outcomes of Participatory Ergonomics in Terms of Greater Comfort and Higher Productivity Applied Ergonomics 37 4 537 546

[28] P. VinkA. S. ImadaK. J. Zink 2008 Defining Stakeholder Involvement in Participatory Design Processes Applied Ergonomics 39 4 519 526

[29] A. R. WillisB. D. Cooper 2008 Computational Reconstruction of Ancient Artifacts IEEE Signal Processing Magazine 25 4 65 83

[30] R. WolffD. J. RobertsA. SteedO. Otto 2007 A Review of Telecollaboration Technologies with Respect to Closely Coupled Collaboration International Journal of Computer Applications in Technology 29 1 11 26

[31] S. I. WoolleyT. R. DavisN. J. FlowersJ. Pinilla-DutoitA. LivingstoneT. N. Arvanitis 2002 Communicating Cuneiform: The Evolution of a Multimedia Cuneiform Database Journal of Visible Language 36 3 308 324

[32] S. I. WoolleyN. J. FlowersT. N. ArvanitisA. LivingstoneT. R. DavisJ. Ellison 2001 3D Capture, Representation and Manipulation of Cuneiform Tablets. Proc. SPIE - ThreeDimensional Image Capture and Applications IV San Jose 103 110