Self-Tracking Emotional States through Social Media Mobile Photography

This paper presents a preliminary breakdown of the results obtained in an exploratory study conducted through the mobile application Instagram. Our goal was to inspect the potential benefits of combining the self-reporting of emotions with everyday mobile photographic practices to learn more about users’ experiences. To do so, we instructed 25 participants to assess and report their emotional states using Instagram, during a 4-week period, according to a pre-established set of instructions. Participants also filled in pre and post-study questionnaires. We then analysed the 291 submissions obtained and the results from the questionnaires, focusing on three aspects: the categories of the photographs taken, the emotion labels used, and the feedback provided by the participants. We end by presenting and discussing a set of insights that might be useful in the design of mobile apps to improve emotional self-awareness and wellbeing.

Content

Author and article information

Contributors

Carla Nave

Teresa Romão

Nuno Correia

Conference

Publication date: July 2018

Publication date (Print): July 2018

Pages: 1-6

Affiliations

[0001]NOVA Lincs, Faculdade de Ciências e Tecnologia, Universidade Nova de Lisboa, 2829-516 Caparica, Portugal

Article

DOI: 10.14236/ewic/HCI2018.146

SO-VID: 68811291-66b0-45ef-9d20-e21bcc40a96b

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Proceedings of the 32nd International BCS Human Computer Interaction Conference

Conference acronym: HCI

Conference number: 32

Conference location: Belfast, UK

Conference date: 4 - 6 July 2018

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Human Computer Interaction Conference

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2018.146

Self URI (journal page): https://ewic.bcs.org/

References

Nazanin AndalibiPinar OzturkAndrea Forte 2015 Depression-related Imagery on Instagram Proceedings of the 18th ACM Conference Companion on Computer Supported Cooperative Work & Social Computing - CSCW’15 Companion 2015–Janua January 231 234 http://doi.org/10.1145/2685553.2699014
Nazanin AndalibiPinar OzturkAndrea Forte 2017 Sensitive Self-disclosures, Responses, and Social Support on Instagram Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW ’17 January 1485 1500 http://doi.org/10.1145/2998181.2998243
Virginia BraunVictoria Clarke 2006 Using thematic analysis in psychology Qualitative Research in Psychology 3 2 77 101 http://doi.org/10.1191/1478088706qp063oa
Mina ChoiCatalina L Toma 2014 Social sharing through interpersonal media: Patterns and effects on emotional well-being Computers in Human Behavior 36 530 541 http://doi.org/10.1016/j.chb.2014.04.026
Munmun De ChoudhuryMichael Gamon 2013 Predicting Depression via Social Media Proceedings of the Seventh International AAAI Conference on Weblogs and Social Media 2 128 137 http://doi.org/10.1109/IRI.2012.6302998
Alan Fogel 2013 Body Sense: The Science and Practice of Embodied Self-Awareness (Norton Series on Interpersonal Neurobiology) eBook: Alan Fogel: Kindle Store Norton W. W. & Company
Carolina FuentesValeria HerskovicIyubanit RodríguezCarmen GereaMaira MarquesPedro Rossel 2016 A Systematic Literature Review about Technologies for self-reporting emotional information Submitted (under review) http://doi.org/10.1007/s12652-016-0430-z
Venkata Rama Kiran GarimellaAbdulrahman AlfayadIngmar Weber 2016 Social Media Image Analysis for Public Health Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI ’16 1 5543 5547 http://doi.org/10.1145/2858036.2858234
Adam W A GeraghtyLeandro D TorresYan LeykinEliseo J Pérez-StableRicardo F Muñoz 2013 Understanding attrition from international Internet health interventions: a step towards global eHealth Health promotion international 28 3 442 52 http://doi.org/10.1093/heapro/das029
Y. HuL. ManikondaS. Kambhampati 2014 What we Instagram?: a first analysis of Instagram photo content and user types Proceedings of the Eight International AAAI Conference on Weblogs and Social Media 595 598
Ellen IsaacsArtie KonradAlan WalendowskiThomas LennigVictoria HollisSteve Whittaker 2013 Echoes From the Past?: How Technology Mediated Reflection Improves Well-Being Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2013) 1071 1080 http://doi.org/10.1145/2470654.2466137
Eiman KanjoAlan Chamberlain 2015 Emotions in context: examining pervasive affective sensing systems, applications, and analyses Personal and Ubiquitous Computing http://doi.org/10.1007/s00779-015-0842-3
Ian LiAnind DeyJodi Forlizzi 2010 A stage-based model of personal informatics systems Proceedings of the 28th international conference on Human factors in computing systems CHI 10 557 http://doi.org/10.1145/1753326.1753409
Lydia ManikondaMunmun De Choudhury 2017 Modeling and Understanding Visual Attributes of Mental Health Disclosures in Social Media In CHI 2017 http://doi.org/10.1145/3025453.3025932
Morris E. MargaretQusai KathawalaK. Todd Leen 2010 Mobile therapy: Case study evaluations of a cell phone application for emotional self-awareness Journal of Medical Internet Research 12 2 1 21 http://doi.org/10.2196/jmir.1371
Matthew PittmanBrandon Reich 2016 Social media and loneliness: Why an Instagram picture may be worth more than a thousand Twitter words Computers in Human Behavior 62 155 167 http://doi.org/10.1016/j.chb.2016.03.084
Robert Plutchik 2001 The nature of emotions: Human emotions have deep evolutionary roots American Scientist 89 4 344 350 http://doi.org/10.1511/2001.4.344
Jp PollakPhil AdamsGeri Gay 2011 PAM: a photographic affect meter for frequent, in situ measurement of affect Proceedings of the SIGCHI Conference on … 725 734 http://doi.org/10.1145/1978942.1979047
Kiran K RachuriCecilia MascoloPeter J RentfrowChris Longworth 2010 EmotionSense?: A Mobile Phones based Adaptive Platform for Experimental Social Psychology Research International Studies 10 281 290 http://doi.org/10.1145/1864349.1864393
J. A. RussellJames Russel 1980 A Circumplex Model of Affect Journal of Personality and Social Psychology 39 6 1161 1178 http://doi.org/10.1037/h0077714
James A RussellLisa Barrett Feldman 1999 Core Affect , Prototypical Emotional Episodes , and Other Things Called Emotion?: Dissecting the Elephant Journal of Personality and Social Psychology 76 5 805 819 http://doi.org/10.1037/0022-3514.76.5.805
Anna StåhlKristina HöökMartin SvenssonAlex Taylor S.Marco Combetto 2009 Experiencing the affective diary Personal and Ubiquitous Computing 13 5 365 378 http://doi.org/10.1007/s00779-008-0202-7
Melanie Swan 2012 Sensor Mania! The Internet of Things, Wearable Computing, Objective Metrics, and the Quantified Self 2.0 Journal of Sensor and Actuator Networks 1 3 217 253 http://doi.org/10.3390/jsan1030217
Mike ThelwallKevan BuckleyGeorgios Paltoglou 2012 Sentiment Strength Detection for the Social Web 1 63 163 173
Janet L Uhlir 2016 Social Comparison and Self-Presentation on Social Media as Predictors of Depressive Symptoms by Submitted to Scripps College in partial fulfillment of the degree of Bachelor of Arts

Comments

Comment on this article

[1] Nazanin AndalibiPinar OzturkAndrea Forte 2015 Depression-related Imagery on Instagram Proceedings of the 18th ACM Conference Companion on Computer Supported Cooperative Work & Social Computing - CSCW’15 Companion 2015–Janua January 231 234 http://doi.org/10.1145/2685553.2699014

[2] Nazanin AndalibiPinar OzturkAndrea Forte 2017 Sensitive Self-disclosures, Responses, and Social Support on Instagram Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW ’17 January 1485 1500 http://doi.org/10.1145/2998181.2998243

[3] Virginia BraunVictoria Clarke 2006 Using thematic analysis in psychology Qualitative Research in Psychology 3 2 77 101 http://doi.org/10.1191/1478088706qp063oa

[4] Mina ChoiCatalina L Toma 2014 Social sharing through interpersonal media: Patterns and effects on emotional well-being Computers in Human Behavior 36 530 541 http://doi.org/10.1016/j.chb.2014.04.026

[5] Munmun De ChoudhuryMichael Gamon 2013 Predicting Depression via Social Media Proceedings of the Seventh International AAAI Conference on Weblogs and Social Media 2 128 137 http://doi.org/10.1109/IRI.2012.6302998

[6] Alan Fogel 2013 Body Sense: The Science and Practice of Embodied Self-Awareness (Norton Series on Interpersonal Neurobiology) eBook: Alan Fogel: Kindle Store Norton W. W. & Company

[7] Carolina FuentesValeria HerskovicIyubanit RodríguezCarmen GereaMaira MarquesPedro Rossel 2016 A Systematic Literature Review about Technologies for self-reporting emotional information Submitted (under review) http://doi.org/10.1007/s12652-016-0430-z

[8] Venkata Rama Kiran GarimellaAbdulrahman AlfayadIngmar Weber 2016 Social Media Image Analysis for Public Health Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI ’16 1 5543 5547 http://doi.org/10.1145/2858036.2858234

[9] Adam W A GeraghtyLeandro D TorresYan LeykinEliseo J Pérez-StableRicardo F Muñoz 2013 Understanding attrition from international Internet health interventions: a step towards global eHealth Health promotion international 28 3 442 52 http://doi.org/10.1093/heapro/das029

[10] Y. HuL. ManikondaS. Kambhampati 2014 What we Instagram?: a first analysis of Instagram photo content and user types Proceedings of the Eight International AAAI Conference on Weblogs and Social Media 595 598

[11] Ellen IsaacsArtie KonradAlan WalendowskiThomas LennigVictoria HollisSteve Whittaker 2013 Echoes From the Past?: How Technology Mediated Reflection Improves Well-Being Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2013) 1071 1080 http://doi.org/10.1145/2470654.2466137

[12] Eiman KanjoAlan Chamberlain 2015 Emotions in context: examining pervasive affective sensing systems, applications, and analyses Personal and Ubiquitous Computing http://doi.org/10.1007/s00779-015-0842-3

[13] Ian LiAnind DeyJodi Forlizzi 2010 A stage-based model of personal informatics systems Proceedings of the 28th international conference on Human factors in computing systems CHI 10 557 http://doi.org/10.1145/1753326.1753409

[14] Lydia ManikondaMunmun De Choudhury 2017 Modeling and Understanding Visual Attributes of Mental Health Disclosures in Social Media In CHI 2017 http://doi.org/10.1145/3025453.3025932

[15] Morris E. MargaretQusai KathawalaK. Todd Leen 2010 Mobile therapy: Case study evaluations of a cell phone application for emotional self-awareness Journal of Medical Internet Research 12 2 1 21 http://doi.org/10.2196/jmir.1371

[16] Matthew PittmanBrandon Reich 2016 Social media and loneliness: Why an Instagram picture may be worth more than a thousand Twitter words Computers in Human Behavior 62 155 167 http://doi.org/10.1016/j.chb.2016.03.084

[17] Robert Plutchik 2001 The nature of emotions: Human emotions have deep evolutionary roots American Scientist 89 4 344 350 http://doi.org/10.1511/2001.4.344

[18] Jp PollakPhil AdamsGeri Gay 2011 PAM: a photographic affect meter for frequent, in situ measurement of affect Proceedings of the SIGCHI Conference on … 725 734 http://doi.org/10.1145/1978942.1979047

[19] Kiran K RachuriCecilia MascoloPeter J RentfrowChris Longworth 2010 EmotionSense?: A Mobile Phones based Adaptive Platform for Experimental Social Psychology Research International Studies 10 281 290 http://doi.org/10.1145/1864349.1864393

[20] J. A. RussellJames Russel 1980 A Circumplex Model of Affect Journal of Personality and Social Psychology 39 6 1161 1178 http://doi.org/10.1037/h0077714

[21] James A RussellLisa Barrett Feldman 1999 Core Affect , Prototypical Emotional Episodes , and Other Things Called Emotion?: Dissecting the Elephant Journal of Personality and Social Psychology 76 5 805 819 http://doi.org/10.1037/0022-3514.76.5.805

[22] Anna StåhlKristina HöökMartin SvenssonAlex Taylor S.Marco Combetto 2009 Experiencing the affective diary Personal and Ubiquitous Computing 13 5 365 378 http://doi.org/10.1007/s00779-008-0202-7

[23] Melanie Swan 2012 Sensor Mania! The Internet of Things, Wearable Computing, Objective Metrics, and the Quantified Self 2.0 Journal of Sensor and Actuator Networks 1 3 217 253 http://doi.org/10.3390/jsan1030217

[24] Mike ThelwallKevan BuckleyGeorgios Paltoglou 2012 Sentiment Strength Detection for the Social Web 1 63 163 173

[25] Janet L Uhlir 2016 Social Comparison and Self-Presentation on Social Media as Predictors of Depressive Symptoms by Submitted to Scripps College in partial fulfillment of the degree of Bachelor of Arts

Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65