Evaluating interactive systems from an emotional perspective
In this paper, we introduce a model that aims to provide guidelines that will strengthen the evaluation of interactive systems by assisting in the identification and analysis of emotions evoked by users during system usage. We briefly discuss related projects that have included emotions in the evalu...
- Autores:
-
Méndez Alegria, Yenny Alexanra
Collazos Ordóñez, Cesar Alberto
Granollers Saltiveri, Antoni
Huitr, Alfredo Sanchez
- Tipo de recurso:
- Article of journal
- Fecha de publicación:
- 2014
- Institución:
- Universidad de San Buenaventura
- Repositorio:
- Repositorio USB
- Idioma:
- spa
- OAI Identifier:
- oai:bibliotecadigital.usb.edu.co:10819/25878
- Acceso en línea:
- https://hdl.handle.net/10819/25878
https://doi.org/10.21500/22563202.42
- Palabra clave:
- Emotions
evaluation
user experience
usability
- Rights
- openAccess
- License
- http://purl.org/coar/access_right/c_abf2
| id |
SANBUENAV2_ec392fc2f32b98a13ad6abc3412d5805 |
|---|---|
| oai_identifier_str |
oai:bibliotecadigital.usb.edu.co:10819/25878 |
| network_acronym_str |
SANBUENAV2 |
| network_name_str |
Repositorio USB |
| repository_id_str |
|
| dc.title.spa.fl_str_mv |
Evaluating interactive systems from an emotional perspective |
| dc.title.translated.spa.fl_str_mv |
Evaluating interactive systems from an emotional perspective |
| title |
Evaluating interactive systems from an emotional perspective |
| spellingShingle |
Evaluating interactive systems from an emotional perspective Emotions evaluation user experience usability |
| title_short |
Evaluating interactive systems from an emotional perspective |
| title_full |
Evaluating interactive systems from an emotional perspective |
| title_fullStr |
Evaluating interactive systems from an emotional perspective |
| title_full_unstemmed |
Evaluating interactive systems from an emotional perspective |
| title_sort |
Evaluating interactive systems from an emotional perspective |
| dc.creator.fl_str_mv |
Méndez Alegria, Yenny Alexanra Collazos Ordóñez, Cesar Alberto Granollers Saltiveri, Antoni Huitr, Alfredo Sanchez |
| dc.contributor.author.eng.fl_str_mv |
Méndez Alegria, Yenny Alexanra Collazos Ordóñez, Cesar Alberto Granollers Saltiveri, Antoni Huitr, Alfredo Sanchez |
| dc.subject.spa.fl_str_mv |
Emotions evaluation user experience usability |
| topic |
Emotions evaluation user experience usability |
| description |
In this paper, we introduce a model that aims to provide guidelines that will strengthen the evaluation of interactive systems by assisting in the identification and analysis of emotions evoked by users during system usage. We briefly discuss related projects that have included emotions in the evaluation of interactive systems. The research presented here is a preliminary work towards the inclusion of emotions during the evaluation of interactive systems. Our model is presented including details of each of its phases. We discussed preliminary results of the application of the model to evaluating a Virtual Learning Environment. Our approach comprises four major phases: Selection of relevant emotions; analysis of relationships between emotions and interactive systems; selection of detection mechanisms; and application of evaluation methods. |
| publishDate |
2014 |
| dc.date.accessioned.none.fl_str_mv |
2014-06-01T00:00:00Z 2025-07-31T17:10:50Z |
| dc.date.available.none.fl_str_mv |
2014-06-01T00:00:00Z 2025-07-31T17:10:50Z |
| dc.date.issued.none.fl_str_mv |
2014-06-01 |
| dc.type.spa.fl_str_mv |
Artículo de revista |
| dc.type.coar.spa.fl_str_mv |
http://purl.org/coar/resource_type/c_6501 http://purl.org/coar/resource_type/c_2df8fbb1 |
| dc.type.coarversion.spa.fl_str_mv |
http://purl.org/coar/version/c_970fb48d4fbd8a85 |
| dc.type.content.spa.fl_str_mv |
Text |
| dc.type.driver.spa.fl_str_mv |
info:eu-repo/semantics/article |
| dc.type.local.eng.fl_str_mv |
Journal article |
| dc.type.redcol.spa.fl_str_mv |
http://purl.org/redcol/resource_type/ART |
| dc.type.version.spa.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
| format |
http://purl.org/coar/resource_type/c_6501 |
| status_str |
publishedVersion |
| dc.identifier.doi.none.fl_str_mv |
10.21500/22563202.42 |
| dc.identifier.eissn.none.fl_str_mv |
2256-3202 |
| dc.identifier.uri.none.fl_str_mv |
https://hdl.handle.net/10819/25878 |
| dc.identifier.url.none.fl_str_mv |
https://doi.org/10.21500/22563202.42 |
| identifier_str_mv |
10.21500/22563202.42 2256-3202 |
| url |
https://hdl.handle.net/10819/25878 https://doi.org/10.21500/22563202.42 |
| dc.language.iso.spa.fl_str_mv |
spa |
| language |
spa |
| dc.relation.bitstream.none.fl_str_mv |
https://revistas.usb.edu.co/index.php/GuillermoOckham/article/download/42/7 |
| dc.relation.citationendpage.none.fl_str_mv |
50 |
| dc.relation.citationissue.eng.fl_str_mv |
1 |
| dc.relation.citationstartpage.none.fl_str_mv |
43 |
| dc.relation.citationvolume.eng.fl_str_mv |
12 |
| dc.relation.ispartofjournal.eng.fl_str_mv |
Revista Guillermo de Ockham |
| dc.relation.references.spa.fl_str_mv |
Agarwal, A., & Meyer, A. (2009). Beyond usability: evaluating emotional response as an integral part of the user experience. In CHI 09 Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (pp. 2919–2930). ACM. doi:10.1145/1520340.1520420 Bak, J., Nguyen, K., Risgaard, P., & Stage, J. (2008). Obstacles to usability evaluation in practice: A survey of software development organizations. Proceedings of the 5th Nordic Conference on Human-Computer Interaction: Building Bridges. Retrieved from http://doi.acm.org/10.1145/1463160.1463164 Branco, P., Firth, P., Encarnação, L. M., & Bonato, P. (2005). Faces of emotion in human-computer interaction. Work, 1236–1239. doi:10.1145/1056808.1056885 Brave, S., & Nass, C. (2008). Emotion in Human-Computer Interaction. In A. Sears & J. A. Jacko (Eds.), The Human-Computer Interaction Handbook. Fundamentals, Evolving Technologies and Emerging Applications. (Second., Vol. 29, p. 1386). Standford University: Lawrence Erlbaum Associates. Retrieved from http://courses.washington.edu/imt540a/readings/Blomberg-08.pdf Champney, R. K., & Stanney, K. M. (2007). Using Emotions in Usability. Proceedings of the Human Factors and Ergonomics Society, 2, 1044–1049. Retrieved from http://www.ingentaconnect.com/content/hfes/hfproc/2007/00000051/00000017/art00012 Cortés-Silva, X. (2013). Vikara: Plataforma de desarrollo y gestión de aplicaciones para detección de emociones. Department of computing, electronics and mechatronics. Tesis no publicada. Universidad de las Américas Puebla. Cowan, B. R., Vigentini, L., & Jack, M. A. (2009). Exploring the effects of experience on wiki anxiety and wiki usability: an online study. Proceedings of the 23rd British HCI Group Annual Conference on People and Computers Celebrating People and Technology, 175–183. Retrieved from http://portal.acm.org/citation.cfm?id=1671032 D’mello, S., & Calvo, R. A. (2013). Beyond the Basic Emotions: What Should Affective Computing Compute? In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (pp. 2287–2294). New York, NY, USA: ACM. doi:10.1145/2468356.2468751 Damasio, A. R. (2003). Looking for Spinoza: Joy, Sorrow, and the Feeling Brain. Orlando Harcourt (Vol. 1st, p. 355). Harcourt. Retrieved from http://www.loc.gov/catdir/description/har021/2002011347.html Desmet, P. (2004). Measuring emotion: development and application of an instrument to measure emotional responses to products. In M. A. Blythe, K. Overbeeke, A. F. Monk, & P. C. Wright (Eds.), Funology (Vol. 41, pp. 111–123). Kluwer Academic Publishers. doi:10.1007/1-4020-2967-5 Desmet, P., Overbeeke, K., & Tax, S. (2001). Designing Products with Added Emotional Value: Development and Appllcation of an Approach for Research Through Design. The Design Journal, 4(1), 32–47. doi:10.2752/146069201789378496 Frøkjær, E., & Hornbæk, K. (2008). Metaphors of human thinking for usability inspection and design. ACM Transactions on Computer-Human Interaction, 14(4), 1–33. doi:10.1145/1314683.1314688 Lera, E. De, & Garreta-Domingo, M. (2007). Ten Emotion Heuristics : Guidelines for assessing the user ’ s affective dimension easily and cost-effectively. Group, 2(September), 7–10. Retrieved from http://portal.acm.org/citation.cfm?id=1531450 Méndez, Y. A., Collazos, C. A., Granollers, T., & Sánchez, J. A. (2013). Emo+Eval: Including Emotions in the Process of Evaluating Interactive Systems. In Proceedings of the 2013 Chilean Conference on Human - Computer Interaction (pp. 48–49). New York, NY, USA: ACM. doi:10.1145/2535597.2535612 Norman, D. A. (2004). Emotional Design: Why We Love (or Hate) Everyday Things. The Journal of American Culture (Vol. 2006, p. 272). Basic Books. doi:10.1111/j.1537-4726.2004.133_10.x Peter, C., Beale, R., Crane, E., & Axelrod, L. (2007). Emotion in HCI. In Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 2 (pp. 211–212). Swinton, UK, UK: British Computer Society. Retrieved from http://dl.acm.org/citation.cfm?id=1531407.1531471 Petrie, H. (2010). Measuring User Experience of websites : Think aloud protocols and an emotion word prompt list. Methods, 3673–3678. doi:10.1145/1753846.1754037 Petrie, H., & Harrison, C. (2009). Measuring users' emotional reactions to websites. Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (pp. 3847-3852). Boston, MA, USA: ACM. doi: http://doi.acm.org/10.1145/1520340.1520582 Picard, R. (2000). Affective Perception. Communications of the ACM,, 43, 50–51. Retrieved from http://affect.media.mit.edu/pdfs/00.picard-cacm.pdf Picard, R., & Daily, S. (2005). Evaluating affective interactions: Alternatives to asking what users feel. CHI Workshop on Evaluating Affective …. Retrieved from http://mit.sustech.edu/NR/rdonlyres/Media-Arts-and-Sciences/MAS-630Spring-2008/Readings/picard_chi2005.pdf Reeve, J. (1996). Motivacion y Emoción (McGraw-Hil.). University of Rochester, River Campus. Reeve, J. (2010). Motivacion y Emoción (5ª Edi.). México: McGraw Hill. Saroha, K., Sharma, S., & Bhatia, G. (2011). Human Computer Interaction: An intellectual approach. IJCSMS International Journal of Computer Science and Management Studies, 11(02), 147–154. Retrieved from http://www.ijcsms.com/journals/Volume 11, Issue 02, Aug 2011_Paper25.pdf Thompson, E. R. (2007). Development and Validation of an Internationally Reliable Short-Form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 38(2), 227–242. doi:10.1177/0022022106297301 Tsai, T. C., Chen, J. J., & Lo, W. C. (2009). Design and Implementation of Mobile Personal Emotion Monitoring System. In Proceedings of the 2009 Tenth International Conference on Mobile Data Management: Systems, Services and Middleware (pp. 430–435). Washington, DC, USA: IEEE Computer Society. doi:10.1109/MDM.2009.78 Watson, D., Clark, L. A., & Tellegen, A. (1988). Development of brief measures of positive and negative affect: The PANAS scale. The PANAS Scales Journal of Personality and Social Psychology, 47, 1063–1070. Zaman, B., & Shrimpton-Smith, T. (2006). The FaceReader: Measuring instant fun of use. In A. Mørch, K. Morgan, T. Bratteteig, G. Ghosh, & D. Svanaes (Eds.), NordiCHI (Vol. 189, pp. 457–460). ACM Press. doi:10.1145/1182475.1182536 |
| dc.rights.accessrights.spa.fl_str_mv |
info:eu-repo/semantics/openAccess |
| dc.rights.coar.spa.fl_str_mv |
http://purl.org/coar/access_right/c_abf2 |
| dc.rights.uri.spa.fl_str_mv |
https://creativecommons.org/licenses/by-nc-sa/4.0/ |
| eu_rights_str_mv |
openAccess |
| rights_invalid_str_mv |
http://purl.org/coar/access_right/c_abf2 https://creativecommons.org/licenses/by-nc-sa/4.0/ |
| dc.format.mimetype.spa.fl_str_mv |
application/pdf |
| dc.publisher.eng.fl_str_mv |
Universidad de San Buenaventura Cali |
| dc.source.spa.fl_str_mv |
https://revistas.usb.edu.co/index.php/GuillermoOckham/article/view/42 |
| institution |
Universidad de San Buenaventura |
| bitstream.url.fl_str_mv |
https://bibliotecadigital.usb.edu.co/bitstreams/3b52103c-34b1-488f-bfcc-80693f0e878a/download |
| bitstream.checksum.fl_str_mv |
fc244012c0675e42281b2f4fb63eaed1 |
| bitstream.checksumAlgorithm.fl_str_mv |
MD5 |
| repository.name.fl_str_mv |
Repositorio Institucional Universidad de San Buenaventura Colombia |
| repository.mail.fl_str_mv |
bdigital@metabiblioteca.com |
| _version_ |
1851053683055263744 |
| spelling |
Méndez Alegria, Yenny AlexanraCollazos Ordóñez, Cesar AlbertoGranollers Saltiveri, AntoniHuitr, Alfredo Sanchez2014-06-01T00:00:00Z2025-07-31T17:10:50Z2014-06-01T00:00:00Z2025-07-31T17:10:50Z2014-06-01In this paper, we introduce a model that aims to provide guidelines that will strengthen the evaluation of interactive systems by assisting in the identification and analysis of emotions evoked by users during system usage. We briefly discuss related projects that have included emotions in the evaluation of interactive systems. The research presented here is a preliminary work towards the inclusion of emotions during the evaluation of interactive systems. Our model is presented including details of each of its phases. We discussed preliminary results of the application of the model to evaluating a Virtual Learning Environment. Our approach comprises four major phases: Selection of relevant emotions; analysis of relationships between emotions and interactive systems; selection of detection mechanisms; and application of evaluation methods.application/pdf10.21500/22563202.422256-3202https://hdl.handle.net/10819/25878https://doi.org/10.21500/22563202.42spaUniversidad de San Buenaventura Calihttps://revistas.usb.edu.co/index.php/GuillermoOckham/article/download/42/75014312Revista Guillermo de OckhamAgarwal, A., & Meyer, A. (2009). Beyond usability: evaluating emotional response as an integral part of the user experience. In CHI 09 Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (pp. 2919–2930). ACM. doi:10.1145/1520340.1520420 Bak, J., Nguyen, K., Risgaard, P., & Stage, J. (2008). Obstacles to usability evaluation in practice: A survey of software development organizations. Proceedings of the 5th Nordic Conference on Human-Computer Interaction: Building Bridges. Retrieved from http://doi.acm.org/10.1145/1463160.1463164 Branco, P., Firth, P., Encarnação, L. M., & Bonato, P. (2005). Faces of emotion in human-computer interaction. Work, 1236–1239. doi:10.1145/1056808.1056885 Brave, S., & Nass, C. (2008). Emotion in Human-Computer Interaction. In A. Sears & J. A. Jacko (Eds.), The Human-Computer Interaction Handbook. Fundamentals, Evolving Technologies and Emerging Applications. (Second., Vol. 29, p. 1386). Standford University: Lawrence Erlbaum Associates. Retrieved from http://courses.washington.edu/imt540a/readings/Blomberg-08.pdf Champney, R. K., & Stanney, K. M. (2007). Using Emotions in Usability. Proceedings of the Human Factors and Ergonomics Society, 2, 1044–1049. Retrieved from http://www.ingentaconnect.com/content/hfes/hfproc/2007/00000051/00000017/art00012 Cortés-Silva, X. (2013). Vikara: Plataforma de desarrollo y gestión de aplicaciones para detección de emociones. Department of computing, electronics and mechatronics. Tesis no publicada. Universidad de las Américas Puebla. Cowan, B. R., Vigentini, L., & Jack, M. A. (2009). Exploring the effects of experience on wiki anxiety and wiki usability: an online study. Proceedings of the 23rd British HCI Group Annual Conference on People and Computers Celebrating People and Technology, 175–183. Retrieved from http://portal.acm.org/citation.cfm?id=1671032 D’mello, S., & Calvo, R. A. (2013). Beyond the Basic Emotions: What Should Affective Computing Compute? In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (pp. 2287–2294). New York, NY, USA: ACM. doi:10.1145/2468356.2468751 Damasio, A. R. (2003). Looking for Spinoza: Joy, Sorrow, and the Feeling Brain. Orlando Harcourt (Vol. 1st, p. 355). Harcourt. Retrieved from http://www.loc.gov/catdir/description/har021/2002011347.html Desmet, P. (2004). Measuring emotion: development and application of an instrument to measure emotional responses to products. In M. A. Blythe, K. Overbeeke, A. F. Monk, & P. C. Wright (Eds.), Funology (Vol. 41, pp. 111–123). Kluwer Academic Publishers. doi:10.1007/1-4020-2967-5 Desmet, P., Overbeeke, K., & Tax, S. (2001). Designing Products with Added Emotional Value: Development and Appllcation of an Approach for Research Through Design. The Design Journal, 4(1), 32–47. doi:10.2752/146069201789378496 Frøkjær, E., & Hornbæk, K. (2008). Metaphors of human thinking for usability inspection and design. ACM Transactions on Computer-Human Interaction, 14(4), 1–33. doi:10.1145/1314683.1314688 Lera, E. De, & Garreta-Domingo, M. (2007). Ten Emotion Heuristics : Guidelines for assessing the user ’ s affective dimension easily and cost-effectively. Group, 2(September), 7–10. Retrieved from http://portal.acm.org/citation.cfm?id=1531450 Méndez, Y. A., Collazos, C. A., Granollers, T., & Sánchez, J. A. (2013). Emo+Eval: Including Emotions in the Process of Evaluating Interactive Systems. In Proceedings of the 2013 Chilean Conference on Human - Computer Interaction (pp. 48–49). New York, NY, USA: ACM. doi:10.1145/2535597.2535612 Norman, D. A. (2004). Emotional Design: Why We Love (or Hate) Everyday Things. The Journal of American Culture (Vol. 2006, p. 272). Basic Books. doi:10.1111/j.1537-4726.2004.133_10.x Peter, C., Beale, R., Crane, E., & Axelrod, L. (2007). Emotion in HCI. In Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 2 (pp. 211–212). Swinton, UK, UK: British Computer Society. Retrieved from http://dl.acm.org/citation.cfm?id=1531407.1531471 Petrie, H. (2010). Measuring User Experience of websites : Think aloud protocols and an emotion word prompt list. Methods, 3673–3678. doi:10.1145/1753846.1754037 Petrie, H., & Harrison, C. (2009). Measuring users' emotional reactions to websites. Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (pp. 3847-3852). Boston, MA, USA: ACM. doi: http://doi.acm.org/10.1145/1520340.1520582 Picard, R. (2000). Affective Perception. Communications of the ACM,, 43, 50–51. Retrieved from http://affect.media.mit.edu/pdfs/00.picard-cacm.pdf Picard, R., & Daily, S. (2005). Evaluating affective interactions: Alternatives to asking what users feel. CHI Workshop on Evaluating Affective …. Retrieved from http://mit.sustech.edu/NR/rdonlyres/Media-Arts-and-Sciences/MAS-630Spring-2008/Readings/picard_chi2005.pdf Reeve, J. (1996). Motivacion y Emoción (McGraw-Hil.). University of Rochester, River Campus. Reeve, J. (2010). Motivacion y Emoción (5ª Edi.). México: McGraw Hill. Saroha, K., Sharma, S., & Bhatia, G. (2011). Human Computer Interaction: An intellectual approach. IJCSMS International Journal of Computer Science and Management Studies, 11(02), 147–154. Retrieved from http://www.ijcsms.com/journals/Volume 11, Issue 02, Aug 2011_Paper25.pdf Thompson, E. R. (2007). Development and Validation of an Internationally Reliable Short-Form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 38(2), 227–242. doi:10.1177/0022022106297301 Tsai, T. C., Chen, J. J., & Lo, W. C. (2009). Design and Implementation of Mobile Personal Emotion Monitoring System. In Proceedings of the 2009 Tenth International Conference on Mobile Data Management: Systems, Services and Middleware (pp. 430–435). Washington, DC, USA: IEEE Computer Society. doi:10.1109/MDM.2009.78 Watson, D., Clark, L. A., & Tellegen, A. (1988). Development of brief measures of positive and negative affect: The PANAS scale. The PANAS Scales Journal of Personality and Social Psychology, 47, 1063–1070. Zaman, B., & Shrimpton-Smith, T. (2006). The FaceReader: Measuring instant fun of use. In A. Mørch, K. Morgan, T. Bratteteig, G. Ghosh, & D. Svanaes (Eds.), NordiCHI (Vol. 189, pp. 457–460). ACM Press. doi:10.1145/1182475.1182536info:eu-repo/semantics/openAccesshttp://purl.org/coar/access_right/c_abf2https://creativecommons.org/licenses/by-nc-sa/4.0/https://revistas.usb.edu.co/index.php/GuillermoOckham/article/view/42Emotionsevaluationuser experienceusabilityEvaluating interactive systems from an emotional perspectiveEvaluating interactive systems from an emotional perspectiveArtículo de revistahttp://purl.org/coar/resource_type/c_6501http://purl.org/coar/resource_type/c_2df8fbb1http://purl.org/coar/version/c_970fb48d4fbd8a85Textinfo:eu-repo/semantics/articleJournal articlehttp://purl.org/redcol/resource_type/ARTinfo:eu-repo/semantics/publishedVersionPublicationOREORE.xmltext/xml2683https://bibliotecadigital.usb.edu.co/bitstreams/3b52103c-34b1-488f-bfcc-80693f0e878a/downloadfc244012c0675e42281b2f4fb63eaed1MD5110819/25878oai:bibliotecadigital.usb.edu.co:10819/258782025-07-31 12:10:50.388https://creativecommons.org/licenses/by-nc-sa/4.0/https://bibliotecadigital.usb.edu.coRepositorio Institucional Universidad de San Buenaventura Colombiabdigital@metabiblioteca.com |