Abstract
In-situ self-reporting is a widely used data collection technique for understanding people's behavior in context. Characteristics of smartphones such as their high proliferation, close proximity to their users, and heavy use have made them a popular choice for applications that require frequent self-reporting. Newer device categories such as wearables and voice assistants offer their own advantages, providing an opportunity to explore a wider range of self-reporting approaches. In this paper, we focus on exploring the design space of Situated Self-Reporting (SSR) devices. We present the Heed system, consisting of simple, low-cost, and low-power SSR devices that are distributed in the environment of the user and can be appropriated for reporting measures such as stress, sleepiness, and activities. In two real-world studies with 10 and 7 users, we compared and analyzed the use of smartphone and Heed devices to uncover differences in their use due to the influence of factors such as situational and social context, notification types, and physical design. Our findings show that Heed devices complemented smartphones in the coverage of activities, locations and interaction preferences. While the advantage of Heed was its single-purpose and dedicated location, smartphones provided mobility and flexibility of use.
- Barbara E. Ainsworth, William L. Haskell, Melicia C. Whitt, Melinda L. Irwin, Ann M. Swartz, Scott J. Strath, William L. O'Brien, David R. Bassett, Kathryn H. Schmitz, Patricia O. Emplaincourt, David R. Jacobs, and Arthur S. Leon. 2000. Compendium of Physical Activities: an update of activity codes and MET intensities: Med. Sci. Sports Exerc. 32, Supplement (September 2000), S498--S516.Google Scholar
- Niels Van Berkel, Denzil Ferreira, and Vassilis Kostakos. 2017. The Experience Sampling Method on Mobile Devices. ACM Comput. Surv. CSUR 50, 6 (2017), 93. Google ScholarDigital Library
- Elliot T. Berkman, Nicole R. Giuliani, and Alicia K. Pruitt. 2014. Comparison of text messaging and paper-and-pencil for ecological momentary assessment of food craving and intake. Appetite 81, (2014), 131--137.Google Scholar
- Chris J. Burgin, Paul J. Silvia, Kari M. Eddington, and Thomas R. Kwapil. 2013. Palm or cell? Comparing personal digital assistants and cell phones for experience sampling research. Soc. Sci. Comput. Rev. 31, 2 (2013), 244--251. Google ScholarDigital Library
- Yung-Ju Chang, Gaurav Paruthi, and Mark W. Newman. 2015. A Field Study Comparing Approaches to Collecting Annotated Activity Data in Real-world Settings. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15), 671--682. Google ScholarDigital Library
- Yung-Ju Chang, Gaurav Paruthi, Hsin-Ying Wu, Hsin-Yu Lin, and Mark W. Newman. 2017. An investigation of using mobile and situated crowdsourcing to collect annotated travel activity data in real-word settings. Int. J. Hum.-Comput. Stud. 102, (2017), 81--102. Google ScholarDigital Library
- Eun Kyoung Choe, Bongshin Lee, Matthew Kay, Wanda Pratt, and Julie A. Kientz. 2015. SleepTight: Low-burden, Self-monitoring Technology for Capturing and Reflecting on Sleep Behaviors. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15), 121--132. Google ScholarDigital Library
- Eun Kyoung Choe, Nicole B. Lee, Bongshin Lee, Wanda Pratt, and Julie A. Kientz. 2014. Understanding quantified-selfers' practices in collecting and exploring personal data. 1143--1152. Google ScholarDigital Library
- Tamlin S. Conner, Howard Tennen, William Fleeson, and Lisa Feldman Barrett. 2009. Experience sampling methods: A modern idiographic approach to personality research. Soc. Personal. Psychol. Compass 3, 3 (2009), 292--313.Google ScholarCross Ref
- John W. Creswell. 2013. Qualitative inquiry and research design: Choosing among five approaches. Sage.Google Scholar
- Mihaly Csikszentmihalyi and Reed Larson. 2014. Validity and reliability of the experience-sampling method. In Flow and the foundations of positive psychology. Springer, 35--54. Retrieved May 14, 2017 from http://link.springer.com/10.1007/978-94-017-9088-8_3Google Scholar
- Anind K. Dey, Katarzyna Wac, Denzil Ferreira, Kevin Tassini, Jin-Hyuk Hong, and Julian Ramos. 2011. Getting Closer: An Empirical Investigation of the Proximity of User to Their Smart Phones. In Proceedings of the 13th International Conference on Ubiquitous Computing (UbiComp '11), 163--172. Google ScholarDigital Library
- Jens Grubert, Matthias Kranz, and Aaron Quigley. 2016. Challenges in Mobile Multi-Device Ecosystems. MUX J. Mob. User Exp. 5, 1 (December 2016).Google ScholarCross Ref
- E. G. Guba and Y. S. Lincoln. 1985. Naturalistic inquiry (Vol. 75). Beverly Hills CA Sage (1985).Google Scholar
- Joel M. Hektner, Jennifer A. Schmidt, and Mihaly Csikszentmihalyi. 2007. Experience sampling method: Measuring the quality of everyday life. Sage.Google Scholar
- Javier Hernandez, Daniel McDuff, Christian Infante, Pattie Maes, Karen Quigley, and Rosalind Picard. 2016. Wearable ESM: Differences in the Experience Sampling Method Across Wearable Devices. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '16), 195--205. Google ScholarDigital Library
- Stephen Intille, Caitlin Haynes, Dharam Maniar, Aditya Ponnada, and Justin Manjourides. 2016. μEMA: Microinteraction-based Ecological Momentary Assessment (EMA) Using a Smartwatch. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16), 1124--1128. Google ScholarDigital Library
- Predrag Klasnja, Beverly L. Harrison, Louis LeGrand, Anthony LaMarca, Jon Froehlich, and Scott E. Hudson. 2008. Using wearable sensors and real time inference to understand human recall of routine activities. In Proceedings of the 10th international conference on Ubiquitous computing (UbiComp '08), 154--163. Google ScholarDigital Library
- Bob Kummerfeld, Lie Ming Tang, Judy Kay, and Farahnaz Yekeh. 2015. SAL: A Small, Simple, Situated, Ambient Logger. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers (UbiComp/ISWC'15 Adjunct), 403--406. Google ScholarDigital Library
- T. Lataster, D. Collip, M. Lardinois, J. Van Os, and I. Myin-Germeys. 2010. Evidence for a familial correlation between increased reactivity to stress and positive psychotic symptoms. Acta Psychiatr. Scand. 122, 5 (November 2010), 395--404.Google ScholarCross Ref
- Neal Lathia, Kiran K. Rachuri, Cecilia Mascolo, and Peter J. Rentfrow. 2013. Contextual Dissonance: Design Bias in Sensor-based Experience Sampling Methods. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '13), 183--192. Google ScholarDigital Library
- Kay A. Lopez and Danny G. Willis. 2004. Descriptive versus interpretive phenomenology: Their contributions to nursing knowledge. Qual. Health Res. 14, 5 (2004), 726--735.Google ScholarCross Ref
- Akhil Mathur, Nicholas D. Lane, and Fahim Kawsar. 2016. Engagement-aware Computing: Modelling User Engagement from Mobile Contexts. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16), 622--633. Google ScholarDigital Library
- Chulhong Min, Seungwoo Kang, Chungkuk Yoo, Jeehoon Cha, Sangwon Choi, Younghan Oh, and Junehwa Song. 2015. Exploring current practices for battery use and management of smartwatches. In Proceedings of the 2015 ACM International Symposium on Wearable Computers, 11--18. Google ScholarDigital Library
- William Odom, James Pierce, Erik Stolterman, and Eli Blevis. 2009. Understanding why we preserve some things and discard others in the context of interaction design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1053--1062. Google ScholarDigital Library
- K. O'Hara, M. Perry, and S. Lewis. 2003. Social coordination around a situated display appliance. Proc. SIGCHI Conf. Hum. Factors Comput. Syst. (2003), 65--72. Google ScholarDigital Library
- Aditya Ponnada, Caitlin Haynes, Dharam Maniar, Justin Manjourides, and Stephen Intille. 2017. Microinteraction Ecological Momentary Assessment Response Rates: Effect of Microinteractions or the Smartwatch? Proc ACM Interact Mob Wearable Ubiquitous Technol 1, 3 (September 2017), 92:1--92:16. Google ScholarDigital Library
- Abigail Sellen, Rachel Eardley, Shahram Izadi, and Richard Harper. 2006. The Whereabouts Clock: Early Testing of a Situated Awareness Device. In CHI '06 Extended Abstracts on Human Factors in Computing Systems (CHI EA '06), 1307--1312. Google ScholarDigital Library
- Abigail Sellen, Richard Harper, Rachel Eardley, Shahram Izadi, Tim Regan, Alex S Taylor, and Ken R Wood. 2006. HomeNote: supporting situated messaging in the home. In CSCW '06: Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work, 1--10. Google ScholarDigital Library
- Saul Shiffman, Arthur A. Stone, and Michael R. Hufford. 2008. Ecological momentary assessment. Annu Rev Clin Psychol 4, (2008), 1--32.Google Scholar
- Ghada Abu Shosha. 2012. Employment of Colaizzi's strategy in descriptive phenomenology: A reflection of a researcher. Eur. Sci. J. ESJ 8, 27 (2012).Google Scholar
- Khai N. Truong, Thariq Shihipar, and Daniel J. Wigdor. 2014. Slide to X: Unlocking the Potential of Smartphone Unlocking. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14), 3635--3644. Google ScholarDigital Library
- M. Weiser and J. Seely Brown. The Coming Age of Calm Technology", Xerox PARC October 5, 1996.Google Scholar
- Wikipedia. 2017. Affinity diagram. Retrieved November 12, 2017 from https://en.wikipedia.org/w/index.php?title=Affinity_diagram8oldid=772829913Google Scholar
- Jessica A. de Wild-Hartmann, Marieke Wichers, Alex L. van Bemmel, Catherine Derom, Evert Thiery, Nele Jacobs, Jim van Os, and Claudia J. P. Simons. 2013. Day-to-day associations between subjective sleep and affect in regard to future depression in a female population-based sample. Br. J. Psychiatry 202, 6 (June 2013), 407--412.Google ScholarCross Ref
- Farahnaz Yekeh, Judy Kay, Bob Kummerfeld, Lie Ming Tang, and Margaret A. Allman-Farinelli. 2015. Can SAL Support Self Reflection for Health and Nutrition? In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction (OzCHI '15), 134--141. Google ScholarDigital Library
- Xiaoyi Zhang, Laura R. Pina, and James Fogarty. 2016. Examining Unlock Journaling with Diaries and Reminders for In Situ Self-Report in Health and Wellness. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 5658--5664. Google ScholarDigital Library
- Yang Zhang, Gierad Laput, and Chris Harrison. 2017. Electrick: Low-Cost Touch Sensing Using Electric Field Tomography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 1--14. Google ScholarDigital Library
- Gartner Survey Shows Wearable Devices Need to Be More Useful. Retrieved November 7, 2017 from https://www.gartner.com/newsroom/id/3537117Google Scholar
- Discover the Countries Leading in App Usage. Retrieved May 13, 2018 from https://www.appannie.com/en/insights/market-data/global-consumer-app-usage-data/Google Scholar
- BLE Nano. RedBear. Retrieved November 13, 2017 from http://redbearlab.com/blenano/Google Scholar
- Apache Cordova. Retrieved November 14, 2017 from https://cordova.apache.org/Google Scholar
Index Terms
- Heed: Exploring the Design of Situated Self-Reporting Devices
Recommendations
ReVibe: A Context-assisted Evening Recall Approach to Improve Self-report Adherence
Besides passive sensing, ecological momentary assessments (EMAs) are one of the primary methods to collect in-the-moment data in ubiquitous computing and mobile health. While EMAs have the advantage of low recall bias, a disadvantage is that they ...
Context-Informed Scheduling and Analysis: Improving Accuracy of Mobile Self-Reports
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsMobile self-reports are a popular technique to collect participant labelled data in the wild. While literature has focused on increasing participant compliance to self-report questionnaires, relatively little work has assessed response accuracy. In this ...
Knock, knock! who's there? Putting the user in control of managing interruptions
The abundance of communication technology, such as the omnipresence of cell phones, has not only increased our ability to reach people anytime anywhere, but also the likelihood of being interrupted. As a result, there is value in understanding how to ...
Comments