skip to main content
10.1145/3472749.3474823acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

MARS: Nano-Power Battery-free Wireless Interfaces for Touch, Swipe and Speech Input

Authors Info & Claims
Published:12 October 2021Publication History

ABSTRACT

Augmenting everyday surfaces with interaction sensing capability that is maintenance-free, low-cost (∼ $1), and in an appropriate form factor is a challenge with current technologies. MARS (Multi-channel Ambiently-powered Realtime Sensing) enables battery-free sensing and wireless communication of touch, swipe, and speech interactions by combining a nanowatt programmable oscillator with frequency-shifted analog backscatter communication. A zero-threshold voltage field-effect transistor (FET) is used to create an oscillator with a low startup voltage (∼ 500 mV) and current (< 2uA), whose frequency can be affected through changes in inductance or capacitance from the user interactions. Multiple MARS systems can operate in the same environment by tuning each oscillator circuit to a different frequency range. The nanowatt power budget allows the system to be powered directly through ambient energy sources like photodiodes or thermoelectric generators. We differentiate MARS from previous systems based on power requirements, cost, and part count and explore different interaction and activity sensing scenarios suitable for indoor environments.

References

  1. Gregory D Abowd. 2020. The Internet of Materials: A Vision for Computational Materials. IEEE Annals of the History of Computing 19, 02 (2020), 56–62.Google ScholarGoogle Scholar
  2. Imtiaz Ahmad, Rosta Farzan, Apu Kapadia, and Adam J Lee. 2020. Tangible privacy: Towards user-centric sensor designs for bystander privacy. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2(2020), 1–28.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Pietro Andreani, Xiaoyan Wang, Luca Vandi, and Ali Fard. 2005. A study of phase noise in Colpitts and LC-tank CMOS oscillators. IEEE Journal of Solid-State Circuits 40, 5 (2005), 1107–1118.Google ScholarGoogle ScholarCross RefCross Ref
  4. Georgia Apostolou, Angèle Reinders, and Martin Verwaal. 2016. Comparison of the indoor performance of 12 commercial PV products by a simple model. Energy science & engineering 4, 1 (2016), 69–85.Google ScholarGoogle Scholar
  5. Nivedita Arora and Gregory D Abowd. 2018. ZEUSSS: Zero energy ubiquitous sound sensing surface leveraging triboelectric nanogenerator and analog backscatter communication. In The 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings. 81–83.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Nivedita Arora, Thad Starner, and Gregory D Abowd. 2020. SATURN: An introduction to the Internet of Materials. Commun. ACM 63, 12 (2020), 92–99.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Nivedita Arora, Steven L Zhang, Fereshteh Shahmiri, Diego Osorio, Yi-Cheng Wang, Mohit Gupta, Zhengjun Wang, Thad Starner, Zhong Lin Wang, and Gregory D Abowd. 2018. SATURN: A thin and flexible self-powered microphone leveraging triboelectric nanogenerator. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (2018), 1–28.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Arrow. 2000. Panasonic Solar cell. https://www.arrow.com/en/products/am-1417ca/panasonicGoogle ScholarGoogle Scholar
  9. Arrow. 2000. Photodiode. https://www.arrow.com/en/products/sfh-2704/osram-opto-semiconductorsGoogle ScholarGoogle Scholar
  10. Yvan Bonnassieux, Christoph J Brabec, Yong Cao, Tricia Breen Carmichael, Michael L Chabinyc, Kwang-Ting Cheng, Gyoujin Cho, Anjung Chung, Corie L Cobb, Andreas Distler, 2021. The 2021 flexible and printed electronics roadmap. Flexible and Printed Electronics 6, 2 (2021), 023001.Google ScholarGoogle ScholarCross RefCross Ref
  11. Graham Brooker and Jairo Gomez. 2013. Lev Termen’s Great Seal bug analyzed. IEEE Aerospace and Electronic Systems Magazine 28, 11 (2013), 4–11.Google ScholarGoogle ScholarCross RefCross Ref
  12. James B Burr and John Shott. 1994. A 200 mV self-testing encoder/decoder using Stanford ultra-low-power CMOS. In Proceedings of IEEE International Solid-State Circuits Conference-ISSCC’94. IEEE, 84–85.Google ScholarGoogle ScholarCross RefCross Ref
  13. Alex Butler, Shahram Izadi, and Steve Hodges. 2008. SideSight: multi-” touch” interaction around small devices. In Proceedings of the 21st annual ACM symposium on User interface software and technology. 201–204.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Scott Davidoff, Min Kyung Lee, Charles Yiu, John Zimmerman, and Anind K Dey. 2006. Principles of smart home control. In International conference on ubiquitous computing. Springer, 19–34.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. R.H. Dennard, F.H. Gaensslen, Hwa-Nien Yu, V.L. Rideout, E. Bassous, and A.R. LeBlanc. 1974. Design of ion-implanted MOSFET’s with very small physical dimensions. IEEE Journal of Solid-State Circuits 9, 5 (1974), 256–268. https://doi.org/10.1109/JSSC.1974.1050511Google ScholarGoogle ScholarCross RefCross Ref
  16. Advanced Linear Devices. 2010. EPAD. https://www.aldinc.com/ald_epad.phpGoogle ScholarGoogle Scholar
  17. Advanced Linear Devices. 2012. ALD110800. https://www.aldinc.com/pdf/ALD110800.pdfGoogle ScholarGoogle Scholar
  18. Aline Eid, Jimmy GD Hester, and Manos M Tentzeris. 2021. 5G as a wireless power grid. Scientific Reports 11, 1 (2021), 1–9.Google ScholarGoogle ScholarCross RefCross Ref
  19. EnOcean. 2003. EnOcean ECO 200. https://www.enocean.com/en/enocean_modules/eco-200Google ScholarGoogle Scholar
  20. Farhad Farhabakhshian, Thomas Brown, Karti Mayaram, and Terri Fiez. 2010. A 475 mV, 4.9 GHz enhanced swing differential Colpitts VCO in 130 nm CMOS with an FoM of 196.2 dBc/Hz. In IEEE Custom Integrated Circuits Conference 2010. IEEE, 1–4.Google ScholarGoogle ScholarCross RefCross Ref
  21. FCC. 1990. FCC UHF Limit. https://afar.net/tutorials/fcc-rules/Google ScholarGoogle Scholar
  22. Maria Gallucci. 2020. Next-Gen Solar Cells Can Harvest Indoor Lighting for IoT Devices. IEEE Spectrum (2020).Google ScholarGoogle Scholar
  23. Chuhan Gao, Yilong Li, and Xinyu Zhang. 2018. LiveTag: Sensing human-object interaction through passive chipless WiFi tags. In 15th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 18). 533–546.Google ScholarGoogle Scholar
  24. Ricardo Gonzalez, Benjamin M Gordon, and Mark A Horowitz. 1997. Supply and threshold voltage scaling for low power CMOS. IEEE Journal of Solid-State Circuits 32, 8 (1997), 1210–1216.Google ScholarGoogle ScholarCross RefCross Ref
  25. Tobias Grosse-Puppendahl, Steve Hodges, Nicholas Chen, John Helmes, Stuart Taylor, James Scott, Josh Fromm, and David Sweeney. 2016. Exploring the design space for energy-harvesting situated displays. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 41–48.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. USA GSA. 2000. OSHA lighting requirement. https://www.gsa.gov/node/82715Google ScholarGoogle Scholar
  27. Chris Harrison and Scott E Hudson. 2008. Scratch input: creating large, inexpensive, unpowered and mobile finger input surfaces. In Proceedings of the 21st annual ACM symposium on User interface software and technology. 205–208.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. David Holman, Nicholas Fellion, and Roel Vertegaal. 2014. Sensing touch using resistive graphs. In Proceedings of the 2014 conference on Designing interactive systems. 195–198.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Yi Hu and Philipos C Loizou. 2007. Evaluation of objective quality measures for speech enhancement. IEEE Transactions on audio, speech, and language processing 16, 1(2007), 229–238.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Bashima Islam, Yubo Luo, and Shahriar Nirjon. 2019. Zygarde: Time-sensitive on-device deep intelligence on intermittently-powered systems. (2019).Google ScholarGoogle Scholar
  31. Vikram Iyer, Justin Chan, Ian Culhane, Jennifer Mankoff, and Shyamnath Gollakota. 2018. Wireless analytics for 3D printed objects. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. 141–152.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Vikram Iyer, Justin Chan, and Shyamnath Gollakota. 2017. 3D printing wireless connected objects. ACM Transactions on Graphics (TOG) 36, 6 (2017), 1–13.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. CC Santos Júnior, D Deotti, RM da Ponte, MB Machado, and MC Schneider. 2012. Zero-Threshold-Voltage MOSFETs: A Survey. (2012).Google ScholarGoogle Scholar
  34. Mustafa Emre Karagozler, Ivan Poupyrev, Gary K Fedder, and Yuri Suzuki. 2013. Paper generators: harvesting energy from touching, rubbing and sliding. In Proceedings of the 26th annual ACM symposium on User interface software and technology. 23–30.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Keiko Katsuragawa, Ju Wang, Ziyang Shan, Ningshan Ouyang, Omid Abari, and Daniel Vogel. 2019. Tip-tap: battery-free discrete 2D fingertip input. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 1045–1057.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Gierad Laput, Eric Brockmeyer, Scott E Hudson, and Chris Harrison. 2015. Acoustruments: Passive, acoustically-driven, interactive controls for handheld devices. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2161–2170.Google ScholarGoogle Scholar
  37. Aime Lay-Ekuakille, Giuseppe Vendramin, Amerigo Trotta, and Gabriella Mazzotta. 2009. Thermoelectric generator design based on power from body heat for biomedical autonomous devices. In 2009 IEEE international workshop on medical measurements and applications. IEEE, 1–4.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Hanchuan Li, Eric Brockmeyer, Elizabeth J Carter, Josh Fromm, Scott E Hudson, Shwetak N Patel, and Alanson Sample. 2016. Paperid: A technique for drawing functional battery-free wireless interfaces on paper. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 5885–5896.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Hanchuan Li, Can Ye, and Alanson P Sample. 2015. IDSense: A human object interaction detection system based on passive UHF RFID. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2555–2564.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Marcio Bender Machado, Marcio Cherem Schneider, Daniel Lucas Novack, and Carlos Galup-Montoro. 2015. Analysis and design of a fully-integrated colpitts oscillator operating at ultra-low-voltages. Analog Integrated Circuits and Signal Processing 85, 1(2015), 27–36.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Enrico Macii. 2004. Ultra low-power electronics and design. Springer.Google ScholarGoogle Scholar
  42. Kinya Matsuda, Yoshihiko Horio, and Kazuyuki Aihara. 2001. A simulated LC oscillator using multi-input floating-gate MOSFETs. In ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No. 01CH37196), Vol. 3. IEEE, 763–766.Google ScholarGoogle ScholarCross RefCross Ref
  43. John M Miller. 1920. Dependence of the input impedance of a three-electrode vacuum tube upon the load in the plate circuit. Scientific Papers of the Bureau of Standards 15, 351(1920), 367–385.Google ScholarGoogle ScholarCross RefCross Ref
  44. Mouser. 2000. Solar cell. https://www.mouser.com/ProductDetail/PowerFilm/LL200-36-75Google ScholarGoogle Scholar
  45. Kris Myny. 2018. The development of flexible integrated circuits based on thin-film transistors. Nature electronics 1, 1 (2018), 30–39.Google ScholarGoogle Scholar
  46. Alex Olwal, Jon Moeller, Greg Priest-Dorman, Thad Starner, and Ben Carroll. 2018. I/O Braid: Scalable touch-sensitive lighted cords using spiraling, repeating sensing textiles and fiber optics. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. 485–497.Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Makoto Ono, Buntarou Shizuki, and Jiro Tanaka. 2013. Touch & activate: adding interactivity to existing objects using active acoustic sensing. In Proceedings of the 26th annual ACM symposium on User interface software and technology. 31–40.Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. OSHA. [n.d.]. OSHA room temperature requirement. https://www.osha.gov/laws-regs/standardinterpretations/2003-02-24Google ScholarGoogle Scholar
  49. Joseph A Paradiso and Mark Feldmeier. 2001. A compact, wireless, self-powered pushbutton controller. In International Conference on Ubiquitous Computing. Springer, 299–304.Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Joseph A Paradiso and Thad Starner. 2005. Energy scavenging for mobile and wireless electronics. IEEE Pervasive computing 4, 1 (2005), 18–27.Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Swadhin Pradhan, Eugene Chai, Karthikeyan Sundaresan, Lili Qiu, Mohammad A Khojastepour, and Sampath Rangarajan. 2017. Rio: A pervasive rfid-based touch gesture interface. In Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking. 261–274.Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Stevan Preradovic and Nemai Chandra Karmakar. 2010. Chipless RFID: Bar code of the future. IEEE microwave magazine 11, 7 (2010), 87–97.Google ScholarGoogle Scholar
  53. Matej Rakús, Viera Stopjaková, and Daniel Arbet. 2017. Design techniques for low-voltage analog integrated circuits. Journal of Electrical Engineering 68, 4 (2017), 245.Google ScholarGoogle ScholarCross RefCross Ref
  54. Vaishnavi Ranganathan, Sidhant Gupta, Jonathan Lester, Joshua R Smith, and Desney Tan. 2018. Rf bandaid: A fully-analog and passive wireless interface for wearable sensors. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (2018), 1–21.Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Wei Ren, Yan Sun, Dongliang Zhao, Ablimit Aili, Shun Zhang, Chuanqian Shi, Jialun Zhang, Huiyuan Geng, Jie Zhang, Lixia Zhang, 2021. High-performance wearable thermoelectric generator with self-healing, recycling, and Lego-like reconfiguring capabilities. Science Advances 7, 7 (2021), eabe0586.Google ScholarGoogle Scholar
  56. Valkyrie Savage, Xiaohan Zhang, and Björn Hartmann. 2012. Midas: fabricating custom capacitive touch sensors to prototype interactive objects. In Proceedings of the 25th annual ACM symposium on User interface software and technology. 579–588.Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Inchang Seo. 2004. Low-voltage low-power analog circuit techniques using floating-gate MOS transistors. University of Florida.Google ScholarGoogle Scholar
  58. Sherif M Sharroush. 2017. A voltage-controlled ring oscillator based on an FGMOS transistor. Microelectronics journal 66 (2017), 167–186.Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Andrew Spielberg, Alanson Sample, Scott E Hudson, Jennifer Mankoff, and James McCann. 2016. RapID: A framework for fabricating low-latency interactive objects with RFID tags. In Proceedings of the 2016 chi conference on human factors in computing systems. 5897–5908.Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Thad Starner and Joseph A Paradiso. 2004. Human generated power for mobile electronics. Low-power electronics design 45 (2004), 1–35.Google ScholarGoogle Scholar
  61. James W Stevens. 1999. Optimized thermal design of small ΔT thermoelectric generators. Technical Report. SAE Technical Paper.Google ScholarGoogle Scholar
  62. Vamsi Talla, Michael Buettner, David Wetherall, and Joshua R Smith. 2013. Hybrid analog-digital backscatter platform for high data rate, battery-free sensing. In 2013 IEEE Topical Conference on Wireless Sensors and Sensor Networks (WiSNet). IEEE, 1–3.Google ScholarGoogle ScholarCross RefCross Ref
  63. Vamsi Talla, Bryce Kellogg, Shyamnath Gollakota, and Joshua R Smith. 2017. Battery-free cellphone. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 2 (2017), 1–20.Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Anna Vallgårda and Johan Redström. 2007. Computational composites. In Proceedings of the SIGCHI conference on Human factors in computing systems. 513–522.Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Anandghan Waghmare, Qiuyue Xue, Dingtian Zhang, Yuhui Zhao, Shivan Mittal, Nivedita Arora, Ceara Byrne, Thad Starner, and Gregory D Abowd. 2020. UbiquiTouch: Self sustaining ubiquitous touch interfaces. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (2020), 1–22.Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Anran Wang, Vikram Iyer, Vamsi Talla, Joshua R Smith, and Shyamnath Gollakota. 2017. {FM} backscatter: Enabling connected cities and smart fabrics. In 14th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 17). 243–258.Google ScholarGoogle Scholar
  67. Yuntao Wang, Jianyu Zhou, Hanchuan Li, Tengxiang Zhang, Minxuan Gao, Zhuolin Cheng, Chun Yu, Shwetak Patel, and Yuanchun Shi. 2019. Flextouch: Enabling large-scale interaction sensing beyond touchscreens using flexible and conductive materials. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1–20.Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Mark Weiser. 1999. The computer for the 21st century. ACM SIGMOBILE mobile computing and communications review 3, 3(1999), 3–11.Google ScholarGoogle Scholar
  69. Raphael Wimmer. 2010. FlyEye: grasp-sensitive surfaces using optical fiber. In Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction. 245–248.Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. Chenren Xu, Lei Yang, and Pengyu Zhang. 2018. Practical backscatter communication systems for battery-free Internet of Things: A tutorial and survey of recent research. IEEE Signal Processing Magazine 35, 5 (2018), 16–27.Google ScholarGoogle ScholarCross RefCross Ref
  71. Kimitoshi Yamazaki, Ryohei Ueda, Shunichi Nozawa, Mitsuharu Kojima, Kei Okada, Kiyoshi Matsumoto, Masaru Ishikawa, Isao Shimoyama, and Masayuki Inaba. 2012. Home-assistant robot for an aging society. Proc. IEEE 100, 8 (2012), 2429–2441.Google ScholarGoogle ScholarCross RefCross Ref
  72. Shouli Yan and Edgar Sanchez-Sinencio. 2000. Low voltage analog circuit design techniques: A tutorial. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences 83, 2 (2000), 179–196.Google ScholarGoogle Scholar
  73. Daniel J Yeager, Alanson P Sample, Joshua R Smith, and Joshua R Smith. 2008. WISP: A passively powered UHF RFID tag with sensing and computation. RFID handbook: Applications, technology, security, and privacy (2008), 261–278.Google ScholarGoogle Scholar
  74. Pengyu Zhang, Mohammad Rostami, Pan Hu, and Deepak Ganesan. 2016. Enabling practical backscatter communication for on-body sensors. In Proceedings of the 2016 ACM SIGCOMM Conference. 370–383.Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. Yang Zhang and Chris Harrison. 2018. Pulp nonfiction: Low-cost touch tracking for paper. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Yang Zhang, Yasha Iravantchi, Haojian Jin, Swarun Kumar, and Chris Harrison. 2019. Sozu: Self-powered radio tags for building-scale activity sensing. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 973–985.Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Yang Zhang, Chouchang Yang, Scott E Hudson, Chris Harrison, and Alanson Sample. 2018. Wall++ room-scale interactive and context-aware sensing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–15.Google ScholarGoogle ScholarDigital LibraryDigital Library

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Conferences
    UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology
    October 2021
    1357 pages
    ISBN:9781450386357
    DOI:10.1145/3472749

    Copyright © 2021 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 12 October 2021

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article
    • Research
    • Refereed limited

    Acceptance Rates

    Overall Acceptance Rate842of3,967submissions,21%

    Upcoming Conference

    UIST '24

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format