Motivation

Automatic identification technology such as RFID promises to connect physical objects with virtual representations or even computational capabilities. However, even though RFID tags are continuously falling in price, their widespread use on consumer items is still several years away, rendering large-scale experiments with such an “internet of things” difficult. Much more ubiquitous are printed bar codes, yet so far their recognition required either specialized scanner equipment, custom-tailored bar codes or costly commercial licenses – all equally significant deployment hurdles. We have developed a freely available EAN-13 bar code recognition and information system that is both lightweight and fast enough for the use on camera-equipped mobile phones, thus significantly lowering the barrier for large-scale, real-world testing of novel information and interaction applications based on “connected” physical objects. We hope that this “low tech” version of bridging the gap will allow the community of researchers, developers and motivated people to quickly develop and try out more realistic and widespread applications, and thus gain real-world experiences for better jump-starting the future internet of things, today.

Today's Role of Barcode Recognition

The idea of linking real-world products with virtual information has been around for quite some time. In 1998, Barrett and Maglio already described a system for attaching information to real-world objects [BM98], while 1999 Want et al. expanded upon the idea and linked arbitrary items through the use of RFID tags with both information services and actions [WFGH99].

Since then, a number of research projects have continued to explore this concept of “bridging the gap”, i.e., the automatic identification of individually tagged real-world products in order to quickly look up information or initiate a specific action [KBM+02]. With the increasing mobility of powerful computing systems, e.g., mobile phones or handheld PDAs, this bridging can even be done in situ, i.e., right when we need it, where we need it.

While RFID potentially offers an unprecedented user experience due to its detailed means for identification (i.e., on a per item basis) and the lack of a line-of-sight requirement for reading, most industry analysts agree that an item-level rollout (e.g., having an RFID tag on every single supermarket product) is still several years away [Jue05]. In contrast, the printed bar codes are practically ubiquitous: Virtually every item sold today carries an internationally standardized bar code on its packaging, enabling not only checkout registers to quickly sum up one’s shopping items, but also to identify a product and look up a wealth of related information.

Obviously, using bar codes for linking real-world objects to virtual information has a number of drawbacks when compared to an RFID-enabled future with corresponding mobile RFID readers, such as NFC-enabled1 mobile phones. Due to their sensitivity to soiling, ripping, and lighting conditions, optical bar code recognition can be difficult. Until recently, reading a conventional (i.e., 1D) bar code inevitably required a separate laser scanner or a corresponding mobile phone scanner attachment. The increasing availability of camera phones, i.e., mobile phones with an integrated digital camera, has begun to simplify this process, however. After 2D bar codes have been successfully recognized by most consumer-grade camera phones for quite some time [Roh04], the continuously increasing quality of both the camera resolution and the employed lenses have finally made it feasible to directly read 1D bar codes with such cameras, without the need for special attachments or handheld lasers.

This significantly changes the attractiveness of using barcodes for the above physical-to-digital linkage: Instead of waiting several years for a comprehensive item-level roll out of RFID tags, or forcing people to carry around specific scanner attachments for their mobile phones, the support of 1D bar code recognition on any camera phone immediately allows anybody to interact with almost any commercially available product – all it takes is a small application download.

References

[BM98] Rob Barrett and Paul P. Maglio. Informative things: how to attach information to the real world. In UIST ’98: Proceedings of the 11th annual ACM symposium on User interface software and technology, pages 81–88, New York, NY, USA, 1998. ACM Press.

[Jue05] Ari Juels. RFID Privacy: A Tecnical Primer for the Non-Technical Reader. In Katherine Strandburg and Daniela Stan Raicu, editors, Privacy and Technologies of Identity: A Cross-Disciplinary Conversation. Springer, 2005.

[KBM+02] Tim Kindberg, John Barton, Jeff Morgan, Gene Becker, Debbie Caswell, Philippe Debaty, Gita Gopal, Marcos Frid, Venky Krishnan, Howard Morris, John Schettino, Bill Serra, and Mirjana Spasojevic. People, places, things: web presence for the real world. Mobile Networks and Applications, 7(5):365–376, 2002.

[Roh04] Michael Rohs. Real-World Interaction with Camera-Phones. In 2nd International Symposium on Ubiquitous Computing Systems (UCS 2004), pages 39–48, Tokyo, Japan, November 2004.

[WFGH99] RoyWant, Kenneth P. Fishkin, Anuj Gujar, and Beverly L. Harrison. Bridging physical and virtual worlds with electronic tags. In CHI ’99: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 370–377, New York, NY, USA, 1999. ACM Press.