Carnegie Mellon University researchers are looking to use technology that detects shapes to help smart cities, the clothing and gaming industries, and more.
Jingxian Wang, a Ph.D. candidate in electrical and computer engineering, said designs of smart cities served as an inspiration to create WiSh, the technology being devised that uses RFID (radio frequency identification) tags. Wang tested the technology on the 10th Street Bridge in Pittsburgh to measure the bridge’s curvature. A computer readout reconstructed the bridge’s shape so accurately that it matched infrastructure surveys.
“Low-cost, low-power, and minimum-effort are the main concerns when people design smart cities,” he said.
Infrastructure monitoring has so far hit hard limits in China and the U.S., Wang said. Many of these monitoring systems rely on expensive and energy-intensive sensors such as cameras or motion sensors that create more problems than they solve. WiSh could operate in cities cheaply, accurately and battery-free, sensing a diverse range of buildings and shapes.
Beyond applications in infrastructure, WiSh in smart clothing could measure movement and posture, such as spine curvature and gestures. VR gaming could benefit from WiSh through tags embedded in carpeting or upholstery to more accurately capture a player’s movement.
“WiSh is inspired by our recent body-tracking work, RFWear, and by industrial products, like vision-based shape-aware technology that Disney and Microsoft have explored as motion capture for virtual reality,” Wang said. WiSh especially has key advantages over motion capture: cost, ease of use and power supply.
“A lot of daily-wearable tech devices are costly, require constant charging, and can’t be washed,” said Haojian Jin, a Ph.D. student in the Human-Computer Interaction Institute. “With WiSh, its RFID tags cost only a cent apiece, are easy to implement and require no batteries.”
WiSh works by analyzing the RFID signals to model the shape of a surface. The tags on the bridge, for instance, appear as a curve. In most devices using RFID tags, such as ID cards and readers, the tags are mobile, and the reader, stationary. The team reversed this to make the tags stationary and the reader mobile. This enables the team to place tags on any surface and position an RFID reader in any desired location.
To capture the positions of each tag requires enormous computing power, he said. Otherwise, a computer would struggle to model more than a few dozen tags. The team created algorithms that matched the positions of tags as a whole to real-world models. This approach drastically reduces computing time and nullifies information gaps from unaccounted-for tags.
The team, advised by ECE Assistant Professor Swarun Kumar, who runs the Laboratory for Emerging Wireless Technologies (WiTech Lab), discovered some limitations in how they can use the RFID tags. Because the tags themselves are 3cm2, the algorithm can’t resolve any features on a surface smaller than that, such as wrinkles on cloth. Similarly, the algorithm can’t detect folds because of the RFID tags being placed on and coupling with each other, thus obfuscating a clear read.
While the RFID tags are being used on Pittsburgh bridges, the team expects the novel devices to be broadly applicable in the future.
“From smart cities and homes, to everyday materials like gaming systems and clothing,” Wang said. “These tags will be life-changing.”
