Creating Realistic Virtual Textures from Contact Acceleration Data

Joseph M. Romano, Katherine J. Kuchenbecker

IEEE Transactions on Haptics · 2011 · 235 citations · 31 references

Concepts

TL;DR

Modern haptic interfaces convey large‑scale shape but often fail to provide realistic microscopic texture feedback, and direct texture rendering is difficult because it requires a finely detailed surface model, real‑time dynamic simulation, and high‑bandwidth output. This paper presents a fully realized solution for creating realistic virtual textures. The system captures a texture’s feel with a sensorized handheld tool that records 3‑D acceleration, position, and contact force, reduces the signals to a perceptually equivalent 1‑D form, applies linear predictive coding to produce frequency‑domain texture models, and renders them in real time on a Wacom tablet using a stylus equipped with voice‑coil actuators. Human subject studies confirm that the rendered virtual textures convincingly simulate contact with the real surfaces.

Abstract

Modern haptic interfaces are adept at conveying the large-scale shape of virtual objects, but they often provide unrealistic or no feedback when it comes to the microscopic details of surface texture. Direct texture-rendering challenges the state of the art in haptics because it requires a finely detailed model of the surface's properties, real-time dynamic simulation of complex interactions, and high-bandwidth haptic output to enable the user to feel the resulting contacts. This paper presents a new, fully realized solution for creating realistic virtual textures. Our system employs a sensorized handheld tool to capture the feel of a given texture, recording three-dimensional tool acceleration, tool position, and contact force over time. We reduce the three-dimensional acceleration signals to a perceptually equivalent one-dimensional signal, and then we use linear predictive coding to distill this raw haptic information into a database of frequency-domain texture models. Finally, we render these texture models in real time on a Wacom tablet using a stylus augmented with small voice coil actuators. The resulting virtual textures provide a compelling simulation of contact with the real surfaces, which we verify through a human subject study.

References

31