Academic Journal

InContacts: Tracking Microsurface Interactions Using Modular Optical Flow Sensor Systems

Abstract

Tracking fine-grained surface interactions such as sliding, pressing, and deformation is essential for enriching tangible interaction design. However, existing systems often require external infrastructures, markers, or controlled environments, limiting their deployment in everyday contexts. We present InContacts, a compact, wireless module equipped with an optical flow sensor that enables the detection of microsurface interactions without the need for external setup or special tracking objects. By leveraging both positional data and image quality (IQ) data, InContacts enables robust relative sensing of interaction states and intensity trends, rather than precise absolute measurement, across a wide range of materials and configurations. We modularize the sensing mechanism and provide a visual programming graphical user interface (GUI) and code generation tools to enable rapid prototyping, supporting rapid prototyping and system integration. We technically characterize the sensing capabilities and limitations of the proposed system through a series of benchmarks, including motion tracking behavior, material-dependent responses, and deformation-related signals. In addition, we report a hands-on workshop as qualitative, deployment-oriented evidence, illustrating how the proposed sensing primitives can be appropriated and combined in practical interaction scenarios. The results show that modular optical flow sensors can function as versatile surface interaction sensors beyond their conventional device-centric use cases, supporting scalable and practical deployment in real-world environments.

Artifacts

Information

Book title

IEEE Sensors Journal

Volume

26

Issue

11

Pages

17810-17821

Date of issue

2026/06/01

Date of presentation

2026/06/01

DOI

10.1109/JSEN.2026.3685124

Project

ArgusEyes

Citation

BibTeX
@article{xlab80,
  author = {Ryosuke Shibata and Ken Nakagaki and Mai Kamihori and Shintaro Izumi and Kazuki Takashima and Yuichi Itoh},
  title = {InContacts: Tracking Microsurface Interactions Using Modular Optical Flow Sensor Systems},
  journal = {IEEE Sensors Journal},
  year = {2026},
  volume = {26},
  number = {11},
  pages = {17810--17821},
  doi = {10.1109/JSEN.2026.3685124}
}
ACM Reference Format
Ryosuke Shibata, Ken Nakagaki, Mai Kamihori, Shintaro Izumi, Kazuki Takashima, and Yuichi Itoh. 2026. InContacts: Tracking Microsurface Interactions Using Modular Optical Flow Sensor Systems. In IEEE Sensors Journal, Vol. 26, No. 11, 17810-17821. https://doi.org/10.1109/JSEN.2026.3685124