Abstract
We propose an immersive virtual reality (VR) system that uses multimodal biosignals—including EEG, ECG, and EMG—to dynamically enhance user interaction. Participants wear these sensors with a head-mounted display (HMD) and engage in VR scenarios where physiological states affect in-game elements. In one scenario, users wield a sword-like weapon whose length, shape, and thickness change in real time based on EEG, ECG, and EMG signals. This requires maintaining high concentration and physiological stability to gain advantages against computer-controlled opponents. The VR environment also includes distracting stimuli, such as notification sounds and visual banners, to simulate real-world attention challenges and promote concentration training. In another scenario, users manipulate large virtual objects through gestures and concentration thresholds detected via biosignals and accelerometers. This work advances the integration of physiological monitoring and VR interaction, enabling new approaches for attention enhancement and immersive control.