Information Interaction Laboratory,
Tohoku Gakuin University

Research Topics

In Information Interaction Laboratory, following researches are conducted in order to realize two research goals (Task Support via Ultra-Realistic Communications and Interpretation of Perception Process of Multimodal Information Processing).

Task Support via Ultra-Realistic Communications

We are developing technologies and methods based on the concept of "improving things that are difficult to use and making work smoother."

Sound Presentation for Remote Control Cockpit

In conventional cockpit, sound was presented using a 5.1ch surround system. However, this system has the problem that it is difficult to notice abnormalities coming from above because the sound is not played from above.

To solve this problem, we are developing a personal 3D sound field reproduction technology (recording sound with eight directional microphones and replaying the recorded sound with eight loudspeakers). By this technology, it is expected that it will be easier to notice abnormalities from above because a 3d sound space is expressed appropriately.

Personal3D

Sound Presentation for Large-screen Multipoint Teleconference System

Conventional conference systems have presented stereo sound. However, this method has the problem that it is difficult to tell who is speaking because no sound is played back from the position of participants.

In order to solve this problem, we are developing the MVP (Multiple Vertical Panning) method (placing a pair of loudspeakers above and below the large screen display, and playing back sound been set an appropriate volume difference from the two loudspeakers above and below the position of participants). By this method, it is expected that it will be easier to understand who is speaking because the sound is always played back from the position of participants.

MVP

Live Performance via Automatic Accompaniment

In conventional performances, the computer provided the accompaniment, and the performers matched with the accompaniment. However, this method has the problem that it is difficult for the performers to match the timing, so they cannot finish their performances at the same time at the end of the song.

In order to solve this problem, we are developing a foot pedal method (a foot pedal is placed at the performer's feet, and the foot pedal is operated while playing). By this method, the computer plays the accompaniment according to the performer's operations, so it is expected that a live performance can be performed with the just timing even at the end of the song.

FootPedal

Sound Presentation for Future 3D Television

In the future 3D TV, people will watch TV while surrounding TV. This 3D TV can be realized with VR/MR goggles, but there is a problem that the device must be worn.

To solve this problem, we are developing a 3D radiated sound field reproduction technology (recording sound with a microphone array surrounding the performer and replaying the recorded sound with a radiated loudspeaker array). This technology reproduces the sound field outside the TV, so it is expected that viewers will be able to watch the 3D TV without wearing anything.

Radiated3D

Interpretation of Perception Process of Multimodal Information Processing

Our goal is to understand how humans feel when they use multiple sensations.

Mechanism of Ventriloquism Effect

In previous research, sound was played from a horizontal direction, viewing position was only one ,and sound was played from a position that avoided the TV. In this laboratory, sound is played from a vertical direction, multiple viewing positions are considered, and sound is played from behind the TV.

Contact

inserted by FC2 system