EXCLUSIVE COVERAGE: Behind the scenes of Perfume's real-time “space-to-space transfer”, a mix of real and virtual live broadcast WIRED.jp

“If something goes wrong, everything goes wrong. Our role this time is to connect the technique to the people watching us. That's why we're trying desperately to match our choreography to the technique and find our location. I think that's one of the reasons why. I feel so nervous On stage like this.

The three, freed from tension, spoke about their perceptions of the “positive future” they had envisioned during the process so far.

“Instead of using equipment all around us that has 'notes' posted everywhere, what if we could use cameras that anyone could use to transmit spatial information in three dimensions. We could feel more deeply the presence and connection of those we love that are far away. I think I would be A~chan is able to do that, Nochi says so.

“The only way to enjoy a live performance far away was through a screen like a movie theater…” Kashioka said, continuing in an amused tone. “It would be amazing if everyone could enjoy our 3D presence anywhere they want. That means we don't have to choose a location either. In the ocean, in space, anywhere. That means we might be able to perform live. I think that would be “Wonderful.”

Reproducing and transmitting existence itself

To achieve this performance, a system equipped with three LiDAR devices (sensors that use laser light) and cameras, similar to those installed in autonomous vehicles, was installed in five locations surrounding the Perfume Theater. By combining the huge amount of 3D point cloud data and image data measured and photographed by this system, and using special NTT technology that increases the accuracy of 3D data in real time, it is possible to capture the movement of people and objects. It has become possible to transmit and reproduce information. Spatial to remote locations with high accuracy and high speed. Kota Hidaka, director of the NTT Human Information Laboratories, explains the purpose of this demonstration experiment as follows.

“We have been communicating sounds for a long time, embodying the word 'tele' included in our company name, NTT (Nippon Telegraph and Telephone Corporation). From this perspective, in 2017 we began working with Perfume on 'Tele' as an extension of our attempt “Removing Distance” In “Experience the Future”, we try to transcend time and space to convey the feelings and existence of far away space with the harsh quality of entertainment using point clouds. In this sense, the fragrance, which has been around for 25 years, is unique.

Spatial transmission that gives you the same feeling as performing live on location. Jun Shimamura, also a senior researcher at NTT Human Information Laboratories, imagines potential applications for the IOWN, or society of the future, concept.

“Furthermore, by transmitting human myoelectricity and even physical intelligence, for example, people with disabilities would be able to 'move' their bodies. Or, in the urban layer, vast amounts of spatial information could be transmitted with movement instantly. This would “It enables two-way engagement, simulation and monitoring of disaster countermeasures and urban planning, and real-time feedback. This will ultimately lead to people's happiness in the real world. We are contributing to this world through technology.”

The presence of fragrance and technological texture in every era

Kaoru Kano, who served as the creative director for this performance, said that one of his tasks was to present a vision for the kind of community he would create, based on the theme of NTT technology that had not yet appeared in the community that had happened. At the same time, this was another primary goal.