Sony Electronics Inc. has developed the world's first real-time live distribution technology with full object-based spatial sound.[1] In addition, Sony is expanding the potential of its music experience 360 ​​Reality Audio, which immerses the user in a three-dimensional sound field.

Live streaming is widely appreciated because it is easy to use and does not impose any restrictions on location and movement. However, it has so far been a challenge to convey a realistic listening impression. Now Sony has further developed its proprietary 360 Spatial Sound technology to enable real-time transmission of three-dimensional sound and video recordings with 360 Reality Audio. In this way, users can experience live performances or concerts in authentic quality in real time without being there themselves.
The first live event to be streamed in real-time with 360 Reality Audio is artist Hikaru Utada's online event "40 Dai-Wa-Iroiro♬" streaming around the world on January 19, 2023.[2 ] The event is free for the first 10.000 participants.[3]

Development of an encoder for the real-time distribution of 360 reality audio for artists and sound engineers
Sony has further improved the production environment for 360 Reality Audio and developed a real-time encoder that enables artists and sound engineers to achieve both real-time performance and outstanding sound quality. In order to create a spatial musical experience, the sound engineers first assign position information to each sound source, such as vocals, guitars and drums, and arrange the sounds in a spherical space. The new 360 Reality Audio production tool for real-time distribution that Sony has now developed further improves the production environment and enables the sound engineers to place the sound sources anywhere and instantly and produce sound with the intended three-dimensional effect.
In order to send the music to the server and transmit it to the users, the audio data including the position information is compressed once. However, a certain processing time is required to preserve the high sound quality. Sony has now developed its own sound quality processing algorithm to achieve the real-time performance that is crucial for live broadcasting. In addition, since 360 ​​Reality Audio uses object-based spatial audio technology, the amount of information (bit rate) assigned to each sound source (object) can be automatically optimized without degrading the sound quality. By briefly compressing the audio data, the technology enables real-time distribution synchronized with the video recording.

Development of an app [4] for real-time distribution of 360 reality audio to viewers
In cooperation with the US software company Streamsoft Inc., Sony has developed the "360 Reality Audio Live" application, which enables users to experience 360 ​​Reality Audio in real time. With this app and their own headphones, users can enjoy this new form of live entertainment.[5]

In addition, the application offers a real-time chat function that allows artists and viewers, as well as viewers, to communicate with each other in real time. This can create a feeling of togetherness online, as if you were actually there.
360 Reality Audio Live website: https://www.sony.net/united/360RA_live/schedule/

Real-time streaming of Hikaru Utada's online event "40 Dai-Wa-Iroiro♬" in 360 Reality Audio
The event will be broadcast around the world on Thursday, January 19, 2023 - Hikaru Utada's 40th birthday - starting at 21:00 Japan time. In order to participate, viewers need the 360 ​​Reality Audio Live app and headphones.
Hikaru Utada's 40 Dai-Wa-Iroiro♬ Online Event website: https://www.utadahikaru.jp/40iroiro/en/

What is 360 Reality Audio?
360 Reality Audio uses Sony's object-based spatial sound technology to create an immersive experience that's as real as if the listener were at a live concert. Artists and music producers can use 360 ​​Reality Audio to create a 360-degree listening experience by positioning sounds such as vocals, choirs and instruments in the sound field in a way that suits their creative and artistic visions . When the resulting content is played back, listeners enjoy a musical experience immersed in sounds from all directions - just as the producers intended. For more information see here on the official 360 Reality Audio website.

[1] As of December 22, 2022, according to Sony research.
[2] The event is presented by U3MUSIC / EPIC Records Japan. Please check the event website for the countries and regions where it will be broadcast.
[3] The event will also be streamed in standard 2-channel sound with no limit on the number of participants.
[4] Available on mobile devices such as Android and iOS smartphones and tablets.
[5] The app can be used in combination with headphones from any manufacturer. When users use 360 ​​Reality Audio-certified headphones from Sony or Audio-Technica, they can use the customization features of the associated apps to enjoy an even more realistic experience.