For viewers to delight in material such as movies, sports games and live events to the max, home TVs not only need outstanding picture quality but impressive sound quality also. Understanding this, market leaders are pursuing 3D audio advancement to include a deeper level of immersion to home entertainment experiences - bringing to life thrilling action scenes and catching the quietest information of ambient sound.
In other words, 3D audio makes listeners feel as if they're truly in the middle of the action. Typically just supported at specific venues such as cinema or taping studios, 3D audio is making its way into homes to give audiences a new method to experience their preferred content.
Samsung Electronics' advanced research study institute Samsung Research has been aiming to popularize 3D audio because 2020. To this end, Samsung dealt with Google to collectively develop Immersive Audio Model and Formats (IAMF) - an innovative 3D spatial audio technology that was adopted by the Alliance for Open Media (AOM)1 in October 2023. Samsung Newsroom took a seat with the group that developed IAMF to hear the story of how the technology came to life.
▲ The Visual Technology Team at Samsung Research led the development of a standard for audio innovation. (From left) SungHee Hwang, JeongHoon Park and WooHyun Nam
A New Way To Enjoy 3D Audio in the house
Ambient noise exists everywhere - from the noise of shoes scraping on the sidewalk to the mild hum of cars and trucks driving down the road. While this sound might seem unnecessary in media, it's important in adding depth and a sense of realness. 3D audio works to flawlessly mix ambient sound with conversations and other sound effects to create a more lively and genuine entertainment experience.
"3D audio makes you feel as if you're really in the heart of the action by adjusting the strength, movement and vibrance of the sound," stated WooHyun Nam from the Visual Technology Team at Samsung Research. "In this method, audiences are able to take pleasure in a more full-bodied noise that catches the 3D aspects of the world around us."
▲ SungHee Hwang from Samsung Research's Visual Technology Team
Despite the advantages of 3D audio, it has actually been difficult to apply the innovation to home audio devices due to technological restrictions. "3D sound details from material can not be translated appropriately by home audio systems such as TV speakers or sound bars, leading to a somewhat minimal audio experience that lacks information from the initial content," said SungHee Hwang from the Visual Technology Team at Samsung Research.
To fix this, Samsung worked vigilantly with Google to develop an audio service that would enable viewers to experience content audio as planned. "If the 3D audio information can be checked out by device makers, they can change the noise in audio gadgets - permitting immersive audio experiences with standard TV speakers or sound bars at home," stated Nam. "By adjusting the audio to match the home gadget environment, listeners can experience audio simply as the creator planned without any distortions or loss in quality."
An uniform requirement is needed to send and receive audio data efficiently between developers and gadget producers. "Samsung and Google's particular competence in gadgets and material made the companies ideal partners to create IAMF technology," stated JeongHoon Park, Executive Vice President and Head of Visual Technology Team at Samsung Research. "By coming together to establish this unprecedented technology, we are leading the way for consumers to delight in 3D audio in their homes."
Three Characteristics of IAMF Technology: Vertical Audio, AI-Based Audio and Customized Audio
IAMF technology uses 3 distinct features that enhance the audio experience.
▲ WooHyun Nam from Samsung Research's Visual Technology Team
1. Ability To Express Sound Vertically
Previous open-source audio codecs just supported horizontal sound expression. With IAMF innovation, audio can now be revealed vertically so that sound is progressively multi-directional. "IAMF makes sound more practical, by allowing listeners to hear audio in front, behind or to either side and likewise above or below them," stated Nam. "As such, when IAMF technology is applied to home TV speakers and sound bars, it allows listeners to hear noises such as birds flying over their head on their TVs in the house."
2. AI-Based Scene Analysis and 3D Audio Effects
IAMF utilizes AI and deep-learning technology to evaluate scenes and emphasize particular aspects of the material - changing audio levels for more improved sound throughout the viewing experience. "In TV and film, there are particular scenes where the soundtrack or background music is the primary focus," said Nam. "IAMF will stabilize the sound in these instances. Similarly, the technology will tweak audio when there is character discussion to allow the listener to focus on the discussion."
In addition, IAMF technology supplies ideal sound regardless of changes in the device environment. "By adjusting the scene analysis audio information according to the device environment, IAMF innovation makes it possible for listeners to enjoy the material's original sound quality on basic home TVs," Hwang included.
3. Highly Customized Audio
Users will have the ability to freely adjust sound according to their choices with IAMF innovation. Whether audiences are seeking to amplify sound impacts from an action scene or boost dialogue, IAMF provides the flexibility to tailor material audio for a more personalized experience.
▲ IAMF evaluates information from content and enables audiences to adjust and customize audio settings. When enjoying a sports game, users can directly select whether to stress the commentator's voice or the noises of the video game itself.
3D Audio Across the Industry With Open-Source IAMF
Open source is crucial to creating a unified requirement throughout the industry. IAMF is the first open source-based audio innovation basic adopted by AOM - indicating both business and independent material creators across the market can access the innovation and expand its usage.
"In order to allow individuals to easily create content with 3D audio innovation, associated technology requires to be open up to all," said Nam. "Providing a total open-source structure for 3D audio, from production to shipment and playback, will allow for much more varied audio material experiences in the future."
Similarly, Park highlighted how IAMF technology will have a big influence on the audio landscape progressing. "Because we live in an era dominated by content creation, IAMF will help lead, broaden and transform the 3D audio environment," he stated.
Success Accomplished Through Cooperation
Research on IAMF started in 2020 and took almost four years to finish. Through a mix of determination and effort, the group was able to achieve success.
"The task involved many days of continuously work, and there were times when we required to operate at night due to the time difference in between our workplace and Google's," said Hwang. "Despite these obstacles, I was happy in the end. It was a great chance to work with designers from other nations."
The groups established a sense of sociability along the method and constructed a strong foundation of trust and understanding. "A Google worker pointed out how this collaboration with Samsung has been the most satisfying collaboration he had finished up until now," Park remembered. "We were able to achieve this task because our teams relied on each other. I'm really happy with and grateful for our staff member' efforts and their cooperation."
▲ JeongHoon Park, Corporate EVP and Head of the Visual Technology Team at Samsung Research
Additionally, Park applauded each staff member's distinct skills and competence which helped contribute to the creation of IAMF. "WooHyun Nam contributed in proposing the innovation development concepts while SungHee Hwang arranged and recorded our team's concepts in a specific way," he stated.
A Vision for 'Samsung Sound'
Upon its release, the Samsung Research group realized that the standardization of 3D spatial audio marked a brand-new period of sound technology.
"Thanks to IAMF, we can begin looking into innovations that will open a world of audio possibilities," said Nam. In line with this, the Samsung Research group is presently establishing an advanced version of IAMF technology that can be used to various sectors such as mobile phones, the metaverse, computer game and more.
▲ With their combined efforts and unrelenting persistence, the Visual Technology Team at Samsung Research was able to effectively produce a brand-new requirement for 3D audio.
Given the success of IAMF, the Samsung Research group is encouraged to create better audio innovation for customers. Each of the staff member shared their aspirations for the future of 3D audio.
Nam discussed his desire to develop audio innovation that is more immersive. "I wish to produce an advanced 3D audio innovation that makes users seem like they are truly in the scene of a motion picture, TV show or live event," he stated. "I also wish to continue this research till 3D audio is used to Samsung's mobile phones."
More broadly, Hwang talked about how he hopes Samsung will have the ability to develop unequaled audio technology that will place it amongst the ranks of other leading audio business. "My goal is to establish an innovation that consumers will have the ability to quickly differentiate as 'Samsung Sound' when they hear it," he said. "I am optimistic that the IAMF requirement is a stepping stone toward this dream. "
"My hope is that Samsung's sound innovation will make it possible for consumers to take pleasure in an upgraded audio experience that is on par with that of current visual experiences," stated Park. "I hope that material creators will use Samsung's audio technology to make 3D audio content accessible. Additionally, we aim to create an encouraging environment that allows scientists to handle bold and exciting challenges such as broadening Samsung's audio technology."
Technological standards such as IAMF will make home entertainment more immersive for viewers across the board. The Samsung Research group is leading the way for innovations that will change the future of audio.
1 A non-profit market consortium formed to develop and share technology for multimedia delivery, allowing creators to utilize the innovation without fretting about cost. It is operated by an alliance of 38 business including Samsung Electronics, Google, Amazon, Apple and Meta.
