Samsung has announced that it will showcase three new experimental projects from its C-Lab program at the ongoing SXSW. The company will unveil Hum On app that transcribes hummed melodies into musical scores, Waffle, a social media platform that enables collaborative content creation and Entrim 4D, a VR accessory that lets users feel the movements of the on-screen action.
First up, as the name suggests, the Hum On app records hummed melodies and instantly transcribes them into musical notation. You can play it back by using your preferred arrangement style like R&B, classical or rock. The app utilizes analysis software to detect the pitch and duration of a user’s voice and machine learning to create a suitable accompaniment similar to the way a musician considers melody and chords. Samsung said that team is currently focused on improving the recognition accuracy of the app, and is even considering collaborating with musicians to provide more diverse, artist-inspired accompaniments in the future.
Next up Waffle, that sports a UI similar to a waffle, is a content-sharing application, that enables users to create a new feed of expandable content and even add to existing related content. Waffle enables users to add their own perspective to someone else’s content, and vice versa. Finally, the last project from the C-Lab program is related to virtual reality. The Entrim 4D uses a combination of algorithms and Galvanic Vestibular Stimulation (GVS), a technique that sends specific electric messages to a nerve in the ear.
The VR accessory synchronizes your body with changing movements in video content. These electrical signals are delivered via headphones equipped with electrodes that correspond with movement data input by engineers. Samsung says that the Entrim 4D team has conducted experiments on more than 1,500 people and developed 30 different movement patterns. They are also working on a version that uses additional electrodes to create a sense of rotational motion.