# Reading/decoding audio in usd

**URL:** <https://forum.aousd.org/t/reading-decoding-audio-in-usd/1605>\
**Category:** USD\
**Created:** [June 15, 2024, 5:17am UTC](https://forum.aousd.org/t/reading-decoding-audio-in-usd/1605 "2024-06-15T05:17:01Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![paoloemilioselva](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.aousd.org/paoloemilioselva/32/267_2.png) [@paoloemilioselva](https://forum.aousd.org/u/paoloemilioselva)\
**Post date:** [June 15, 2024, 5:17am UTC](https://forum.aousd.org/t/reading-decoding-audio-in-usd/1605/1 "2024-06-15T05:17:01Z")

</div>

Hi,  
I wanted to start looking into audio, and how to manipulate geometry based on input audio.  
Some like this:

[![](https://us1.discourse-cdn.com/flex016/uploads/aousd/original/1X/22bd8e0bd467e72a9f23803c1514d1d0dfaeb214.jpeg "sliBase (audio capture in Maya)") ](https://www.youtube.com/watch?v=pHnNleXCQeg)

and before I go with my custom audio reader in a sceneindex or any other usd plugin, can I leverage what’s already in OpenUSD in UsdMediaSpatialAudio for example ?  
Is what’s there already able to decode and pass audio details downstream ? what actual renders an audio file ?  
I’m starting from scratch, so even a simple c++ implementation of how to playback an example spatialAudio file would be fantastic.  
Thank you!

---

<div class="post-metadata">

**Author:** ![spiff](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.aousd.org/spiff/32/22_2.png) [@spiff](https://forum.aousd.org/u/spiff)\
**Post date:** [June 16, 2024, 5:08am UTC](https://forum.aousd.org/t/reading-decoding-audio-in-usd/1605/2 "2024-06-16T05:08:13Z")

</div>

That’s pretty cool, @paoloemilioselva ! `UsdMediaSpatialAudio` has no implementation in OpenUSD yet, though we are very open to contributions that would render spatial audio in a cross-platform way.

---

<div class="post-metadata">

**Author:** ![paoloemilioselva](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.aousd.org/paoloemilioselva/32/267_2.png) [@paoloemilioselva](https://forum.aousd.org/u/paoloemilioselva)\
**Post date:** [July 7, 2024, 7:12am UTC](https://forum.aousd.org/t/reading-decoding-audio-in-usd/1605/3 "2024-07-07T07:12:41Z")

</div>

Not exactly the same as my previous video, but I was able to use @nporcino LabSound in my Hydra gameengine.  
This is keyframed animation (from a json file with left-right notes), with animated booleans to play the note of each emitter (key).  
All in OpenUSD and Hydra which means you can use it in Solaris, usdview and all usd+hydra compliant hosts, with my custom sceneindex plugin obviously.

Headphones on 🙂

> <https://twitter.com/slider1978/status/1809846705581617407>

---

<div class="post-metadata">

**Author:** ![nporcino](https://avatars.discourse-cdn.com/v4/letter/n/3d9bf3/32.png) [@nporcino](https://forum.aousd.org/u/nporcino)\
**Post date:** [July 7, 2024, 5:28pm UTC](https://forum.aousd.org/t/reading-decoding-audio-in-usd/1605/4 "2024-07-07T17:28:55Z")

</div>

I love seeing this 🙂 I’ve been wanting to connect LabSound to USD for years but have never had time to devote to it, this is so amazing to see and hear!