On Mon Mar 25 09:34:51 2024 +0000, Torge Matthies wrote:
The AAC encoder actually doesn't expose the generated `MF_MT_USER_DATA` in the output type, you were right. Which only makes it more important that we either generate it in the IMFMediaSink or parse it from the input stream. I already did an experiment with just putting an `aacparse` element at the start of the wg_muxer pipeline, but that didn't make GStreamer happy. It might be that the input to the media sink is an AAC stream in "raw" format, and I think you can't parse out codec data from that. In which case I don't see a way around generating the user data separately in some way from the attributes set on the input type of the IMFMediaSink, either directly in Wine or with the Gstreamer-based method.
Yes, reconstructing codec data is just not something aacparse does unfortunately. That could of course be changed but it would put an unfortunate limit on the minimum GStreamer version, and it's not all that clear that it's the right thing to do here.