Open Media devroom
Open Source video mixing and syncing with real-time control
<p>As of the 3.10 release, the public domain (Unlicense) media server MistServer (https://mistserver.org) gained a new feature: the ability to mix raw (UYVY pixel format only, for now) video streams, raw audio streams (PCM) and PNG images with resizing, overlapping, aspect ratio keeping and support for non-uniform frame rates between sources. Not only that - but it's even possible to control the configuration in real time without any downtime.
This talk shows off what is possible, and explains how we did it in technical detail.</p>
<p>Covered topics:</p>
<ul>
<li>How to efficiently store a multi-frame raw video buffer in shared memory</li>
<li>Synchronization handling between multiple sources</li>
<li>Handling sources being added or removed without interruptions</li>
<li>How we implemented decoding and encoding between raw and encoded formats</li>
<li>The user interface that was built to control the mixing in a user-friendly way (though "raw" control through JSON is also possible)</li>
</ul>
Additional information
| Live Stream | https://live.fosdem.org/watch/k4601 |
|---|---|
| Type | devroom |
| Language | English |
More sessions
| 1/31/26 |
<p>Recent Rockchip SoCs (namely, those of the RK35 generation) integrate dedicated IP blocks for video capture and image signal processing. Yet support for these blocks in upstream Linux remains one of the last missing pieces in an otherwise well-supported SoC lineup.</p> <p>This talk will begin with an overview of the contributions that have already landed in mainline, provide an update on the change sets that are currently in flight, and outline the remaining work needed to fully enable video ...
|
| 1/31/26 |
<p>This talk describes our in-race-car video camera hardware and the open-source software that underpins our sub 200ms Glass to Glass streaming. </p> <p>We will discuss interfacing to V4l2 (in various modes) from memory safe languages (that <em>aren’t</em> C) and also the problems and advantages of accessing a chip specific encoder API. I will have a solid grumble about the increasing complexity and opacity of the linux media APIs and a moan about how much I miss Plan9 style thinking.</p> ...
|
| 1/31/26 |
<p>The WebKit <a href="https://wpewebkit.org/">WPE</a> and <a href="https://webkitgtk.org/">GTK</a> ports are aiming to leverage GstWebRTC as their WebRTC backend. Over the years we have made progress towards this goal both in WebKit and in <a href="https://gstreamer.freedesktop.org/">GStreamer</a>. During this talk we will present the current integration status of GstWebRTC in WebKit, the achievements recently accomplished and the plans for the coming months.</p>
|
| 1/31/26 |
<p>This talk will present a range of unusual programming techniques that were used in the development of a state-of-the-art H.264 software decoder (https://github.com/tvlabs/edge264), to drastically reduce code and binary size and improve speed. The techniques are applicable to other audio/video codecs, and will be presented as HOWTOs to help participants use them in their projects. It complements my talks from the last 2 years at FOSDEM, and will focus this time on (i) using YAML output as a ...
|
| 1/31/26 |
<p>The global software ecosystem has moved to richer and richer web experience. With the addition of A/V APIs, webgl acceleration, rich media APIs, RTC and, more recently, the wide open field of web assembly-supported features, more or and more of the typical user interaction and applications happens within the browser.</p> <p>However, not all processing is meant to happen browser-side. In particular, when dealing with media with potentially large resolutions, exotic formats or complex ...
|
| 1/31/26 |
<p>In this talk, I will pass in review about what happened in the VideoLAN and FFmpeg communities about VLC, FFmpeg, x264, dav1d, dav2d, checkasm, libplacebo and libspatialaudio.</p> <p>And a bit of Kyber :)</p> <p>All in one short talk :)</p>
|
| 1/31/26 |
<p>Streamplace (https://stream.place) has been spending the last two years developing a novel form of decentralized public broadcast to facilitate a live video layer for Bluesky's AT Protocol. The basis of this system are C2PA-signed one-second MP4 files that can be deterministically muxed together into larger segments for archival. This talk will give a technical overview of how all the pieces fit together and show off how our freely-licensed media server facilitates cooperative livestreaming ...
|
