This lightning talk will showcase a new GStreamer plugin that allows applications to overlay HTML pages on top of video content. This plugin also allows to capture and interact with an HTML page in a live GStreamer pipeline, for recording purposes for instance.
Overlaying content on top of live video is common practice in the broadcasting industry nowadays. What if you could use HTML and Javascript for your overlay implementations? This would be possible with GStreamer and WebKit's WPE port combined in a GStreamer plugin.
GstWPE receives EGLImages from WPE and shares them as GstMemory objects attached to buffers injected into the pipeline. This approach enables applications to perform overlaying directly in the GPU using shaders. Alternatively the EGLImages can be downloaded to the CPU main memory using the GStreamer gldownload element and processed there.
GStreamer is an extremely powerful and versatile framework for creating streaming media applications. WPE WebKit allows embedders to create simple and performant systems based on Web platform technologies. It is designed with hardware acceleration in mind, leveraging common 3D graphics APIs for best performance.
Speakers: Philippe Normand