Blogs

mpf-rdf-mux: RDF Multiplexer

mpf-rdf-mux

The following describes the usage and an example of the mpf-rdf-mux component, a multiplexer which can be used to join two streams of GRDF buffers.  Multiplexing two streams to join them into a single stream requires knowledge of the data-types in the input.  This component is restricted to processing GRDF streams, both on the input and on the output pads.

Categories:

mpf-buf-rdf: GstBuffer RDF metadata generator

mpf-buf-rdf

The following describes usage and an example of the mpf-buf-rdf component.  This component can be placed pretty much anywhere in a pipeline to generate RDF metadata about the GstBuffer buffers that are connected to its input.  When used with a "tee" component it can be used to associate metadata with buffers (audio, video, etc) as they flow through a pipeline. 

New MPF Components

I'm in the process of migrating some new MPF components into the public MPF space.  These components are:

Quick skim of "Automated Metadata in Multimedia Information Systems"

I just skimmed "Automated Metadata in Multimedia Information Systems - Creation, Refinement, Use in Surrogates, and Evaluation" Turns out the lecture is by Mike Christel of CMU, which I hadn't noticed ... it's a quick read, and worth the hour it takes. Here's my quick notes:

Some interesting tidbits he cites re ASR results:

Signal Innovations Group

As part of our efforts to seek out centers of excellence for media algorithms we met with a company last week called Signal Innovations Group, SIG  http://www.siginnovations.com/about.html whose co-founders are Dr. Paul Runkle and Dr. Larry Carin.  Dr.

Speech/Nonspeech detector

Here are some notes on the current version of the speech/nonspeech detector known as "spnsp".

Speech Recognition overview

The following is a high-level view of how we plan to stich together the speech recognition system. I'm especially interested in feedback on mime types for the various data flows. I'll post seperately on specific components as well.

mpf-xml-pipeline-dump component

I have committed a new component to SVN to assist with diagnosing MPF (and gstreamer) pipelines: MPF/components/mpf-xml-pipeline-dump.  This component acts as an identity transform, but will dump the structure of the pipeline on the first call to component_process.  The default is a dump to stdout, but the component also supports a "location=filename" parameter to place the XML in a named file.  The dump is performed by the gst_xml_write_file function, and is rather verbose. 

Segmenter Component (mpf-segmenter)

Published June 1, 2009, 4:04 pm | by stuffs

I just committed a first version of a stream segmenter component: mpf-segmenter.  This component works together with a time-of-interest component (mpf-toi) to chop a stream up into segments of interest. Both mpf-toi and mpf-segmenter are in the public SVN tree under the MPF/components directory, and require a current build of GRDF which implements node comparison functions for uri and anon nodes.

Time Of Interest Component (mpf-toi)

I have checked in a first version of the mpf-toi (Time Of Interest) component.  This will allow for segmenting or analyzing media streams based on the stream time.  The source code is in MPF/trunk/components/mpf-toi in the svn repository.

Categories: