mercredi 1 février 2017

Rust stream pipeline creation

Hi I would like get some advice on design for a system that process a stream of data and send it on through a number of elements.

What I a thinking of a something like GStreamer where you have a number of elements with inputs and an output that can be strung together into a pipeline.

My element would not have to deal with complex video or audio it we be simple functions like strip zeros or add a constant.

So lets assume we have a stream input element that reads a data stream from a file. Each data point in my case would be a tuple of a timestamp and floating point value. It would then connect to say an Add element that add 20 to each point. this could then be pass to a third element that only passes the data at 5 minute intervals.

I would be using Rust for this so can use any rust features. I guess I should use channels and allow the elements to run in parallel.

I would be interested in any advice on whether there are similar projects already or design patterns for this kind on thing.

Aucun commentaire:

Enregistrer un commentaire