A little experiment with Pure Data (aka Pd) running a patch using a webcam for data input. Motion detection results in three sets of continuously changing values that are converted to MIDI note and controller data. The MIDI output is routed to VCV Rack for the final conversion to audio.
Pure Data with GEM is required for this patch, along with a webcam, of course. The original Pd patch for webcam to MIDI conversion can be found at http://hotchk155.blogspot.com/2010/05/webcam-motion-detection-to-midi-with.html. My version of the patch is located at http://linux-sound.org/misc/motionnoise-dp.pd.
You’ll also need the following plugins/modules for VCV Rack:
Amalgamated Harmonics – Progress Mk II
Audible Instruments – Macro Oscillator
Autodafe – 1×8 Mult
Frozen Wasteland – BPM LFO
Impromptu Modular – Clocked, Tact-1
JW Modules – Quantizer
NYSTHI – 4DCB
RJModules – Button
Squinky Labs – Form
Stoermelder – 8Face, uMap
SynthKit – Clock Divider
Valley Audio – Plateau
VCV – Octave, VCO-1, Mixer, 8vert, VCA-1, Audio-8, MIDI-CV
Wiqid Anomalies – Dual Attenuverter
The Bogaudio DGate and VCV ADSR are pictured in the screenshot are unused.
Deep thanks to all the developers & users of VCV Rack !
19 July 2020