Marco Martinez

Since 2015, I have been working closely with Sapien, LLC and Colorado State Unversity to develop a sound-to-touch sensory substituion platform. Using hardware built by Sapien, I have created research software tools, demonstration apps, example code, and a Java API (see Tactile Waves) to help our multidisciplinary team create non-invasive auditory prosthetics. With the sucessful launch of the Cthulhu Shield Kickstarter, the project has grown to include other types of sensory replacement and augmentation, as well. For more information on the Cthulhu hardware, visit Sapien's kickstarter page.

Most recently, I created 2 example/demonstration apps that show how to use the Cthulhu Shield with an Android device. The first app captures video from the device camera, finds regions of motion within each frame, and activates a Cthulhu device in response to this motion, giving a low-resolution tactile "T-Rex Vision". The second app uses Tactile Waves to capture audio and extract formant frequencies in real-time. These frequencies are used to create stimulation patterns on the Cthulhu, yeilding "tactile sound" on the users tongue. Source code for both applications is available here.

Tactile Waves in an open source Android/Java library for audio processing, feature extraction, and sound-to-touch sensory substitution. Originally developed as a sensory substitution research and development tool, the project has evolved into a comprehensive audio/speech processing library for music visualization, VJing, audio FX, and other creative audio work. Currently, I am porting elements of the library to C++, and have begun work on version 2.0, which will include some exciting new features and algorithms. I also have plans to build a version of the library for Processing so users can more easily build Java programs that take advantage of Tactile Waves' powerful audio engine.

This project has a dedicated website with links to documentation, downloads, and source code.

My corresponding thesis publication for this project is available here.

For the past several years, I have been developing free plugins for Ableton Live, using Max For Live. With these plugins, I aim to provide advanced signal processing techniques that would otherwise be out of reach for a typical Max user. My currently available plugins include a suite of mixing and mastering tools for phase correlation, perceived loudness metering, volume metering, and spectral referencing. A custom DJ control surface for the Push 2 and similar pad based controllers is currently in development, as well as a motion tracking modulator that converts motion from a video source to parameter automations.

Visit my Max for Live developer page for more info and downloads.

LH Duo Filter is my first publically available audio plugin (VST). This plugin implements a custom dual-mode low/high-pass filter using JUCE. Turning the CUTOFF control clockwise will apply a 12 dB/octave high-pass filter to the signal with an increasing cutoff frequency. Similarly, turning counter-clockwise will apply a low-pass filter with decreasing cutoff frequency. The MODE switch will toggle between two different filter types. The first is a clean biquad filter (from Tactile Waves), and the second is a custom oversampled state variable filter with added saturation/waveshaping. The RES knob can be used to control the filter resonance, while the LINK switch will allow the resonance to be adjusted automatically, according to the CUTOFF position.

This plugin is perfect for live performance/DJing. During buildups and transitions, low or high-pass filtering can be applied to a sound using just one knob, freeing up the performers hands and controls for other effects. It is also useful in the studio, as its fully automatable parameters allow for precise control of filter sweeps in an arrangement. Because of the plugin's low performance overhead, it can be thrown on several tracks in one session without using up available resources.

FREE downloads and source code coming soon!

The Love Project is a massive, mirror-finished stainless steel statue conceptualized by Fort Collins steel artist Rick Reider. I worked with Rick over the past few years to help bring his creation to life. Starting with 2D drawings and 3D CAD models, I helped Rick design each letter to be visually pleasing, structurally sound, and manufacturable. I then created photorealistic renderings and 3D printed models (pictured above) to visualize the design, and finally DXF cutting files for the guys at Colorado Waterjet. The statue is currently being manufactured in Rick's Fort Collins workshop. More information on this project can be found on Rick's website here.