Sound and Music in Video Games - Aaron McLeran
Camshift for Tracking Colored Moving Objects - Javier Villegas
A music project using and demonstrating the Fmod ex audio engine system - one of the more popular game audio middleware C++ APIs. Also an experiment using OSC with FMod and a rudimentary implementation of generative music functions.
Download: Go to Web Page Browse Code Project Report
This project is a real time computer vision system capable to track objects by looking its representation in the Hue plane. The algorithm uses a modification of the mean shift algorithm (camshift) over the backprojected histogram of the hue of the object of interest. It was implemented and tested using the OpenCV library over the Windows ñ P.C platform, and was programmed using Visual C++ 5.0.
Download: Go to Web Page Code Archive
Media Service Using Red5 and Adobe AIR - Olav Nistad
An implementation of a media server and client(s) that can stream video and music from a server using the java based, free and open source version of Flash Media Server called red5. The clients are implemented as Adobe AIR applications - the latest development by Adobe which is still in the beta stage. Since AIR applications are hybrid - that is half web applications and half desktop applications - there is a big variety of opportunities to take advantage of.
Download: Project Report
Process Sonification - Sirichai (Yoshi) Pintongkam
A simple and pleasant way of relating relative changes in the computer system with minimal interference with audio cues. Repetitive (and hopefully less obtrusive) exposure to audio mapping of the changes in computer system should help familiarize user with his own computer system's behavior. The initial goal is to create audio representation of a program/process relating its behavior to the overall performance of current computer system status.
Download: Project Report
Multi-Touch, Consumers and Developers - Charlie Roberts
Controlling a Dot Matrix LED Display with a Microcontroller - Matt Stabile
This project is a library in Processing that enables basic UDP streaming of video. At a bare minimum, the library streams JPEG compressed images over UDP, moving on from there to explore h264 compression and the addition of audio. No such library currently exists, and it is a valuable addition to the Processing environment.
Download: Project Report
This project is the realization of a spectrum analyzer on an LED Matrix controlled by a microcontroller. The microcontroller being used is an Atmel Atmega128 which will convert an input signal (music) into a digital signal, perform FFT operations on the signal, and then send the proper control signals to the LED Matrix for display of the spectrum at discrete frequencies. This process will occur in real time and the goal is to construct a large LED matrix (16 x 16) that can be mounted on the front of a bass speaker cabinet for use in live performances. The first implementation of the analyzer will be on a smaller 8 x 8 matrix for testing purposes.
Download: Project Report
An Implementation of MVC with OSC and Chuck Programming Language - Pablo Colapinto
An implementation of model-view-controller with OpenSoundControl and the Chuck programming language
Download: Project Report
DSS - Compression Audio & Video Test - Andres Burbano
Darwin Streaming Server - Compression Audio & Video Test. Because Darwin Streaming Server is an open source project supported by the community, I want to contribute doing an analysis of some alternatives of compression in video and audio.The alternatives selected are:
Video compression: H264, MPEG-4, JPG 2000.
Audio compression: MPEG-4 Audio, MACE 6:1, Miu-Law.
The conclusion is simple, there is no only one alternative (H264) for Video Stream using DSS, it depends on the ideas and objectives. So here is some information that can be useful to take a decision, have a look and decide what to do.
Project Website: DSS - Compression Audio & Video Test
Hidden Markov Models - An Introduction to Gesture Recognition - Phillip Pop
The Hidden Markov Model allows computing devices to model the uncertainty of an observation; the same uncertainty we humans encounter in everyday life. Rightly so, it has found ubiquitous use in human machine interfaces such as speech, handwriting, and gesture recognition systems. The paper offers an introduction to the mathematical theory behind Hidden Markov Models, paying particular attention to the algorithms used to implement it. It also gives a short survey of current Hidden Markov Model uses, as well as reviews a joystick recognition system that utilizes the Hidden Markov Model. The joystick recognition software is also available for download, and it recognizes several predetermined shapes as they are drawn by the user.
Download: Project Archive Project Report
Orrery MVC - Greg Shear
The Orrery concept began as an exercise in properly utilizing the model-view-controller paradigm. In this case, the model is that of objects in simple orbital motion. A Cocoa GUI window offers both a basic view of one parameter of an object, and a way to control another parameter of another object.
Download: Go to Web Page
String Instrument Recognition - Larry Wu
The goal of this project is to use the frequency domain processing to decompose a guitar signal into separate sections. The decomposition may involve various methods of audio segmentation and transient detection. For example, in the frequency domain, we may see that the magnitude of a particular STFT frequency bin was more-or-less steadily decaying, but then at a certain time the magnitude greatly increases. We can surmise that this might be an "attack" (plucking of a string).
Download: Project Archive Project Report
Autopoietic Systems - Mariano Mora
The paper offers a brief summary of autopoietic systems, history and concept as a theoretical tool, with a background on general system theory. It touches on the many-sided applications that have been found for them and later focuses on already realized aswell as possible artistic projects that make use of the idea of self-generating systems.
Download: Project Report
