technical setup of darkmatter

containing all cached data + wordnet database

connecting to the internet (eth0, dhcpclient) and the visualizer (eth1, 10.0.1.1)

processes running on this one:

• database storing all words (wordnet relations, web-scraped tags,…)
• database storing related cached pictures (900.000 of those for now) + sound, video (todo)
• webserver handing out locally cached media to visualizer pc
• python scripts crawling the internets, analyzing & inserting tag relations into db
• java applications retrieving media from flickr, youtube, freesound,… and caching media locally
• puredata running synthesis patches, communicating over OSC (for the moment this is done on maxmsp)

basically it retrieves and stores and analyzes the whole bunch of data

network connections to the camera over ethernet interface (eth1, 10.0.0.1) and towards data-containing machine (eth0, 10.0.1.2)

processes running here :

• darkmatter proce55ing sketch (java) (communicating to camera-driver using closed source linux SDK with homebrewn JNI lib)
• computervision (OpenCV JNI lib) to interprete image (running avg background / thresholding / calculating inertial moments / line sampling)

basically

• it gets data in from db/cache, camera and
• outputs video signal to projector sends some OSC events to the audio synth

• XenICs Gobi – thermal imaging camera, captures far infrared radiation (all bodies radiate electromagnetic waves) – it connects over the network (10.0.0.2) to the visualizer

basically, it sends an greyscale image 384×288 with a temperature value for each pixel