Hotpot and alternative composing at Steim

My alternative notation to make DIY Macroblock video art [background print art by Goto80progress] Hotpot Lab at Steim is a new series of musical events that mixes presentations, performances and workshops. Last week Peter Kirn, creator and editor of Create Digital Music, visited for the second (what is hopefully going to be monthly) Hotpot. Peter did not present any of his own projects, but instead gave an introductory talk, which was primarily focused on alternative notation systems. What alternative systems do DIY artists use for composing? First of all, Peter states that a notation systems is any kind of reflection of the way in which the artist is thinking - (ideally) it exists in a direct line or connection with the brain of the composer. The notation of a composition can therefore occur in hardware or in software; sequencers, iPhone apps and grids (like the monome and the arduinome) can all be understood as alternative notation systems. So what role does DIY have in the development of these (alternative) notation systems? Although DIY often start very simple, these technologies can be grow into very complex systems. Peter shows examples like the pencil lead circuit, Paia business cards, Arduino (which will hopefully become about more then just Arduino) and then mentions more complex technologies like The Brain boards and open sound control (OSC - which gives users the possibility to collaborate). According to Kirn, these DIY technologies give room for more sophisticated and personal notations and compositions. Even though this description of progress sounds linear, Kirn concludes with a comparison of funky ducks flocking on a frozen pond (which made me think of kinky ducks). Just like in nature, where accidental mutations often result in complexity and sometimes progression, DIY accidents could also cause progress and new complexities. While most musicians wait for the perfect product (which will never exist - in fact standards like MIDI rely heavily on error, according to Kirn) these weird DIY products could give opportunity for change. This change does not necessarily need to be better - artists are not looking to make better music perse - they are looking for (better) ways to express themselves. While first these changes will challenge the artist to get away from instincts and intuitions, they will also force them to create new systems of notation. The immediate effect might be destructive but in time these mutations will rebuild and reorganized (mold) into compositional systems that will feel closer to the artists personal expression. DADA DIY alternative notation systems I saw at MOMA last December.

Compression art: visualizing the obscured

Demolish the eerie ▼oid. Music composed by Extraboy.
Extraboy used a rain vst, PIPPO vst and C64 noise to compose a complimentary soundscape.

████ Infinitely pliable, yet holding shape █
Especially over the last century communication has been striving to become increasingly fast and transparent. As a result the concept of immediacy has become one of the key words of this period (at least for media theoreticians).
To answer this wish for acceleration the transfer of information and information objects themselves have been forced to change. Digital compression technologies are used to encode files into fewer bits (or other information-bearing units), to travel faster and further. These compressions reorganize the relations inside and between the data of for instance sounds and images by means of scaling, reordering, and decomposing. Compressions also reorganize the context, time and space of information; basic values on which communication used to depend.

█ Compression █
The language or taxonomy of digital compressions is horribly complex. Looking at a file, first of all there is the file format, which is a ‘container’ of for instance sound and image (think about mpeg, avi or mov). This container possesses the meta-information about what type(s) of compression-decompression protocol(s) - the codecs - are needed to store and transfer the information or to view the data object. This container however does not posses the compression algorithm itself (.avi is thus not a compression but only a container!).
In the second place, a file depends on the specific compression-decompression protocols (codecs). These protocols can in their turn be divided into two groups: lossy and lossless. Lossless compressed files can be rebuilt exactly the way they were before they were compressed; they have retained all information while being compressed. But while in the beginning the development of new audio and video technologies were focusing on the improvement of sonic quality, by for instance the reduction of noise, recent developments seem to lead to a reversal of this trend. Lossy compression has become almost ubiquitous, whereas original (RAW and lossless compressed) information is mostly absent and relatively obese, especially in the realms of digital music, photography and cinema.
New lossy data compression technologies, such as the mp3 data format have made it possible to distribute music easily, but in lower quality than the CD. Lossy data compression takes a distance from the original file. This compression focuses only on the data that is important for the eye and/or the ear to perceive, and discards the information that is believed to be of lesser importance. For video images for instance, perception depends on the thresholds of luminance (brightness) and chrominance (coloring) in space and time. Therefore, video codecs are based on and centered around the transmission of these two values as efficiently as possible.
Most compressions and codecs are relatively concealed; they rarely come to the surface to reveal their true nature - their system of rules. They have been build and rebuild a thousand or more times to be as transparent and invisible as possible. However, as I also wrote in the Glitch Studies Manifesto, the dominant, continuing search for a noiseless channel has been, and will always be no more than a regrettable, ill-fated dogma.
Even though the constant search for complete transparency brings newer, ‘better’ media, every one of these new and improved techniques will always have their own fingerprints of imperfection. Thus, every compression technology will have its visible, or less visible artifacts, that sometimes come to the surface.

█ Compression art █
While some artists believe that lossy compressions harm their work, since these compressions essentially chop away pieces of information, other artists feel that compression is a necessary part of the character of their canvas. They believe that these rigorous forms of compression add certain artifacts that materialize the inherent character of the digital canvas; they (re-)visualize the obscured. The music label 20kbps for instance, is dedicated to low compression music releases; they advertise the extreme low of 20kbps instead of the already low-end musical standard of 128 kbps.
Johan Larsby also investigated the question of how to apply compression effects to audio. He came up with these results (1 and 2). I especially like the fast degradation by feeding back the compression into itself - reminds me of Seb's I am sitting in a room and Universes' digital decay experiments.
In 2002 Ana Kronschnabl released George The Mewvie (2002), which features her cat in extremely poor compression under the header “new films for new machines”. This film gives an impression of what the final film would look like, once it had been encoded and compressed for streaming through a 56K modem, which was the standard at that time. The three-minute long video shows a brown, blocked away moving and purring cat.
The RyBN audiovisual-art collective from France also makes use of lossy artifacts. They describe themselves as specialized in the “realization of installations, performances and interfaces by referring [...] to the codified systems of the artistic representation (painting, architecture, counter-cultures).” RyBNs Monochrome performance for instance, takes place in total darkness and consists of only black sequences extracted from various DIVX movies. The saturation parameter (color intensity) of the black video channel is linked to the sounds master volume. During the performance, the saturation becomes higher when the volume is turned up. This makes several blocks emerge from the previously black screen that obtain their form and dirty yellow greenish color from the DIVX compression codec.
Works like George The Mewvie and the Monochrome performance are not always aesthetically engaging; at times they only show very slow moving blobs. But this (lack of) visual pleasure fits well with the critique they voice towards the progression of digital technologies and the common opinion that digital communication is supposed to be fast, perfect and clean: the dogma of instant pleasure. In the Plugin Manifesto Kronschnabl and Tomas Rawlings instruct the reader to:

Use codecs and compression creatively: There are limits to film online. Size should be limited and there is always the ‘problem’ of compression. But the trick is to use this problem in a creative way and play with it.

Kronschnabel and Rawlings continue their argument by stating that the user should investigate the tools created for the internet and explore what he can do with these technologies in creative terms. Because, as the Camera and the celluloid defined the film in cinema, technologies like codecs and compression artifacts will define the material of the digital (internet) film.

█ Macroblock studies: research in the digital material of film. █
The lossy compressed video image is framed fundamentally different from analog or RAW video footage. First of all, the frames no longer rely upon raw pixels. Instead, macroblocks have become one of the elementary components of the lossy compressed moving image (at least under current standard codecs of, amongst others, the Moving Pictures Experts Group ‘MPEG’). Lossy compressed video often depends on luminance (brightness) and chrominance (coloring) thresholds arranged within 16x16 pixel (more or less) macroblocks within the keyframes (the I-frames) of an image sequence. The thresholds (or frequencies) of chrominance and luminance depend on an oscillating cosine function (following Fourier Transform).
Moreover, the material of the digital film is no longer based on a linear series of discrete images (a sequence); instead the video consists of different kinds of frames (I-frames or reference/key frames, P-frames or forward-predicted frames and B-frames or bi-directional frames), of which only the keyframe possesses a complete matrix of macroblocks. The frames between the keyframes (the P- and B-frames) consist of motion vectors that index only the difference in position (the offset) of the macroblocks between the original and the next frame. The handling of space and time within the video technologies is thus significantly different between the linear analog or RAW footage and lossy compressed footage.
Just like any other technology does, these new digital technologies posses their own specific artifacts. A couple of these artifacts are for instance “macroblocking”, “mosaicking”, “pixelating”, “quilting” or “checkerboarding”. And as is normal with any new technology, there is a growing group of (video) artist exploring these different artifacts of this new and constantly changing digital canvas.
A recently popularized wave of video artworks was based on the deletion of keyframes and the exploitation of the vector motion of P-frames. I described this current, which is dubbed datamoshing, pixel bleeding or just compression art, in some earlier posts.
A bit more obscure (partially because maybe the results are a bit less magical) is a related strategy that doesn’t rely on the deletion of keyframes and the exploitation of motion vectors, but on the exploitation/bending of chrominance and luminance algorithms of the Fourier Transform thresholds of the macroblocks. This method visualizes the otherwise mostly obscured macroblock structures of digital video.
The non-technical term macroblocking thus refers to compression/noise artifacts in lossy compressions, that shows up when for instance some data of chrominance/luminance is broken, the FTT cosine function itself is bended or some video image data is for instance edited in a hexeditor.

███ Demolish the eerie ▼oid █
In "Demolish the eerie ▼oid" I exploit macroblocking, by opening a DV file in texteditor and playing around with the code.
What became clear to me is that multiple things can happen – and I am not sure (yet) what pieces of code trigger what results. In one of the first tries I encountered some quite mystifying, but nice new organizations of color (chrominance) structures. The matrix of macroblocks is still completely intact but the chrominance values are ... off.

The structure of the video is still intact - you can still recognize me when you look very close/pay attention. The extreme color shift make it hard though.

The matrix of macroblocks holds some puzzling but pleasantly surprising opportunities. It can also be rearranged.
But most of the bends have the more usual outcome: a carnival of macroblocks and an ambient landscape of noise, flickering back and forth, confused and agitated about its proportions.And to finish a dessert of mess: when I open the file in VLC player, I got some nice RAM glitches when change the size of the videoscreen.
The data of the file is so high that the player can only show the image with parts of what is still in the buffer.

██████
Kronschnabl, Ana, and Thomas Rawlings. Plug in Turn on: A Guide to Internet Filmmaking. London: Marion Boyars Publishers Ltd., 2004.
Mackenzie, Adrian. “Codecs.'' In: Matthew Fuller, ed. Software Studies. Massachusetts: MIT Press, 2008. p. 48-55. p. 36
Mackenzie, Adrian. "Every thing thinks: sub-representative differences in digital video codecs". Institute for Cultural Research
Mackenzie, Adrian. "Codecs: Encoding/decoding images and sounds"

The music label 20kbps can be found here
“ARTKILLART / CIMATICS.BE.” AKA/CIMATICS.
monochromatiq. “MONOCHROME.” INCIDENT.NET | MONOCHROME |
TUBE:MONOCHROME | RYBN.ORG.

Special thanks to Emilio Pozzolini, euphotic/Al Astakhov and Extraboy/Anders Carlsson.

//Budapest Micro3

Saturday, 13 March 2010 I will be doing the visuals for Goto80 and Failotron. Other artists include Kelsey (Andre Kormos) and JDDJ3J. The website also promises pony's, Vulcans, black holes and more...

// Sonic Acts XIII :: the poetics of space

 ∆   ∆ 

Next week (25-28 Februari 2010) I will be blogging from Sonic Acts for their website. The festival focusses on themes like hybrid and expanded space, utopian spectacles and invisible architectures (amongst others). The festival only takes place ones every two years, but was the last time I visited it by far the most inspiring/brainwarping four days I have experienced. The title poetics of space is derived from the English translation of La Poétique de l'Espace (1958) written by the French philosopher Gaston Bachelard. In this work Bachelard meticulously describes the influence of space and architecture based on experience and imagination, an approach that is not only rooted in science or functionality (according to the booklet, which can be downloaded here) The banner above is my own (glitched) fearless fold flyer-version.

Videoscapes update // video portfolio

▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒████

Eerie ▼OID trilogy

I stare at a void of knowledge; a strange dimension where the laws are suddenly very different from what I expected and thought I knew. Here is the purgatory; an intermediate state between the termination of the old form and a judgment for a possible continuation into a new form, a new understanding... V•o•i•d |void|• /not valid or legally binding. /the black void of space. /Empty and evacuated.

Interview for Klik Magazine (Slovenian print)

After my presentation of the Glitch Studies Manifesto at Pixxelpoint, Blaž Erzetič, the technical director, asked me to do an interview for Klik magazine.
The final interview is now finished and printed and looks beautiful and mysterious (its translated in Slovenian).. I am however quite sure these are some of the things it says:

>>What is glitch art?
A glitch is an unintended break of (one of) the many flows within a technological system. It is a wonderful and frightening interruption that shifts a technology away from its ordinary form and discourse. For a moment I am shocked, lost, in awe, asking myself what this other utterance is, how was it created. Is it perhaps ...a glitch? But once I named it, the momentum -the glitch- is no more…
The glitch has no solid form or state through time; it is an ephemeral, unexpected, abnormal mode of operandi. As the understanding of a glitch changes when it is being named, so does the equilibrium of the (former) glitch itself: the original experience has vanished into a realm of new conditions and the visual or audible outcome has become a new, actualized possibility.

In my 'Glitch art’ work, I portray the point where glitches and art meet.
To me, glitch art is about the stretching of boundaries and the generation of new modes: as an avant-garde of mishaps these works break up previously sealed politics and force a catharsis of conventions, norms and believes. They create a procedure in which I can learn and become more aware of a technology.
But in reality, not all that is referred to as glitch art follows the creation-through-destruction paradigm, or is an art of the momentum; many works have already passed their tipping point or don’t involve ‘real’ glitch processes at all.
For a long time I struggled with the question if ‘glitch alike’ can (or should) be referred to as ‘glitch art’. Today I think one answer to this question (besides the obvious idea that in these cases the word glitch is used metaphorically) can be found within the fact that a work of glitch art exists within different systems, for instance within the system of production and the system of reception. While the actors within the system of production did not necessarily damaged anything (and did not experience the work as creation through destruction), the perceiving actors, the audience, can still identify the technology as being destroyed. To them, these works can still stretch boundaries and create awareness and therefore be glitch art.
I can now appreciate other artists calling Photoshop experiments or noise filter creations ‘glitch art’. I think a difference lies in the fact that these works focus on a design, or end product. While personally, I like to create procedural glitches that I involve either data corruption or broken hardware and that teach me something about the technology.

>>I have seen from your previous works that you mainly work with video. What techniques do you usually use in these works? Some of them are also real time (VJ-ing). What about hardware? Did you develop any hardware of yours for glitching purposes?
Besides the video works, I do many things. One of my favorites is 404void.iq, which is based on internet research into a destroyed web.
[But]... I switch very often between different media (modern computers, consumer electronics from the 1980s, photo cameras, codecs, audio, ROMs, image file formats). My work does not focus on oppositions like for instance hard and software, real versus virtual or analogue versus digital. Instead, it is mostly an attitude towards all technologies that are controlled by rigid laws (I refer to this as critical media aesthetics). I explore what happens beyond these laws, as an investigation into the unreasonable.

I have given circuit bend workshops and made my own video black boxes in the past, but I am not so much a savant or teacher as an explorator. I cannot program and I only learn by trying and failing.
I think that glitch studies is a very complex studies that takes place between disciplines and categories of both theory and practice, sense and nonsense. Without a nonsense approach, glitch studies cannot exist – to me this means I am free to do anything I cannot do.

>>What comes next? What is some new technology in sight that you can’t wait to put hands on and dismantle its primal functionality?
I moved from the grain of celluloid to the magnetic distortion and scanning lines of the cathode ray tube. I wandered the planes of phosphor burn-in, rubbed away dead pixels and now watch performance art based on the cracking of LCD screens. I don’t plan; I just surf within vortex of technology. But yea, maybe it will be a floppy.

//Some more registration of Blip Festival

The first one is me and Paris doing visuals for Nullsleep. Its quite a dark part of his set, and when I saw it back I really enjoyed it.
The other 2 videos are of Little-Scale set (who won the chip artist of the year-award last weekend) which I did alone. The videos overlap and show some of the glitch manifesto as well.