- » View All
From Creation to Curation, Machine Vision Is Art’s Technical Patron
by Winn Hardin, Contributing Editor - AIA Posted 03/09/2015Machine vision is “boring”. Everyone knows this. It’s an enabling technology that helps robots build cars and empowers Google to drive them. It saves Super Bowl parties by finding bad pixels on an 80-inch OLED flat-panel TV before the big game. It locates hidden cancers in medical patients, saving lives, and helps to protect soldiers from the evils of the night.
Computer vision, on the other hand, is exciting. It must be because artists, video-game makers, and even museum curators all use “computer vision” techniques to create very cool stuff. It looks a lot like machine vision because they use digital cameras and image-processing software on a PC as part of an interactive art exposition, video game, or new tool for classifying lost masterpieces. But it’s not machine vision. It’s cooler.
Call it what you will but machine vision and its cool cousin computer vision are invading every part of the human experience.
Painting With Light
Machine vision engineers don’t have to feel like newbies when it comes to making art. Videoplace, developed between 1969 and 1975, is among the first systems to use a camera, image-processing software, and a display to explore interactive art. Participants stood in front of a backlight and their silhouette was digitized and analyzed. It allowed for up to 50 interactions, including multi-gesture drawing. Myron Krueger originally developed Videoplace to illustrate how people could interact with fledging computer systems.
Currently there is no shortage of artists picking up the digital thread as more art-focused computer programming environments, such as Processing, OpenFrameworks, Max/MSP/Jitter, Quartz Composer, Cinder, and vvvv come online.
For example, Refik Anadol used vvvv software to develop Visions of America: Amériques, a multimedia installation recently shown at Frank Gehry’s Walt Disney Concert Hall in Los Angeles. It included a live orchestral performance of French-born composer Edgard Varèse’s Amériques. During the performance, software analyzed the sound and painted the inside of the auditorium with light and shapes based on different audible parameters. The projected shapes were chosen based on automated recognition of the conductor’s movements during the performance.
Anadol’s work is one of many that have leveraged the low-cost and surrounding software support of Microsoft’s Kinect using projected light patterns, a digital camera, and software to determine the conductor’s pose in 3D space. PlayStation 4’s new camera also is gaining traction due to high frame rates and low cost ($60). This doesn’t mean that industrial cameras don’t have a place in artistic endeavors, however.
Industrial camera manufacturer Point Grey (Richmond, British Columbia, Canada) has been very effective in an area it calls “Prosumer & Entertainment.” Recently, Point Grey’s LadyBug multi-sensor sphere camera helped Brasil360 create interactive virtual experiences built around Brazil in advance of the FIFA World Cup. Point Grey’s monochrome FireFly camera has been named by authoritative digital art blog, Creative Applications Network, as a good choice for artists looking for HD-quality video feeds for their projects. The blog also discusses the use of near infrared, thermal, and time of flight (ToF) cameras as unique tools for developing interactive projects. Other resources such as Jorge C.S. Cardoso’s presentation on how to use differencing, thresholding, color, and object-tracking algorithms are becoming much more prevalent as the use of machine vision/computer vision gains traction in the artistic world.
Vision ‘Cures’ Museum Woes
More evidence of machine vision converging on the artistic world can be found in recent conferences that focus exclusively on the use of automated imaging for art history and analysis. Last year witnessed Zurich’s European Conference on Computer Vision with workshops on “Where Computer Vision Meets Art (VISART)” and in Chicago, The Humanities and Technology Camp (THAT Camp) forum on digital art history. Both workshops brought together computer vision experts with art historians to discuss how image-processing techniques could be used to aid art analysis and curation.
During VISART, presentations covered how computer vision can help researchers develop 3D reconstructions from paintings, authentication, and forensics; computer vision and cultural heritage; and interactive 3D media and immersive environments.
If it’s true that a picture is worth a thousand words, then image-processing tools that can quantify both the truth and beauty of an artwork speak more than volumes —they are priceless.
There are currently no comments for this article.
Leave a Comment:
All fields are required, but only your name and comment will be visible (email addresses are kept confidential). Comments are moderated and will not appear immediately. Please no link dropping, no keywords or domains as names; do not spam, and please do not advertise.