Furniture Design Home: Computer Graphics

Showing posts with label Computer Graphics. Show all posts

Automated Selectivity

One of the reasons we like to look at paintings is that reality is filtered through someone's brain. Painters select the important elements out of the infinite detail that meets our eyes. <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiOdoercYMaTo8RLxPwLdPSoU6mvfXeE_EH_ht1AXHtq9CEGl-_32YQBFmjWtsS_GSY69yZvjwWCicghMIxxQBxSfFPrLi1vxWWyTxaDFL-TjC3ZfUL4pcwkW4IZGbttzclzhYPeoChSsA/s1600/Parker_Night_Call.jpg" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="320" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiOdoercYMaTo8RLxPwLdPSoU6mvfXeE_EH_ht1AXHtq9CEGl-_32YQBFmjWtsS_GSY69yZvjwWCicghMIxxQBxSfFPrLi1vxWWyTxaDFL-TjC3ZfUL4pcwkW4IZGbttzclzhYPeoChSsA/s320/Parker_Night_Call.jpg" width="242" /></a> Here, Al Parker chooses to show us detail in the hands and face. He sinks everything else into a flat tone. <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEis3uAo7TwytyhAkNNhBLQuc18KPN-10yf-iDZOORrL2d8xErTk4ALX1chE88nqhvRiki8KDvM9plu0ReqAjVvrnszglc2GtKlrMv3-zw1ytR6Vjv5q8nRkyWVAUDmyU-sp0DG94iE0HJU/s1600/Sargent.Street_in_Venice.sm.jpg" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="308" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEis3uAo7TwytyhAkNNhBLQuc18KPN-10yf-iDZOORrL2d8xErTk4ALX1chE88nqhvRiki8KDvM9plu0ReqAjVvrnszglc2GtKlrMv3-zw1ytR6Vjv5q8nRkyWVAUDmyU-sp0DG94iE0HJU/s400/Sargent.Street_in_Venice.sm.jpg" width="400" /></a> John Singer Sargent could have detailed every paving stone and roof tile in this Venice street scene. Instead he softened and simplified the background areas and put the focus on the faces. This selectivity isn’t arbitrary. The detailed areas correspond with the parts of the picture that we want to look at anyway.  As we’ve seen in previous posts, eye tracking studies have demonstrated the cognitive basis of selective attention. Viewers’ eyes consistently go to areas of a picture with the greatest psychological salience: things like faces, hands, and signs. We’re hard-wired for it. What happens if you combine eye tracking data with computer graphics algorithms to automate the process of selective omission? Would the result look “expressive” or “artistic?” <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhGpLB4CGsAg5xPqeYjy_bv6Az_D288RCk6rTA0vPToVkCca8AcDVy9ms1zYYeohtvLciT2-wG6xVUTyBKScMZ4fO1h_hArEA3MmmqC_7HO_rucDXsvfl4IVM5H_KgjWY1W9x__renbNug/s1600/Painterly_Abstraction.jpg" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="320" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhGpLB4CGsAg5xPqeYjy_bv6Az_D288RCk6rTA0vPToVkCca8AcDVy9ms1zYYeohtvLciT2-wG6xVUTyBKScMZ4fO1h_hArEA3MmmqC_7HO_rucDXsvfl4IVM5H_KgjWY1W9x__renbNug/s320/Painterly_Abstraction.jpg" width="265" /></a> (Click to enlarge) In his doctoral thesis for Rutgers University, Anthony Santella did just that. The photographs on the left include a set of overlapping circles showing where most people spent their time looking in each image. The larger the circle, the longer the concentration on those areas. Santella combined that data with a rendering algorithm which simplified other areas of the image. In the top image, note the flattening of the far figures and the arches above them. In the bottom image of the woman, note how the wrinkles in the drapes and the textures in the sweater are rendered with flat tones. But her eyes, nose and mouth are still detailed. <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiaP_blwOtVG7eMWcJq6_Zi13jzr7DE0iNo5XpwNMW21o0AKn3slIZqyr_6zNDCeWtp3Dm6piQwM4Ta1VT4ZMyKa7TAdgA8Ci1QbqL8MZxxhDtKaWAMURo7RD2LlIiMlcWC2fOj1BWns8g/s1600/Guitarist_Street.jpg" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="282" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiaP_blwOtVG7eMWcJq6_Zi13jzr7DE0iNo5XpwNMW21o0AKn3slIZqyr_6zNDCeWtp3Dm6piQwM4Ta1VT4ZMyKa7TAdgA8Ci1QbqL8MZxxhDtKaWAMURo7RD2LlIiMlcWC2fOj1BWns8g/s400/Guitarist_Street.jpg" width="400" /></a> The rendering algorithms can be designed to interpret the source photo in terms of line and color. Or the shapes can modulated in size according to the interest factor. Note how the outlying areas of each rendering is simplified. Whichever rendering style one desires, the output image has a sense of psychological relevance, more so than <a href="http://gurneyjourney.blogspot.com/2010/01/automated-painting.html">rendering algorithms based merely on abstract principles</a> such as edge detection. As a result these computer-modified photographs have a sense of something approaching true human artistry. The results of this interaction between eye-tracking data and computer rendering algorithms suggests a heretical thought: What we think of as a rare gift of expressive artistic judgment is really something fairly simple and logical, something you can teach a machine to do. "THE ART OF SEEING: VISUAL PERCEPTION IN DESIGN AND EVALUATION OF NON-PHOTOREALISTIC RENDERING" by Anthony Santella <a href="http://www.research.rutgers.edu/%7Easantell/thesis.pdf">www.research.rutgers.edu/~asantell/thesis.pdf</a> Final two sets of images are courtesy this online graduate thesis.  Previous related posts on GurneyJourney: <a href="http://gurneyjourney.blogspot.com/2009/12/abstraction-generator.html">Abstraction Generator</a> <a href="http://gurneyjourney.blogspot.com/2010/01/automated-painting.html">Automated Painting</a> <a href="http://gurneyjourney.blogspot.com/2007/09/al-parker-at-rockwell.html">Al Parker at the Rockwell</a> <a href="http://gurneyjourney.blogspot.com/2009/11/eyes-have-it.html">The Eyes Have It</a> <a href="http://gurneyjourney.blogspot.com/2008/01/stroke-module.html">Stroke Module</a> <a href="http://gurneyjourney.blogspot.com/2009/09/eye-tracking-and-composition-part-1.html">Eyetracking and Composition, part 1 </a> <a href="http://gurneyjourney.blogspot.com/2009/09/eye-tracking-and-composition-part-2.html">Eyetracking and Composition, part 2 </a> <a href="http://gurneyjourney.blogspot.com/2009/09/eye-tracking-and-composition-part-3.html">Eyetracking and Composition part 3</a> Introduction to eyetracking, <a href="http://gurneyjourney.blogspot.com/2009/02/what-are-you-looking-at.html">link.</a> How perception of faces is coded differently, <a href="http://gurneyjourney.blogspot.com/2008/05/never-forget-face.html">link.</a>

Automated Selectivity

One of the reasons we like to look at paintings is that reality is filtered through someone's brain. Painters select the important eleme...