February 27, 2010

Let's see how an environment responds to my fist in your face!

Krueger’s article, “Responsive Environments” begins with his description of his own work on creating environments that respond to participant action and follows his a description of how he believes human-computer interaction should be and how it can contribute to many different fields. Krueger’s projects have followed a theme in which participants enter a room with pressure sensitive flooring, and a computer responds to the participant’s actions in different ways. The first project that Krueger was a part of was GLOWFLOW (a computer responded to participant footsteps by creating sounds and lights, but the effects were delayed, so the participant had no idea of their impact on the environment). Krueger evolved that idea with METAPLAY (an artist in one room interacted with a participant in another by drawing images that would be projected into the room that the participant was in). This expanded on GLOWFLOW by adding an element of interactivity between the participant and the environment, because (s)he could interact with the artist, influencing different creations. PHYSICSPACE was similar to GLOWFLOW, but the participants were aware of how their footprints affected different sounds and how they could influence them with their movements. MAZE used physical movement to control an avatar to navigate through a maze, and VIDEOPLACE (a work in progress) will allow video interaction between people in different rooms.

Krueger makes the argument that the response is the medium saying that it “has the potential of being more rich and variable in some ways, than reality itself” (384). He claims that with the variability of video production, a person can interact with the environment more fully because the avatar can, for example, be shrunken down, fly, grow, flip/rotate, etc. He also emphasized that it is not the attractiveness of the visual/auditory response that is important, but that the response establishes a relationship between the observer and the environment, which is what Krueger calls, “the central theme” (386).

From his argument, Krueger risks criticism from those that believe that a more visually appealing environment is more important than the response itself. Krueger states that the means of output are not nearly as important, saying, “it may be desirable that the output not qualify as beautiful in any sense as that would distract from … the relationship established between the observer and the environment” (386).

Given that Krueger has quoted much funding from the University of Wisconsin over the course of 30 years, it can be assumed that he has conducted much research at the university and is probably a faculty member (379, 380, 384). The intended audience of this article are those that hold stake in the future of teleconferencing, because he makes several references to the field stating how his research advances the current standard providing “an infinitely richer interaction than Picturephone allows” (388).

---------------------------------------------------------------------------------------------

Throughout my reading of this article, I had trouble understanding what Krueger meant by “Response is the medium.” It was not until I finished and began to think of relevant examples that I came to understand how attractive computer response can be. It is a concept that is now being fully developed and helps to make current forms of new media seem archaic and dull. Applications of response can be seen in video games, personal computing and artificial intelligence.

The first example that really made me believe how much of an effect computer response has on a medium is an analytical viewing of the current video game console war. There was a drastic break off this generation, when Nintendo decided to take their console in a new direction. Last generation was all about graphical improvement, which was not Nintendo’s strong suit, so with the release of their console in 2006 (officially dubbed as the Wii), users were introduced to a new kind of console gaming. Gamers are no longer restricted to the two control stick scheme, but now use a motion sensitive controller that responds to the users’ movements. Now, playing digital tennis is no longer dependent on button mashing, but requires a flick of the wrist in order to make the onscreen avatar swing the racket. This can make gaming more interactive and makes one feel like they are actually accomplishing something when they play. Even though other systems like the Xbox 360 and Playstation 3 are more powerful, having games that display better graphical technology, the Nintendo Wii has by far been the better selling console. The success of the Wii is proof that Krueger is right in his assertion that response is the medium.

This idea can also be applied to personal computing, where multi-touch technology is becoming the next big thing. Though the technology is relatively old, the new applications for it are becoming immensely popular. Apple has seen great success with their iPhone and iTouch, and other companies have been bringing in the use of touch technology. More applications of this tech can be seen in the following video:

http://www.youtube.com/watch?v=-2Kn2HKCWqs&feature=fvw

The response from the computer is shifting from mouseular point and click operations to physical touch and move gestures. These transparent interactions make computers more approachable and easy to use.

Finally, computer response is a very important application in the development of Artificial Intelligence (AI). It is a very popular research opportunity to make computers seem more human. If computers can respond to people humanistically, it is the ultimate form of computer transparency. This transparency comes from the way the computers respond to human action. Some example can be seen in the following videos:

http://www.youtube.com/watch?v=P9ByGQGiVMg

http://www.youtube.com/watch?v=tdEoD10-Uvk&feature=related

The success and attraction of these technologies is because of the response, which shows that Krueger has made some accurate assertions.

I propose the following discussion questions:

1. This kind of technology is a little scary to me, because it is possible that with complete transparency, people could forget that they are interacting with computers. Are my fears at all justified, or is the development of AI a masterful accomplishment that should be welcomed? What kind of things could go wrong with the development of AI?

2. In what ways do these technologies improve the humanistic quality of life? In what ways do they worsen it?

3. Many scientists agree that there are technologies that never should have been created (ie atomic/hydrogen bombs). Could the development of AI have similar ramifications? Should we develop it just because we can?

6 comments:

Sean March 3, 2010 at 6:04 PM  

Artificial Intelligence seem like more of a novelty to me at the moment than anything of a threat. With all of our processing power and programming mastery, we are still unable to create perfect and transparent AI, even in digital realms. Even when a machine gives the appearance that it is learning (as in the ASIMO video, which was very interesting)it is still only executing commands and storing memory. It's "learning", while impressive, is only observation and memorization. The true point where AI will be mastered will be when a computer can independently create information and execute a command that it has created without human aid. Until this can be done, I think that AI is nothing that can hurt anyone in a physical form.
Of course, when an AI system is able to do this, even in a simplified form, it will also have the ability to build upon it's own knowledge and create even more knowledge, creating an Intelegence snow-ball, somewhat like the way that humans develop and learn. The dangerous part is that they may be able to do all of this and develop in a matter of minutes rather than years, like humans do.

Zach March 4, 2010 at 11:17 AM  

I think what Sean mentioned about current "AI" is definitely an important thing to remember. No matter how real and spontaneous it may seem at the moment, it has been in some way planned by a programmer. However, when technology and our understanding of the human mind does advance to a point where true independent thought and learning is possible, it is scary to think about how quickly AI will potentially be able to advance itself. I remember reading a very long time ago that a computer program had been designed to simulate evolution. In the experiment that was run it took a standard TV antenna and, after running many calculations and tests, found a new design that was theoretically much better. It did it all by making one design, running a simulation to test its effectiveness, and then it tweaked things and measured what changed. This level of computation would have taken people an enormous amount of time, but a computer could do it overnight, or even shorter. I think that is the idea behind all of the fears of AI, and the ideas certainly seem to have merit. In reference to the game Mass Effect, which I know Karl and maybe some others will understand, the Geth come to mind immediately, and look what harm they (seem to have) caused.

kaitline March 5, 2010 at 12:53 PM  

The idea of AI can be frightening when we look at how much media has shown us to be afraid. There have been tons of movies created on the subject of technology taking over. I, Robot in particular comes to mind. I see the world of technology as exciting because honestly, I would love to have my own R2-D2. However, I can understand Will Smith’s fear in the movie of these robots and especially after how they react to him. I am frightened of the idea of an apocalypse. I really don’t want my college education to be for nothing. Thankfully, I don’t think AI technology is there yet (at least not in the states, maybe in Japan?) Anyway, in the example of I, Robot, the world features these robots who are “friends” of sorts with the people and at times they act as slaves to the humans while being their companions as well. I think it is only a matter of time before something like this becomes a reality and we are living in a Jetsons world with a robot maid and even a robot dog…unfortunately without the flying car though…that’s a whole different argument.

Lauren March 5, 2010 at 7:00 PM  
This comment has been removed by the author.
Lauren March 5, 2010 at 7:15 PM  

The debate behind Artificial Intelligence is a complicated one that is often shown in movies (AI, I-Robot, Matrix) books, comics or TV shows. The fear of humans being overrun by robots or replaced by them is usually at the heart of this argument. It is a valid one in some respects, as we have seen automated robots have indeed replaced workers in countless industries but I don’t believe robots are likely to overrun the earth at their present capabilities. Artificial Intelligence would be the necessary component for something like this to ever happen, but I believe that if scientists have the capability to create AI then, in this case, they would also have the capability to control or put limits on AI. I personally think privately owned, lifelike functioning robots would be awesome. The uses would be endless and various. But (and there is always a but) by eliminating people from certain aspects and places in society could come with a high price. An example that comes to mind is replacing soldiers in the field with human like AI robots, so there is no human life lost however some would argue that war would become nothing more than a game, because any loss that is felt doesn’t amount to the loss of a life, so why not wage war? Another side of things would be to look at how much humans already rely upon technology and the ease it provides us as well as the laziness it allows us. Would it really be in humanities best interest to eliminate the need to do any real work? I don’t believe so. People already rationalize not needing to know complex math because calculators can do it for them. This is only the tip of the iceberg unfortunately.

mehawley March 5, 2010 at 9:29 PM  

I am astounded by the technology featured on the YouTube clip about the future of the computer interface. The fact that the interface can process more than one physical manipulation is quite akin to real life. However this responsive technology goes beyond the humanistic capability allowing users to increase and reduce the size, affirming Krueger’s argument that response as a medium “has the potential of being more rich and variable in some ways, than reality itself” (384). The computer interface is reacting to the human user is many more dimensions than the conventional one point click.

One thing that is of concern is the appropriate interactions between the new technology and the user. I can foresee a privacy issue with the smart table, featured in the clip, such as it taking information from one’s phone or camera that was meant to remain private and undisclosed. This is response and interaction taken beyond the limit. This goes back to what Moulthroup says about considering the impact of new media; he asks “What does [the new media] become when taken to its limit?” (NMR 701). All new media has the potential of being taken to an unhealthy limit and these should be taken into concern in all new medias.