Abstract Reality

[image by flickr user Drewje]

In preparation for Where 2.0 next week, where I’ll be on a panel called “Mobile Reality,” I wanted to jot down some recent thoughts on the matter, both as a way of helping me better understand what I might say next week, but also a kind of beginnings of a more deliberate effort to think through some of the projects I’ve been involved with recently, both at work, and on my own stuff.

(I should mention that all of what comes next is entirely in the context of my personal work, and in no way is endorsed by or has anything to do with my current employer.)

I guess Mobile Reality is an attempt to define some different kind of Augmented Reality (AR) that is about focusing more on real spaces and location awareness, and stuff that runs on mobile devices. (Although AR in general I think is based around the same ideas idea of “enhanced” mobility). So perhaps this new variation is slightly redundant, except maybe to contextualize this stuff as being available on “today’s” mobile devices instead of on some crazy setup with a 100 pound backpack full of gear. In any case, I’m going to just refer to this stuff as Augmented Reality, and completely ignore the whole hologram side of this, where you show your computer’s camera a AR Code, and some 3D model is magically displayed on top of the code. That’s just called magic. [note: see this]

So most instances of Augmented Reality don’t interest me a whole lot. Julian’s been writing about a bunch of overlapping ideas, so I’m not going to spend much time discussing why I’m not 100% on board for this particular vision of the future. As He writes,

All [this] kind of stuff that would turn spatial experiences into some kind of database inquiry seem very much different from what I enjoy about the world when it is mixed with humans — curious interpretations of objects and moments that are not salted with uniform resource locators, pop-ups, soft synthesized voices telling me that I’ve got mail or to turn right at the next intersection.

What he’s getting at here is important, at least to me. The entire idea of many types of AR is to ostensibly make our lives easier, to help us learn about our environment. See Wikitude for a pretty insane example of how this kind of future might look. But in this entire process of becoming more at one with the world through this technology, the world becomes entirely mediated by a computer. It literally becomes a simulacra of itself, as though we weren’t close enough already. In some cases, AR requires use of special glasses that beam the real world into your vision through a camera mounted on the glasses, effectively taking the human part of you completely out of the physical world that the system is supposedly augmenting.

There’s a kind of Uncanny Valley effect that goes on in these experiences. The more that reality is augmented, the less real it becomes. The similarities to the Uncanny Valley here is not surprising considering that AR is a descendant of virtual reality, which itself was an offshoot of computer graphics, where the term comes from.

Clearly in this genealogy, there is a tendency to try and make virtual things real. AR I think is a little different in that it aims to (by definition) make the Real World itself more real, or at least more defined and accessible. In all cases, the inclination is always, “wouldn’t it be cool if…”

Ok, so that’s enough of that. But what I, and I think probably lots of other folks are interested in, is the idea of applying Augmented Reality to virtual spaces. This is the idea of lots of pervasive games and stuff, layering virtual worlds on top of the real world. This concept video from HP is a pretty archetypal version of what this kind of entertainment looks like. A kid, using his HP device, sees a virtual world layered on top of the real world. He’s running around, dodging virtual enemies in the streets, navigating the normal, real world which acts a kind of game field. So this is kind of one of the promises of AR as well, a way to create mobile and pervasive game spaces that blend (or mix) realities.

I think this stuff is pretty cool, in general. I think everyone is on board with the idea that your real life can kind of turn into a game at any moment, your cubicle or whatever turning into some kind of evil lair. If you haven’t seen The Game, or heard about Majestic, maybe you should check those out if you are interested in this kind of thing.

So, most of these type of things are based on this idea of spatial correspondence. If I’m in a park in the real world, there is some virtual space I’m walking around at the same time, that shares the spatial characteristics of the real world. The virtual world is the real world, reskinned, with enemies and obstacles that conform to the same constraints as you would in the real world. The HP video linked above is full of examples of this. I was also part of an early attempt to do similar things (albeit much weirder). Using spatially correspondent worlds makes sense I guess if you really want to turn the real world into a game board. Paradoxically, this kind of Augmented Reality really does more to connect you with the real world, forcing a more complete connection with physical space as you navigate the virtual layer.

In trying to define this kind of stuff, I’m realizing that the kind of stuff that I most interested in is similar to the virtual worlds stuff, but much less concerned with spatial correspondence.

I’m really compelled by the idea that mobile games or other experiences can be used to further connect people to physical environments. At the same time, I’m realizing that my work, and the work of others that I find the most interesting in regards to this, is really experimenting more with the idea of Abstract, or Abstracted Reality. To me, this is more like using aspects of the real world as game pieces rather than using it as the game board itself. There are any number of components that define the real world, from concrete objects like trees or buildings, but also less tangible things about how we interact with the real world like distance, speed, if this house is my house or this bar is where I meet my friends on the weekend.

This is one of the nice things about foursquare, for instance. On the face of it, it’s a type of mobile social network where you can see where your friends are. The thing that’s interesting to me about it though, is that it begins to use some of these more abstract layers of space (call it place, if you want) in a game context. For example, if I check into my bagel shop 3 times in one week, I unlock the “local” badge, or if I am at my local pub more than anyone else, I’m deemed “the mayor” by the game. In this way, dennis and naveen are using a more abstract concept of the physical world, one that connects me to my world a lot more than seeing some pop up overlay of the pub menu, or a little sound blip that tells me where the nearest place to get beer x is. (clearly, it’s getting closer to the beer part of the day…)

It’s probably also useful to look at how traditional games go about getting players to figure out the game environment. Games are often all about figuring out an environment, whether it’s a puzzle, or figuring out how you can get up to the coin on that high platform. But that’s probably enough of this for now.

GDC Mobile wrap

This season, I had to limit myself to one convention.  I chose GDC, or specifically GDC Mobile. This was a mistake.

GDC mobile is technically a summit that takes place in the pre-dawn of the more hyper-capitalistic main show.  On paper, it should have been a amazing place to showcase all the building excitement around a mobile games industry that until about a year ago, was completely lost in the woods, handicapped by poor controls, impossible business models, and a general lack of creativity.  As Neil Young said in his opening keynote, the iPhone “has changed everything.”  Strangely enough then, despite all this innovation, the selected sessions chose to more or less ignore that there was anything interesting going on in this area.

So maybe that’s a problem, or maybe it’s more indicative that the interesting things in mobile are not necessarily *mobile* problems any more.  They are design problems, which need design solutions.  Mobile games are no longer just these weird little things with bad graphics and poor experiences that you port IP to the same time you are figuring out which logo to use for the t-shirt.  No, with new platforms (not just the iPhone), now this is a platform that can be leveraged to build interesting new things, and as a community, we need to start learning to talk about these things in a passionate and interesting way.

It’s nearly unfathomable to me, for example, that Fieldrunners, a simple tower defense clone won the “best game” category.  That’s not really to take anything away from the developers, who executed the thing nicely, and the game is probably super fun and everything.  But this seems to me like a good place to highlight innovation, and all apologies, but I don’t think that adding tilt controls to something that could be experienced just as well on my desktop counts as innovation in a mobile game.  It’s not really taking advantage of all, or really any, of what the platform has to offer.

But I should stop before this becomes a rant against casual games in a mobile context and mention that my favorite, at least most well-worn, iPhone game is Drop7, area/code’s soduku style stacking game.  Not all games have to be GPS enabled, use the camera, or have some wild concept with the word “pervasive” or “ubiquitous” in it.

In fact, I found that the so-called “pervasive” mobile sessions were equally lacking – just in the reverse direction.  Sessions exploring AR (augmented reality) games, or the use of sensing devices in gameplay, were completely devoid of passion and fun, and demonstrated an alarming willingness to elevate technological novelty over engaging design.  It’s hard to scold Fieldrunners for being boring when the so called “cutting edge” of Augmented Reality highlighted a tower defense game ( it just happened to be one that you had to have a whole bunch of technology to play).  At least Fieldrunners looks kind of fun.

Of course, maybe this isn’t really the point.  Researchers are doing research, not necessarily game design, and there’s a whole other set of stuff going on that informs the output.

All of this was demonstrated nicely by the fact that the best talk on mobile game design of the week was given by Frank Lantz as a keynote for the Serious Games summit.

The real issue here is that I wanted to hear from people that were making mobile games, particularly mobile games that weren’t a port of a popular console game to the iPhone.  It would be cool to hear from designers, instead of corporate entities or researchers.  It’s not so much that talks from those spheres are terrible as it is that they aren’t supplemented by sessions from people that exhibit a high degree of passion about what they are building.

I don’t really have any answers to how to fix these issues.  People are building things, even if 99% of those things are failures on some level.  But these people, for better or worse, are forming the industry, and it’s disappointing to not have a venue to hear about their experience so that discussion and community can emerge.  The mobile industry has always been obsessed with the future, but at least at GDC, it’s not necessarily interested in the people who are building it.

Elephant Paths in Animal Crossing

Not really sure the extent to which this happens in other virtual environments, but one of the really great new aspects of the new Animal Crossing game is it’s support of Elephant Paths. The basic idea of the Elephant path is a visible path, formed by “unofficial” movements through space. In this sense, unofficial is defined as outside of established path infrastructure like paved pathways or roads. In many virtual worlds, Animal Crossing included, there aren’t many official pathways to begin with. The larger the world, the more frustrating it can be to navigate. While the world of Animal Crossing really isn’t that huge to begin with, the game requires that you take many of the same routes to accomplish certain tasks. The designers, in this revision of the game, keep track of the movements of your character, and if you trod along the same ground for a few days in a row, a visually distinguishable path will form. These paths enable much quicker and more decisive movement through the space.

The larger point to all this is perhaps thinking about how elephant paths can be created and leveraged in other environments. Certainly implementing such paths in larger online worlds seems obvious. But what about other stuff? What about web browsing trajectories? What about more semantic paths? Most elephant paths are about the quickest way to get from point A to point B. With a more layered approach, we could try and account for running paths, shopping paths, art paths, or other paths that had more encoded information.

Upicomp Needs Hints

One of my favorite visual and conceptual part of Mirror’s Edge is the “red” interactive objects that pop starkly from the acid-washed urban environment. It’s simple, but genius: you can do something with this door, it’s different than that other door.”

It struck me that these kind of visual cues are exactly what we need to think about as we develop “interactive” landscapes. What is the language going to be that tells me “hey, you can pop open your mobile and interact with me.” Right now you have a pretty limited and boring way of “seeing” the interactive environment. Is it going to be the drab version we have now, where wireless networks (bluetooh, bonjour, wifi) allow you to scan for available nodes, which you can then take some action on (connect, download an image, send a file). Or is it going to be something more dramatic like the beckoning redness of the Mirror’s Edge city? While it’s objectively silly to think about a bunch of red doors and pipes around your town, I think the general idea of making interactive objects somehow visible (rather of lurking about the wireless spectrum) is a powerful concept, and one that could reshape the way our future cities look and operate.

Video Game Mirrors

great video from the new york times magazine, demonstrating seriously intense concentration. I’d like to see the more spaced out kind of focused that I get into when I’m working contrasted to these kids’ faces.

Asychronous Multiplayer

Radar gives a shout out to Asynchronous Multiplayer gameplay, something I’ve been thinking a lot about recently with my current project. Radar brings up the new version of Aurora Feint as a good example of this kind of gameplay, and I couldn’t agree more. While I have some minor issues with the mobile gameplay, the core mechanic is something that needs to become a standard “go to” for mobile game developers: Short, fun experiences reinforced by a larger, persistent game narrative / game experience. Synchronous multiplayer games don’t make any sense in the mobile context, so it’s better to augment the games with social mechanics that don’t require you to sync with another player online. In addition, asynchronous mechanics also allow for more haphazard network connections, even offline game play.

swans

Nice, IMD student Ian Dallas is getting lots of internets buzz about his forthcoming game unfinished swan.

Steering

Playing around with Brain Eno’s Bloom while I was walking today made me think about casual mobile experiences. Rightly so, there’s been a lot of attention paid to casual games, a style that has come to dominate the iPhone app store, and was the primary style of mobile game in the pre-iPhone landscape.

But I hope that there’s a new breed of “casual” coming, one that’s more attached to time and attention, and less to the notion of a simple, addictive experience (and one that largely is oppositional to “hard core” games like halo, call of duty, or whatever the fuck). I think Bloom (and to a lesser extent some DS games like ElectroPlankton might count), is a pretty good example of this casual style of mobile game.

I left the house today and started “listening” to Bloom. Easy enough, I picked the generative music option, and started soft rocking out to some hyper chill sound patterns. But the great thing was, as those patterns became a little predictable or repetitive, I could fiddle with the application a bit and slightly change the course of the music in a subtle but meaningful way. This idea of “steering” a mobile experience is really interesting, and I think has the potential to define a new way that we think of casual experiences, particularly with mobile experiences.

Mega Man 9 & Video Game Tipping Points

There has been quite a bit of discussion about how freaking hard the new Mega Man 9 for WiiWare is, and how Capcom wanted it that way. Certainly I’ve been had my rage-inducing moments with the game, but I think I’m nearing what seems to be a tipping point, where it’s taking me less and less time to beat a stage.

Looking around the internet(s) and through some theory books, I’ve yet to come across much discussion about this difficulty tipping point. Maybe you can just write off the notion as simply a result of getting better or more skilled at a game’s mechanics / quirks / control scheme / whatever. But with some games, and I think the Mega Man series is included, you can achieve a certain skill or even intense familiarity with a game and still be stuck, then suddenly something clicks and you start running downhill. This happens to me a lot playing multiplayer games. I would kick ass a Mario Kart in single player mode, for example, and then be rendered completely useless in an online race. Then, at some point, everything made sense in those online matches, and I was in the top 3 every race.

Anyone know if there is a general theory of tipping points applied to games or game design? I’d like to see a study that watched people play a difficult game and measured the following: a) skill level vs. success level – how successful people are versus how skilled they become and b) a visualization of time/success ratios, showing if there is some point at which the time/success ratio peaks and starts accelerating rapidly towards 1.

The place you are

One of my routines is to take my dog out for a walk around 5 or 5:30 every day, which takes about 45 minutes to an hour. Recently I’ve noticed that the perceived time this activity takes varies drastically from day to day. On days that I’m in the mood to be outside, and don’t have some pressing thing to do, the walk seems to take no time at all. On the other hand, when I’m antsy and want to *get it over with* that half hour seems at least twice as long.

This really shouldn’t be surprising, but still important I think from the perspective of mobile design. How we perceive time in mobile situations, from being bored to being passively or actively engaged by some mobile experience should be of real importance of how we design any mobile experience.

Most mobile games are of the *time suck* variety, and tend to be casual (for example my fellow juror swinging his arm wildly around in the back of the courtroom the other day, engaged in a game of iGolf). Even just the process of messing around with my phone the other day during the walk, having it crash, restarting it, hard-restarting it, became a huge time-suck and by the time the phone was functioning again, I was back at home, almost completely unaware that I’d been walking.

I think one of the things that comes almost standard with mobile design is immersion, at least in a sense. Many of the prescribed applications for this medium are for “killing time.” If time is killed successfully, you become so immersed in whatever you are doing, that you have that moment where you snap back into reality and all the sudden you are next in line at the DMV. So immersion, in a sense, is free if you design something that is relatively engaging. The question is then (as I’m stumbling towards some kind of point), how do you create mobile experiences that don’t do this; how do you make stuff that asks us to engage *more* in a 1:1 ratio of real time vs. perceived time. With mobile design, it seems pretty easy to design for time-suck, but how do you design for the place where you actually are instead of the place you’d rather be?

DMV line image by flickr user charliereece