Sensor Data and Interactivity: Real Time vs Discrete

I need to organize some thoughts for an upcoming article. There is a lot of interest in using Internet of Things sensor data in my research group, and my work in persuasive computing is being linked to it rather heavily. There are multiple ways to categorize sensor data interactivity. I have lately been mostly considering a simple categorization: real time interactive and discrete interactivity.

In the former scenario (real time interaction), the end user application interacts with sensor data in a continuous fashion. This has the potential to create a feedback loop where a change in sensor data prompts action in the application, which in turn affects future sensor readings. For a very simple example, if a GPS navigator shows that the user is going the wrong way, the user can change their course in response, and therefore future GPS readings will be affected. This approach is technologically challenging, because it demands continuous connection between the application platform and the sensors. For instance, as of now, many physical activity meters have limited compatibility with mobile devices. If compatibility exists, it may be limited to only a certain mobile OS. One key agenda in Internet of Things research is enabling wider interoperability between sensors and user devices, but we are not there yet.

If we are able to guarantee real time interaction between sensors and applications, new opportunities open up for designing persuasive games. These opportunities arise because they give us the ability to include new kinds of activities as game actions. In the past, this has been achieved through specialized controllers and more recently with sensors built into devices (accelerometers in mobile phones, Microsoft Kinect etc.) Once sensors in everyday environments become more and more available, they also become more prominent as something to build a game on. All sorts of new physical activity games are rather obvious developments, but for creative designers all kinds of sensors can become game interfaces - whether for a persuasive purpose or simply harmless fun. Contemporary alternate reality games are just a glimpse of all sorts of crazy stuff that can be done in the future with IoT technology.

However, like I stated, we are not there yet. Still it is quite usual for persuasive applications or games to use sensor data in a more discrete fashion. Pedometer step counts are downloaded into an application periodically - and perhaps more importantly - after the fact. While performing the activity itself (walking), the user will not directly see how the application reacts. Therefore the user in turn cannot react to what the application is telling them. All interaction is therefore delayed. Furthermore, by the time the data is downloaded into an application, it has become just a number. Although it still represents activity, the activity itself took place in the past. From the perspective of using the application, we could substitute the data with a random number within the same range and observe no difference. Generating data is not part of the interaction between user and the application.

This is basically the scenario that I suggested the three axes for in my previous post. To reiterate: it highly resembles free-to-play games because something is brought into the game from the outside (i.e. real money in f2p games). No matter how much we try to dance around the issue, the fact remains that the game rewards the user based on the sensor data it receives from them. It is hard to obfuscate this fact due to the discrete nature of interaction. To alleviate the problem, in-game benefits granted by sensor data input should be carefully considered. For instance, the "rewards" should be thematically appropriate and function as gameplay or customization elements instead of direct measure of success. If the game is used to persuade players to become more fit, their in-game "fitness" should reflect improvements in their real life fitness. Powering up an avatar is one rather obvious example. This allows players to see virtual improvements in their virtual selves before real life improvements become perceptible.

In theory there is an upside to this more limited use of sensor data: because the input is just a number, a game developed for one purpose can rather effortlessly be fielded for another purpose. In reality however persuasive power is likely reduced if there is no thematic connection between activity and application. This concludes my random musings for now.

The Three Dimensions Model of Persuasive Game Design

Hi! It's been a very long while since I last updated this blog. Not at a whole lot has been happening to write about because the research has been kinda stuck. I have also been writing entries to that other blog. I've been doing a lot of reading though, and there should have been some more updates about that stuff. Maybe later. This time around I just want to put something on paper.

I have been following the gamification discussion mainly through Twitter, and it pains me that it not much has changed in the past two years. Scores, leaderboards, badges and whatnot are still considered perfectly valid. Although there's no entirely unanimous research against them, the studies are kind of piling up. Although it can be argued that studies supporting rewards are also piling up, the mere fact that the issue is highly controversial should make us pause. We're often working in domains where mistakes can be quite harmful and if a method is potentially damaging, its use should be seriously reconsidered. There's that, and of course there's also the fact that it's not really game design, as has been pointed out by actual game designers in the debate. Awesome people around the world are making "gamified" applications that go way beyond the simplistic approach, and for that I commend them.

Somewhat recently I ran into some advice that had been given to companies that provide well-being programs to other companies' employees. Sure enough, the standard issue gamification bullshit was all there was. Obviously I don't want to take this route because a) I am concerned about the potential risks of using rewards and b) doing so would degrade me as a researchers and designer. However it does turn out that coming up with game concepts while avoiding the obvious routes is freaking hard. To help me in this task, I came up with a three-dimensional model to which all design should adhere to. The basic idea of the model is to help every player being able to feel like they are in the game. For instance if the game is cooperative, everyone should be able to contribute. I generally prefer cooperative games in this domain anyway, because competition has a higher risk of dropping players from the game.

Generally speaking there should be three different axes available for players to affect the game's outcome. The first two axes are directly related to whichever behavior is being reinforced by the game. I use the terms long term progress and short term progress. The former shows how far the player has come since starting to play the game or how much progress has been cumulated from the very beginning; the latter follows more recent trends in behavior and should generally be normalized (e.g. to make amateurs and professionals able to compete, we compare who has the bigger relational increase in the behavior). These two axes form the two core dimensions of persuasive applications. They generally provide rich feedback with the purpose of making the user more aware of their own progress and thus more motivated. The third axis on the other hand is what I think is really required to make a persuasive application into a game: decision making.

Using this model, each player can affect the game in three different ways: improving their overall behavior over a long time span (progress); improving their rate of improvement (improvement); making meaningful decisions in the game (strategy). The model bears similarity to some free-to-play games. We can consider the behavioral axes as something that is bought with currency because it comes from outside the game (e.g. physical exercise measurements) but gives the player some advantage. The last axis reflects how well the player does with what they get from the first two axes. Although there is a similarity, in general the two behavioral axes should not be treated the same as in-game payment systems in f2ps. A game that aims for behavior change should allow these axes to have more impact on the game. Unlike f2p games where "pay to win" is frowned upon, a persuasive game should be e.g. "exercise to win".

It is also noteworthy that the two behavioral axes are interrelated in most scenarios. The higher a player is in the overall progress axis, the harder it is for them to keep improving their performance. It means that players who are "ahead" will be stronger on this axis while players who are "behind" will be stronger in the second axis. Over time, that strength in the second axis will gradually move over to this axis. Notice that these axes are different, which means they should have different effects in the game, making the "ahead" players stronger in one way and the "behind" players useful in another way. When done like this, the poor performers will feel motivated to improve their performance because it yields quick returns all the while the good performers won't feel cheated or punished for "doing too well".

Finally, the third axis does not necessarily serve any behavioral change function on its own. It can do so, if the gameplay is related to the behavioral change goals (e.g. requires knowledge of good habits). Its primary purpose is to make the entire thing more interesting - it's what actually makes it a game. Being good or bad on the third axis is not related to behavioral change goals of the game but simply the player's own interest in the game. It's the glue that actually makes the entire system work. The third axis needs to have significance because otherwise players are likely to lose interest in the game (i.e. it's really just a system for tracking progress - nothing wrong with that, but don't call it a game!). Regardless of your target audience, this is very likely the hardest axis to work with because it requires brilliant game design. However, your target audience is very likely to make it even harder.

So there you have it for now. This model is my design philosophy for behavioral change games and so far I can only tell that designing games that are just games is nowhere near as hard.

Two Approaches to Increasing Physical Activity

It's been a long while since I wrote something. For quite some time there were no topics to write about. Lately I have been doing a lot of research into persuasive technologies and pretty much anything that surrounds the issue. While there is still a lot more to look into, I'm starting to form a clear enough picture.The topic I'm about to delve into should have a familiar ring to it. However, this time around the perspective is more informed.

It starts with an article by Richard M. Ryan and Edward L. Deci, Intrinsic and Extrinsic Motivation: Classic Definitions and New Directions. We're hearing a lot of talk about intrinsic motivation from gamification... uh, actually, let's not go into terms. Just check this blog post by Chelsea Howe to get a reference point. In their taxonomy of human motivation Ryan and Deci place intrinsic motivation on the far right, opposed to amotivation in the far left. The implication is that intrinsically motivated actions are the most self-determined and the most likely to be carried out. This we already knew. What's interesting about this taxonomy is in the middle. Instead of considering extrinsic motivation as one big undesirable lump, it is shown to have different degrees of internalization. The leftmost type of extrinsic motivation is the antagonistic, reward-driven motivation called external regulation. It is the type of controlling relationship between the actor and the motivator that is criticized by e.g. Alfie Kohn in Punished by Rewards. 

Kohn's criticism also applies to the second type of extrinsic motivation called introjection. Actions in this stage of extrinsic motivation are driven by social approval. They are important for the person's ego. Although it is less externally controlled than pure external regulation it can still involve a controlling relationship between the source of approval and the actor. Praise is an ego-stroking reward that fits into this category. Or losing weight to avoid being mocked. In these two stages are dependent on external pressure. If the pressure goes away, motivation to do the activity goes away with it. People who have once been motivated through external rewards may fall below their base level once the rewards stop coming. In encouraging physical activity, it should be clear to us that this kind of motivation cannot be healthy, even if it works as long as rewards last. Behaviorists are not wrong, operant conditioning does indeed work - but important matters like physical activity should not be approached with a "whatever works" attitude.

However, there are two more types of extrinsic motivation where the source is to an increasing degree internal. What they have in common is that the activity's goal truly matters to the actor. Although they might not enjoy doing the activity in itself, they understand the importance of doing the activity because it progresses them towards the goal. Even better, they identify with the goal and it becomes a part of their ideal self ("I want to be fit to stay healthy" versus "being fit is a part of who I want to be"). The activity becomes valued by the actor and they feel they are doing it for themselves. In developing persuasive technology, this is where we should by playing ball. Of course it only works if the actor actually values the goal - if they do not, then things will be a lot more complicated. However, I consider that situation to be beyond what we can do with just technology.

So there are two fields where we can operate. The most common approach taken in HCI research is to aid users that are in the better half of extrinsic motivation - they have already established a goal of increasing their physical activity. In this domain, persuasive applications are helpers. It is their job to improve the actor's feelings of competence. There are a lot of ways to go about this. Simple technologies like pedometers alone fulfill one specific need of competence: progress feedback. Technology can quantify activity, allowing the actor to see how well they are doing. It goes up from there. Technologies can help to pick suitable short term goals. They can nudge. They can help connect with like-minded people who are going through the same things. The wealth of persuasive technologies that can be employed once the actor is at least somewhat motivated towards the big goal is huge.

The other field is where exergames operate. It's kind of like a shortcut. Because physical activity is a very broad term, there are a lot of specific activities within it. Exergames in particular aim to create a new activity that the actor might find fun to do. It is possible to jump from amotivation straight into intrinsic motivation if a suitable activity can be found. Dance Dance Revolution has been mentioned to death. Other popular examples include Geocaching. It's not just new activities though. Simply finding an enjoyable sport can do the trick. Technology can step in and help a person to find an activity they might actually like. This is best achieved by making it as effortless as possible to try out new activities. Exergames, especially mobile games, can have a very low barrier of entry (e.g. $1 for a mobile game that allows you to start immediately, or even free-to-play).

I believe that both of these approaches are correct. The first approach is suitable for people who are prepared to get into exercising but need a little push to start and a lot of pull to keep going. The second approach can work wonders with people who do not care about exercise and don't have any fitness goals. It is worth notice that these people can also get started with an exergame and realize that they actually have the competence to become fit if they keep going, which in turn allows them to assume a healthy exercise routine. Or they might want to start doing other exercise to become better at their game or sport. At this point we can combine methods from the first approach to help their training.

To summarize, there are two clearly distinct fields to play in regarding motivating physical activity. Both have their uses, and both have their unique challenges. Research has been done in both fields, but we're still waiting for a physical activity revolution to happen. In this field it seems rather typical that research prototypes do not turn into products, and commercial products are not necessarily up to date with their psychological research. There is still a lot more space for both research and new products in this domain. Oh, and physical activity is just one thing, there's more to come.

Alternate vs Augmented

This has been bothering me a bit. Well, not really bothering, but I am curious. These two concepts, augmented reality and alternate reality, seem to overlap so much that these days it's hard to say which is which. I was actually asked about this just yesterday and I really couldn't say for sure what's the difference. I did give my own opinion. The discussion was initially sparked by a news article about a treasure-hunting location-based game, which was referred to as augmented reality.

This is a tough one. There are no clear-cut definitions. The distinction I make between the two is largely based on the meaning of the words augmented and alternate. Augmented reality enhances reality or our perception of reality with additional information. I do admit this is based on the impression that the first augmented reality applications left on me. I mean the ones that use AR tags which viewed through e.g. a mobile phone show a 3D model where the tag is. Generally, I see augmented reality as something that overlays the real world with additional information. Augmented reality vision is perhaps the clearest example. The primary content of such applications is reality itself. The overall experience of using the application revolves around reality. Admittedly it gets really fuzzy really fast.

Alternate reality on the other hand is something of a replacement reality. These are mostly games that have their own game world which is linked with reality, most commonly by location. Shadow Cities, that mobile game where players battle for influence on a map overlaid on top of the real world is a pretty solid example of an alternate reality game. The game content is primarily virtual and the overall experiences revolves around the virtual component, i.e. the game that is being played. In this case reality enhances the gameplay experience more than the other way around. Players of alternate reality games are not driven by needs based on reality but on needs provided by the game. Again, this gets fuzzy and does it quickly.

Ultimately it's not a big deal. It's just nice to be specific. It is also clear that these two terms do not overlap entirely but they do so a lot. For the record, I would say that a location-based treasure hunt game is alternate reality, not augmented. Bonus question: is geocaching alternate or augmented reality? That is a tough indeed...

Wherigo geocaching

Today I had the opportunity to test Wherigo. It's a toolset for creating GPS adventures for GPS devices. My friend got a Garmin navigator that included an implementation of Wherigo, so we went off to seek one of the two Wherigo caches in Oulu.

This one was much like a multicache with one important difference: because the waypoints were just pieces of code in the virtual game world inside the device, the cache creator was able to enforce rules for traversing between waypoints. In this particular example, there were danger zones scattered around the area where the waypoints were located, and ending up in one of them forced the seekers to start the entire thing over. There were also timelimits for some of the waypoints and again failing to meet those meant starting from the beginning. There was no map, so detecting threats had to be done by looking at their distance and direction. We got shot down a few times when we were still figuring out how exactly the system works. Overall it took us about an hour to go through the entire adventure.

The experience was indeed different from any other caching experience because of the enforced rules. I wouldn't like to do this all the time, because much of the fun in caching is in the freedom to choose one's own approach but it's cool variation from time to time. I don't know the limitations of the toolset just yet, but using what I saw in this one cache could do stuff like actually enforcing limitations on transportation choice for people who want to create no-cars multicaches or whatever.

This was my second time playing an alternate reality game that places virtual objects into real world coordinates using GPS. It was kind of interesting, like navigating threats based on just a radar (or in this case listening to a radar officer, since I wasn't holding the device). The first time was when I playtested a submarine warfare game, and it had some of the same feeling. The submarine game had somewhat better immersion because the enemies were other players, visually present in the environment and also detectable using sonar. I think one important thing in alternate reality game immersion is to make a plausible explanation for why things in the game cannot be seen in the real world.

Anyway, to summarize, Wherigo seems like an interesting addition to geocaching and I'll be reporting if I encounter some fresh concepts that make use of it. We'll be doing the second local cache next week and I've heard it should be a different experience, and also more frustrating. Waiting to see how...

Stage Autumn Game Jam

Nothing new to report really. I've been working on my framework's code structure. It doesn't really make for interesting conversation... However, I did participate in yet another game jam. Unfortunately this time our team didn't quite finish the game in time, but we got quite close. I've written about some of the problems we faced in my other blog. Go check it out!

Yet Another Blog

A quick ad. I started another blog called Shouting from the Sidelines. Unlike this blog which focuses on academic stuff and beneficial games, the new blog is 100% game design. I'll be analyzing games and also occasionally writing about my own designs.