Wii Sign – the film

Here is the film I made to go along with my design proposal.  Its put together from sim graphics and some video sign characters online but I wanted to show how this product could be used.

Nearing an end

Pin up in 3 and a half hours.  I am off to the printers now to get my posters done and sketch book bound.  It is a fantastic feeling when everything is done, and it will be even better when it is all sitting out.  It isn’t till the end you realise how much hard work you have put in, and this is a special project since it is my last ever assessed mark, yes this is my final project, and I’m glad to say, one I am extremely proud of.  Video is exporting as I type, I’m pretty happy with it but would love this to get taken forward so I could work with game developers to really bring the graphics and ideas to life.

Thank you to everyone who got in touch and helped with the project.

I am rather sleepy now but we have a degree show to build today so heads up, might get a wee kip in the hammock in our studio.

So here it is, Wii Sign:

Wii Sign is the outcome of a thematic project entitled No Words.  There are between 30-70000 sign language users in the UK.  A common misconception is that Sign language is based on words, and that each word can be translated into a sign.  In fact, it is a completely different language with its own unique grammar and structure.

Sign language is about the full experience of movement, expression, and gestures.  Sign language is about telling stories.

Wii Sign is a product and interactive game that allows users to learn and practice sign language in a fun and engaging way.  The game is an immerses the user in an environment where only signs can be used.  Wii sign is a language learning tool but maintains gaming elements to appeal to a younger age group.

Users can progress over time to more advanced levels or simply play short games with their friends or online.

The game aims to improve the sign language learning tools available by providing real environments, everyday tasks and simulated conversations.

Wii sign is for everyone

The Wii Kit

The last couple of days I’ve been working on models and got excited by using the rapid prototyper for the first time ever.  I’m rather cuffed with the job.  Put some lights inside…looks good.  May have to paint the inside to stop the light from shining out through the plastic but thats a job for later.  The models are made for the purpose of today which is filming my cousin using it.  Although I’m a bit late now and realised I don’t have a wii, well meant to sort ot yesterday and completely forgot so I’m off to hopefully pick one up off of a friend.

I’m planning to mock up a box for this too, will have to do a quick one before I leave for Edinburgh.

Making the base station

Today I’ve been in the workshop constructing a mock up of the wii branded base station.  It took all day which was disappointing as I wanted to get alot more done.  Always a time optimist.  I’m going to use it in filming and photo session, hopefully with my little cousin if he’s available.

Here’s a few images, now to pull together this interface…

Communication and bringing it together

I’m struggling to pull this all together.  I’m happy with the concept, with the products, the physicality of the whole thing, and I’m happy with my major points I want to stress, after all I am no designing the whole game yet I am struggling to visualise it using the computer.

I’ve done hundreds of sketches, quick ones, to get out the major points, but when I sit at a computer and think, right lets do this, I’m drawing blanks.

Lets hope today and tonight proves fruitful.

The Base Station

Project is nearly over.  I’m honestly rather worried about the amount of work I have left to do.  Although I always get it done, the stress makes me work harder!  I’m trying to quickly mock up a wii branded base station which picks up the speck movement and bluetooths it back to the wii.  I’m also trying to quickly mock up the attachment ‘bands’ of the specks, and had one of those lightbulb moments today when I thought of those slap bands I used to have as a child.  Ordered some and they are on their way.  So tomorrow is a quick mock up of  the model and then I really have to try and visualise the interface quickly.  I’ve had so many ideas for this project, I just need to get them out.  I’d also like to make it into another movie because it is very difficult to convey sign language in graphics as it is completely based on movements…watch this space.

Informatics Forum – Testing Speks

(video to follow later)

Today I was back at the informatics forum testing the specks for myself and capturing some of the real time character movements through Mia.  It is simply amazing to see my movements transferred to the screen.

We discussed how the project would work, what technology is needed and how it could work with the wii.  In fact, because the unit can bluetooth, it can communicate with a laptop, therefore this ‘wii’ product doesn’t have to be wii.  Although it could function as a separate product that doesn’t have to communicate through the wii, I would still like to use Nintendo as the brand, as it captures and builds upon similar behaviour already associated with the games console.

I’d also like to have a go at creating some easy to use bands to attach the specks to the body.  Will be deciding this next week, although most importantly I’d like to develop aspects of the game I feel are important to present.  I’ve been thinking about iconicity and gestural movement as the beginning phase of the game to loosen kids up and teach elements of sign language that cognate with human gestures, something Carla had mentioned she does when teaching German, words that sound similar to English.

Looking forward this weekend to really defining the interface and getting my ideas out of my head, massive sheet of news role on my studio wall tomorrow then!

Informatics Forum

I was at the Informatics Forum which is part of Edinburgh University today speaking with DK Arvind about speck technology and the project.  It went rather well, I got to hold the specks and discuss how the technology works.  Its actually sparked a few new ideas.

What was interesting about our meeting was our agreement that designers could be implemented to help push the technology they are working on into useful products or services.  Their department is actually linked with a part of the NHS so there is a great opportunity to put this technology to good use, perhaps for new medical services?

On May 22nd I’ll hopefully be going back through to capture some of my movements using the technology.  We will be attaching the specks which will pick up my gestures  and work it out by the angles the specks are at (there is a far more complicated explanation but that is as simple as I can make it) to me which will be sent by radio to a ‘base station’ which bluetooths this information into Mia and motion builder (I think this is the correct programmes).

Still need to think about finger movements and how to put specks here, for my concept it may need to be a future prediction that the specks will become smaller and therefore can be worn as rings.

A successful day though!  I wish I had more time for the project but there may be scope to carry this forward at a later stage.

Feeding back

A few days ago in Edinburgh I visited the Royal High School to feedback the proposal to my target user group and the head of the language department, Carly Beaton.

The small focus group was valuable, after a slow start we started to discuss aspects of the concept that could be improved or perhaps changed. The major points were;

Wii sign should maintain a strong gaming element to interest the target audience to ‘play’ it

Implement a time limit for testing at the end of each level in perhaps an emergency situation so there is pressure to do well and learn along the way before advancing

Try different angles, maybe like a first person camera angle and try it with real characters not animated ones

Emergency situations seemed to be more relevant for this age group

We discussed the gaming issue vs language tool. They agreed that whilst young kids would enjoy a simpler version, a straight forward language tool for adults would be suitable and for their age range a more game orientated environment would work where they didn’t feel like they were learning.

Secondly I met Carly Beaton, head of language department at the RHS. She liked the proposal and we discussed different ways to learn languages. She showed me tools like flash cards, the interactive white board. We discussed how certain words cognate with English words, think Sopa in Spanish and Soup in English. This is a good starting point, at the initial learning stage, so perhaps in sign to begin with gestural movements that we use, like banana, which in sign language is holding up the shape of a banana and peeling it, makes the user feel at ease and introduces them gently into the world of sign language encouraging movement and gesture at an early stage.

She also suggested that this had much wider potential than just teaching hearing people how to use basic communicative sign language. It could also be used to teach individuals that have a learning disability or communication disability, or perhaps an older age group where a relative has become deafened and the tool could be used together. I think I will definitely put more emphasis on the two player aspect, and/or utilizing the internet connection of the wii. There have been alot of people asking for people to practice signing online with so I think this is a great opportunity to create a channel where this is possible and widely spread.

At this point in the project I have to admit I am a bit puzzled where to focus my attention on. The advice I have been given by professionals and other participants have said keep it as a straight forward language tool but the ‘target user group’ has said make it more like a game. Perhaps since this concept rolled out as a straight forward good idea rather than a user-centric approach which I am used to I am finding it difficult to concentrate the design so I may aim it as a language tool for adults which I think in this case is more appropriate.

Lighthouse Visit

Having consulted urban learning space previously, I went back to them to gain feedback on the design proposal. I showed them the rough work but as I previously mentioned as long as they understood the concept it was fine.

They really liked it, but agreed with my tutor that it should include more realistic environments and situations, for example going to the market, and be slightly less ‘gamey’, but retain some of the gaming elements to encourage users along the way.

I was sent this statement from Joanne Finlay;

“I was instantly impressed by Sarah’s idea for a sign language Wii-based programme. It is obvious that so much thought has gone into this on Sarah’s part, as the presentation was really detailed and comprehensive. In terms of feasibility, there is clearly a gap in the market here, as there seems very little out there in this area. I think if the application remains ‘games based’ rather than limiting it to the functionality of just a game, it will be great. Combining gaming elements with real-world tasks would be really engaging. There are so many cutting edge technologies that Sarah has considered, making the concept unique in that subject area. I understand that this is the development of an idea as opposed to the development of the software itself; but were the latter to go ahead, I am quite sure it would be a success.”

I’m pretty happy that they gave it the thumbs up, and they mentioned it feeling familiar which is a great compliment as it sits along side the current trend for Nintendo software like Brain Training for the Nintendo DS.

So next step I guess is to work on a few more graphics and content for the ‘game’/'learning tool’.

And next I’m taking it to some of my target users at a school and meeting with a teacher of foreign languages who also teaches the target age group.