The making of Perceptive Media’s Breaking Out

I have been talking about Perceptive Media to many many people. Some get it some don’t… Everytime I try and explain it I use my perception to work out what method would work for them to understand it. When I did the talk at Canvas Conf way back in September I wanted to go into real depth about what we had done, but I had to explain the concept which takes a long while.

However now we got enough feedback, its time to reveal what we done to make it work. Theres a blog post coming soon on the BBC R&D blog but till then… Happyworm have done a excellent blog post explaining the whole thing down to some serious detail, including how to reveal the secret easter egg/control panel!

How to open the easter egg

To open the Easter Egg, Breaking Out must have finished loading and then click under the last 2 of the copyright 2012 on the bottom right. You’ll then have access to the Control Panel.

The easter egg, really unlocks the power of Perceptive Media like never before.

Everything is controllable and the amount of options is insane but all possible with the power of object based audio (the driving force behind perceptive media).

Breaking Out Control Panel

Practically just changing the fade between foreground and background objects can be a massive accessibility aid for those hard of hearing or in a noisy environment like driving a car? Tony Churnside is working on the advantages of object based audio so i won’t even try coming with conclusions on whats possible but lets say, the whole turning your sound system up and down to hear the dialogue could be removed with Perceptive media. Because of course perceptive media isn’t just the objects and delivering the objects, its also the feedback and sensor mechanisms.

Mark Panaghiston writes in conclusion…

The Web Audio API satisfied the goals of the project very well, allowing the entire production to be assembled in the client browser. This enabled control over the track timing, volume and environment acoustics by the client. From an editing point of view, this allowed the default values to be chosen easily by the editor and have them apply seamlessly to the entire production, similar to when working in the studio.

Web Audio API was amazing… and we timed it just about right. At the start of the year, it would not have worked in any other browser except Chrome. But every few months we saw other browsers catch up in the WebAudioAPI front and I’m happy to say the experiment kinda of works on Firefox and Opera.

One of the most complicated parts of the the project was arranging the asset timelines into their absolute timings. We wanted the input system to be relative since that is a natural way to do things, “Play B after A”, rather than, “Play A at 15.2 seconds and B at 21.4 seconds.” However, once the numbers were crunched, the noteOn method would easy queue up the sounds in the future.

The main deficiency we found with the Web Audio API was that there were no events that we could use to know when, for example, a sound started playing. We believe this is in part due to it being known when that event would occur, since we did tell it to noteOn in 180 seconds time, but it would be nice to have an event occur when it started and maybe when its buffer emptied too. Since we wanted some artwork to display relative to the storyline, we had to use timeouts to generate these events. They did seem to work fine for the most part, but having hundreds of timeouts waiting to happen is generally not a good thing.

Yes ideally we would want to be able to turn a written script into a Javascript file complete with timings. Its something which would make perceptive media a lot more accessible to narrative writers.

And finally, the geo-location information was somewhat limited. We had to make it specific to the UK simply because online services were either expensive or heavily biased towards sponsored companies. For example, ask for the local attractions and get back a bunch of fast food restaurants. But in practice though, you’d need to pay for a service such as this and this project did not have the budget.

Yes that was one of the limiting factors which we had to do for cost. And because of that we couldn’t shout about it from the roof tops to the world. However the next experiment/prototype will be usable worldwide, just so we can talk about perceptive media on a global stage if needed

As Harriet said, “OK, I can do this.” And we did!

Yes we did! and we proved Perceptive Media can work and what a fine achievement it is! This is why I can’t shut up about Perceptive Media. When ever we talk about the clash of interactivity and narrative I can’t help but pipe up about Perceptive Media, and why not? It could be the next big thing and I have to thanks James Barrett for coming up with the name after I had originally called it the less friendly Intrusive Media.

Not only did we prove that but it also proved that things off the work plan in R&D can be as valid as things on it. And finally that the ideology of looking at whats happening on the darknet, understanding it and thinking about how it can scale has also been proven…

I love my job and love what I do…

Happyworm were a joy to work with and the final prototype was not only amazing but they also believed into the ideals of open sourcing the code so others can learn, understand and improve on it. You should Download Perceptive Media at GitHub and have a play if you’ve not done so yet… what you waiting for?

The secret garden sunshine mix

The secret garden sunshine mix by cubicgarden

So my latest mix is online, I’m sorry to say I uploaded while at TedXSheffield (it was break time and the wifi was pretty fast). I got to take the wifi as it comes because it looks like I won’t get connectivity till the end of the month now.

As always the mix can be downloaded from soundcloud if the flash player doesn’t take your fancy or you want to listen to it on the go. I would upload a OGG version (the pacemaker defaults to ogg actually, so creating a mp3 version requires extra time and effort) but soundcloud don’t really support versions of the same stuff, I’m considering going back to blip.tv for media uploading. The playlist is below, Yes I really like Thomas Bronzwaer, he’s got a style of trance which really plays to my ear, this is also the reason for Collider twice.

This mix was recorded on my pacemaker while sitting outside in the sunshine of my new shared garden at Islington Wharf. Not my best mixing but entaining and well worth a listen. Thanks to Simon Lumb (@dirtysi) for the new Gouryella remix. I love Gouryella and this remix is pretty true to the original in lot of aspects. Enjoy…

  1. Man on the run – dash berlin with cerf
  2. Perfect Wave – peter martin pres anthanasia
  3. The strings that bind us – Arnej
  4. Be with me – Coast 2 coast feat Amanda Jami
  5. Collider – Thomas Bronzwaer
  6. denva – Ronski Speed
  7. Massive Motion – M.I.K.E
  8. Rainmaker – des mcmahon
  9. North Pole – Nitrous Oxide
  10. Sincere (pulsar remix) – Firewall
  11. The pride in your eyes (martin roth mix) – Tillmann Uhrmacher
  12. Collider – Thomas Bronzwear
  13. Resound – Thomas Bronzwear
  14. Constellation – Thomas Bronzwear
  15. Gouryella (gigolo remix) – Gouryella

Should we kill TV but keep the shows?

So I was almost done with my RSS aggregator for the night when I read Jon's entry titled I Watch Shows, Not Tv. As I was reading through, I was in total agreement with Jon. Some choice quotes which made me laugh.

The medium had become totally uninteresting to me. Reality Tv was everywhere, sitcoms sucked, and ads were worse.

Enter Bittorrent, Hd rips, and RSS. Ever since I set up my system, not only do I watched more shows, but I watch a LOT of shows. I probably have at least 10 shows I watch weekly without missing a beat. But not only do I get to watch them at my own convenience

The only television I watch is the television I watch. That makes sense, I swear. When I’m done with a show. That’s it. I don’t flip to the next channel to see what else is on. I finish and move onto another project. Just sitting in front of your Tv leads to watching Hugh Hefner’s Whores jumping around pretending they have enough content to constitute television. I’d rather sit down catch 42 minutes of Lost or 28 minutes of Curb and be happy.

Totally! I have a very simlar setup to Jon, xbox media centre and all. And he's so right, me and Sarah watch a lot of shows including Lost series 2, Prison Break, Daily Show, etc, etc. When I was in hospital recently, the lovely nurse asked if I wanted the TV on, and without thinking I replied “No, I don't watch TV.” Bang just like that without thinking about it, then I realised what I just said. Honestly me and Sarah turn on the TV for the BBC news 10min update at about 8am in the morning then we turn off and listen to the slashdot review podcast if there is time. When we get back in the evening, we may turn on Channel4 news for 1 hour and maybe once in a while leave it on and watch grand designs or something like that afterwards. But usually we turn off have dinner together and maybe put on a show or listen to a podcast while we catch up with news, emails, etc. Even with the daily show on more4 every day now, Sarah's not interested because shes use to timeshifting it. She does'nt like the idea of turning on the daily show at 8:30pm every day and sitting in front of the TV.
Hey and why would we? With TV RSS we can store them and watch a whole load together with friends on a weekend or watch it the week after if we choose to.

Moving on, I read the related link and found the tons of comments mainly in agreement.

But I say all this and I know something doesnt quite fit.
I've heard about studies in the BBC which went down this route of the show being more important that the channel and TV its self. But these studies say when that is the case, people look for brands they can trust. Channels are a odd thing, if you live in the UK, you may think of BBC one as generally massmarket but higher class than ITV (my view not the BBC's view), BBC two more documentary's and nature programmes but still some comedies and mass market contnet. BBC Three, for people 35 and younger, somewhat like BBC two but with lots of comedies and reality tv. BBC four, highbrow documentary's and some news.
People use these types of thoughts to decide what channel they should wait on or check out. Remove the channel and people try and cling on to many other things like brand to tell them more about the programmes and there expected audience.

So although I'm with you Jon, I need to err on the side of caution because people need to make money without killing the distribution method (as they do now). Itunes video is a good move away from tv and towards shows and programmes.

Comments [Comments]
Trackbacks [0]