What are hyper-reality experiences?

perceptive-media-ethics-dreams-hyper-reality-44-638

I talked previously about mixed reality but the consensus seems to be VR+AR = Mixed Reality… it looks like that ship has sailed and no matter what I say nothing will bring that back. So I have started talking about hyper-reality when discussing perceptive media across objects and things.

You could say its like a theatre cast in your living room and starts to answer some of the questions about perceptive media killing the shared experience. Theres already people hacking things to media, BBC R&D even experimented a long time ago in this area with the famous dalek example and of course the Perceptive Radio was just the start. The second version of the perceptive radio, did actually include more connectivity options to reach out and interact with devices in the local space such as Philips Hue lights, bluetooth devices, etc. It seems so simple but the big difference is they are reacting to the media rather than being thought about at the script/narrative level. With object based media (media+metadata) we can get to level much richer and interesting than ever imagined perviously.

Imagine what would happen if the director/writer could start to specify these type of experiences, the same way a director chooses to show certain characters in certain light, angles, etc. However the big difference is it can be contextual, flexible and scalable for 1 or many more people. How about that for a shared experience?

Of course this  brings up many ethical questions, data dilemmas, and questions about graceful degradation and progressive enhancement for media experiences. But I’m going to side step that in my blog for now. There are too many questions and research is well underway.

Ethics of personal data videos

Hyper-reality (or shall I call it hyper narratives, certainly can’t call it hypermedia) extends the narrative into the real world. This is fascinating because;

I contest this is closer to alternative reality gaming and the very popular immersive theatre works such as sleep no more. A problem with both is the scalability and consistency of experience, but whats great about them is the unique and shared experiences.

The Verge recently did a whats tech podcast which talks about immersive theatre, alternative reality games and the logical future of this stuff. Like the psychtech podcast episode 44, it highlights a lot of my current thinking and how all these things are connected. I always said the Internet of things needs a narrative because right now it all feels to service/utility. Even Google’s home project lacks that human-like narrative.

Internet of things needs a narraive

Some will sniff at this blog post but hyper-reality is the best word I can think of to explain what happens when you mix media objects, physical things, storytelling and context together.

Building virtual worlds is nice, augmenting the real world is better. However in my mind the future is those who explore the cross over of things, devices and media. Can you imagine the incredible levels of immersion?

 

Futurefest 2016 took me by surprise

dsc_0298_1

I have known about Futurefest for years since the first one in Shoreditch town hall about 3 years ago. But was never able to attend due to clashes with the London Design festival which runs around the same time of the year. This time around there was enough time between them and not really being involved in LDF besides attending events, I had the pleasure of attending and presenting the work I’m pretty passionate about.

Having looked at the programme briefly online, I was very convinced this would be great use of my weekend, even so close after IBC 2016 and Mozilla Festival 2016. The variaty of talks was something you only really see at the better established conferences like Thinking Digital, and all for not a lot of money in my view.

I was pretty blown away by the gender split, I first thought it might be because I spent 6 days in a heavily male dominated IBC but I started to do a rough count in my head. It was 60/40 split towards female, amazing…

The first part of my day involved working with Victoria K to fix my presentation which had been converted over to Powerpoint with the usual weird and wonderful problems you get when moving between Libreoffice & Powerpoint. We straighten it out and embeded the videos. I could then relax and attend the sessions.

Unlike most conferences, the sessions were weirdly positioned, with some starting at times like 1505 and 1150, then they would run for 15, 30, 50mins. There was also no set time for lunch or breaks, you had to work it out yourself. This made networking less possible but I quite liked the idea of no formal lunch time as I tend to eat later than most.

My session was titled Data ethics in the time of perceptive media, and I almost missed the start of it due to talking in the speakers green room. Luckily Nesta’s Lydia found me chatting away and we made for the glass box room. Just enough time to mic up, drink some more coffee and sip some water.

I moved quickly through my 58 slides in less than 20mins (20 seconds a slide) giving more time to get Q&A from full packed in audience. I didn’t realise that the talk would be so popular but people told me they couldn’t get in and had to watch from the outside of the glass (sorry if you were not able to get in). The questions, I had already kind of prompted in the later end of the presentation but people got the idea BBC were doing everything to research how to stay trusted but also carve out the new opportunities in a very open way.

After the talk and Q&A, I had quite a few interesting conversations from people asking and enquiring into how deep we were research into the ethics of data? Of course I gave a massive big up to Rhia, Lianne, Maxine and other research scientists we have in BBC R&D. The discussion moved from personalised drama to personalised learning using perceptive media. Which is when I always link or mention the Psyteach Podcast episode 44Is Perceptive Media The Future Of Education?

The Futurefest really did surprise me, the line up was great on paper but I wasn’t sure if they were  able to pull off such a ambious schedule of talks. On paper it started to look like the festival of dangerious ideas which I have been a fan of. Mixing Love, work and play together really is a tricky combination to get right, but Futurefest/Nesta got it about right. No matter what some white man says, Futurefest was a well deserved glimpse of the future, especially after the male dominated experience of IBC.

Millennial was talked about a lot, I realise although I’m much too old to be claiming to be a millennial. I likely think like a millennial (if we are going to tag a generation in this way). This became clear in sessions Work beyond the workplace, Women will rule the world and Design your own life.

From my vast notes in a mindmap (would share but they only make sense to me), millennials charactistics include

  • Multiple things going on
  • More likely to do things they are passionate about
  • Blur work and play and enjoy it
  • Like to reinvent themselves

This doesn’t seem to uncommon to me, but to be fair the people I tend to surround myself with likely subscribe to a bits of these notions too.

The sessions which really stuck out for me were.

dsc_0222_5

Work beyond the workplace by Anjali Ramachandran

This talk started out with AI isn’t going to kill off our jobs and via Dan Lyons new book (I’m still gutted I missed him when he was in Manchester) Distrupted, we ended up reestablishing a new business culture. I had heard of Responsive.org but never really looked into it properly. Something to add to my task list. It all felt reminiscent of Blaze at Thinking Digital Newcastle 2014. I was hoping to catch Anjali about this.

dsc_0296_1

Design your own life

I really enjoyed this talk and quite enjoyed the nature of having the social space outside the main rooms in the open air. Its the kind of thing I enjoyed about BarCamps (sessions spaces in weird and wonderful places). Nesta’s set designer was doing a great job.

The talk by Bill Burnett and Dave Evans, was deeply funny but also full of interesting points while flogging their book (which I did end up buying, but missed the opportunity to get it signed). The crux of the talk was using design methodology to design your own life. Research, prototype, evaulate and repeat. This is where some of the Millennial thinking popped up. They also described other traits which they saw as positive for designing your own life, a strong sense of curiosity and natrual intuition (something which I’m less and less of, sadly). They also dropped something they called dysfunction beliefs, which I’ve been refering to as old fashioned thinking in the past.

There was so much captured and said, I think I’m going to wait till I actually read the book. Shame I didn’t get it signed.

dsc_0324

Shifting identity

This was part of the theme Future love and I have to give credit to the whole theme, which was expressed in a adult and smart way. Sex and the office had Cindy on the big stage and was great, but shifting idenity really pushed things into a new terriory.

dsc_0340

Gender fludity is a area few people talk about and I was exteremely proud to witness Bill Thompson,  chair a tricky subject in such a playful way which made everybody feel at ease.

dsc_0339

The very idea of male & female was kind of torn up, as Bill suggested was the promise of the early days of cyberspace. Everybody on the panel talked about gender on a spectrum, being the new normal. Interestingly a woman, who was born legally a boy talked about the external desire to be extremely feminine. As she said, you could switch gender but don’t you dare float in the middle!

Changing people’s world view was dropped in by one of the panelist, along with be a roll model, communication through demonstration and of course tollerence. Pretty sure it was Cindy who said “look in who you are, that’s the only way to know who you are.” I totally agree, which reminds me of… Of course, this is extremely difficult or potentially dangerious for some people in some places (sadly).

dsc_0309_2

Very fitting end to a incredible panel in most other conferences but certainly contender for the best panel from Futurefest. I glad I missed out on hearing Brian Eno for this panel, it was so worth it.

dsc_0268_2

Love as risk

Frank Furedi deserves a mention because his understated talk seemed to hit all the right buttons. Once again I was franicily mindmapping. My ears really picked up when early in the talk he mentioned “Women who love too much.” A certain friend (they know who they are) has recommended it to me but I’ve never read it. (Keep meaning to dust off my kindle library card option).

Frank slowly deconstructed how we want/have turned love into something safe, predictable and machine like. We want certainly but love is a risk, as Frank says “love is meant to be dangerous, its a risk

I asked Frank the question myself, Simon, Jane and Anna had talked about a month or so earlier. Frank was quick to add more and point out we have rengated love to a transaction. His most powerful example was partner over lover. There was also mentioned about Japanese sex lives (video).

dsc_0240_3

Women will rule!

This is when I first saw the debate platform and what a debate to have on it. It was Cindy who mentioned how training data wasn’t diverse and ended up killing women and children. Weirdly enough I heard a whole podcast from 99 percent invisible about the problem with averages. She also made it super clear as the host, this isn’t about women per-say, but rather diversity and it starts with young women.

I found Cindy extremely powerful as a host and she really got things moving with quotes like “History is white washed by white men” and “Old pastie men

dsc_0272_1

I can imagine how alienating this might all sound to white men. But frankly the time for tip toeing around the subject has gone and passed. The woman from the apprentice, Melody Hossaini got a bit of a backlash for trying to fit in to the systems rather than fix or reinvent them. Especially around the idea of quotas in jobs. Bridget Minamore was right on the button with her passionate rebutal of Melody’s thoughts on quotas.

dsc_0264_1

The debate was good but just as it heated up, time was up. I would have paid to see more of this debate.

Other sessions worthy of note included Cindy’s only provocative talk from the Explore stage. I’ve said far too much about Cindy in this blog and the previous oneprevious one, but she had such an amazing influence.

BBC’s Colin Burns on the debate stage for From design thinking to design playing. Where Colin explained the design process using an imaginary fish.

dsc_0244_4

Dj Spooky’s Future of love music, which really gave a real understanding into the way he thinks as zipped around his ipad from application to application.

dsc_0324

Anne-Marie Imafidon’s the future is young women, which was only bettered by the discussion on the debate stage.

Futurefest took me by total suprise and it was incredibily good value for the price. I have compared it to Future Everything and the Festival of Dangerous ideas; I’m sticking with that because the diversity of the subjects and ideas was incredible. A welcomed change to the line ups and style of conferences we’ve gotten use to. Something between a festival and conference with a sharp edge which got people thinking.

dsc_0329

Thanks to Lydia for convincing me a long while back to get involved and the rest of the team for a great conference. Glad I could play my part, and I’ll be back next year likely under my own steam unless I got something which fits with the themes for 2017.

More magic leap thoughts

I have been aware of magic leap for ages but since Dave sent me the piece about magic leap; I’ve been looking at more of their work and approaches.

This is when I watched the recording of Graeme Devine at the games for learning summit.

The over all idea of mixed reality I certainly would agree with… The important part is talking about worlds and experiences. Nothing about screens or devices. I would suggest the statement…

MixedReality-300x252

Mixed Reality is the mixture of the real world & virtual worlds. So that one understands the other. This creates experience that cannot possibly happen anywhere else.
– Graeme Devine

…as the Moon shot.

It certainly something I’m also thinking a lot about when it comes to perceptive media. Experience which are simply not possible. The only way this is possible is with the combination of the real and virtual/media world. I’m still inspired by some of the thinking behind alternative reality gaming; mixing reality with directed and scalable experiences.

I also found their company ethos of…

  • People are first
  • What we make will be better, not always new
  • The experience really matters

Quite interesting…

We need a magic leap for the other senses

Good friend Dave mentioned Magic Leap and sent me a link to how it may work. I had a read and although it was a reasonable read, I was less impressed than I maybe should have been. I get Magic Leap is the thing lots of people are getting a little moist about, its seems incredible but I share a small amount of the view-point of the blogger..

Regardless if it turns out to be a consumer success or not, this is the first example of real innovation the tech industry has seen in some time. I am extremely excited to see what happens next for them and looking forward to the shake up this will put on the industry in general.

To be clear, I’m not down on Magic Leap, it is innovative but its more of the same. I only really interested in disruption right now. Something the tech industry needs (imho).

I already mentioned my thoughts about mixed reality and it hinges off the fact it’s not just visual and audible. I draw your attention to the interaction design rant (Touch), Smell and media (Smell) and of course the deeply problematic (Taste).

This paper‘s summary, sums up my thoughts, I feel…

The senses we call upon when interacting with technology are very restricted. We mostly rely on vision and audition, increasingly harnessing touch, whilst taste and smell remain largely underexploited. In spite of our current knowledge about sensory systems and sensory devices, the biggest stumbling block for progress concerns the need for a deeper understanding of people’s multisensory experiences in HCI. It is essential to determine what tactile, gustatory, and olfactory experiences we can design for, and how we can meaningfully stimulate such experiences when interacting with technology. Importantly, we need to determine the contribution of the different senses along with their interactions in order to design more effective and engaging digital multisensory experiences. Finally, it is vital to understand what the limitations are that come into play when users need to monitor more than one sense at a time.

Being able to drive and combine all these things together (even in a basic way – multisensory) has the potential to be far more exciting and immersive than Magic leap could even dream about. And its happening in dark and acdemic corners (I was maybe more excited by the vibrate API draft than learning about how magic leap may work – sad, who knows?). I’m sure they might be thinking the same but the fascination of the tech industry is on higher density A/V. Multisensory is moon shot. Being able to drive these on demand in an ethical, sustainable and contextual way is something I think a lot about with Perceptive Media. Being able to enable anyone to create their own experiences to share is the next thing.

Ordinary life does not interest me

Ordinary life does not interest me

I wrote a blog about neurodiversity after Kate included me in a tweet about a mother and daughter talking on the listening project. My blogs are shared into Facebook and Marie added a comment, which was simply a picture.

That picture (same as above) spoke volumes. After looking it up, I found the source.

“Ordinary life does not interest me. I seek only the high moments. I am in accord with the surrealists, searching for the marvelous. I want to be a writer who reminds others that these moments exist; I want to prove that there is infinite space, infinite meaning, infinite dimension. But I am not always in what I call a state of grace. I have days of illuminations and fevers. I have days when the music in my head stops. Then I mend socks, prune trees, can fruits, polish furniture. But while I am doing this I feel I am not living.”

Anaïs Nin, The Diary of Anaïs Nin, Vol. 1: 1931-1934

This is something I absolutely subscribe to. You only have to ask friends about my dotted past and look at some of the friends I get up to shenanigans with. I never seeked to fit in or follow other people’s limited constructs of what I should or not do; and to be fair I’ve never been very apologetic about it. Of course it’s not all tea and honey, but it’s just the way I am. Said on the eve of getting undressed on TV.

Neurodiversity as a superpower?

I always loved the idea of the listening project and of course took part in it myself with the lovely Kate. The editors enjoyed the last part of conversation, which we still haven’t actually gone through with yet?

It was Kate who included me in this tweet about Leanne and Eloise talking about dyslexia as a superpower. Something I’m fully behind being dyslexic and living in a world of the neurotypical.

The Dyslexic advantage is quite something, along with the videos; in this regards. I remember Malcolm Gladwell getting a lot of attention for saying something similar in his book David and Goliath. Desirable difficulty, I believe were the words.

It’s slightly ironic, when reading about the sperm donation place which was turning away dyslexic men. I’ve also been thinking about the advantages and disadvantages of telling young children about their superpower. Can this be a good or bad thing? It’s really hard to say, especially because I don’t have kids, so have no skin (as such) in the game. But of course it doesn’t stop me from chipping in with something anyway.

I was talking with a colleague recently and we were talking about the joy of seeing neurodiverse people doing what comes naturally, instead of trying to fit in with the neurotypical view. For example, I write as I talk, this isn’t the way you write… lots of people tell me. So I tried to adopt this, but in the end gave up knowing it simply was not the way which works for me. I am obviously a lot happier because of this but I’m still waiting for the technology to catch up.

Street art in Manchester's Northern Quarter

The colleague is a very visual thinker and prefers to communicate in pictures. One of the many great things I seen is this person writing emails using gifs and very little text. Its sounds nuts but it works so well and I’ve started wondering why this doesn’t happen more often? I mean Emjoi’s are becoming more common place, I seen Gif usage increasing in spaces which support them like Instant messaging, Twitter, Slack, etc. I even have a task to install a few apps so I can create my own.

Media which expands human communication and curiosity?

Superpower or magic

How about that for a superpower?!

Is slack actually a roach motel?

Trello into Slack via IFTTT

I have mixed feelings about Slack. Its good but I worry about the deadend nature of it. A clear sign of this is IFTTT’s recipes involving Slack. Every single recipe has Slack as the output (action), not a single one has Slack at the input (trigger).

This is the notion of the roach motel or walled garden, right?

I have been looking at alternatives; before anybody starts; YES I know IRC, yes I have used IRC in the past and more recently. I get it but I always find it not a great environment, especially for modern work, due to the obscure never-changing syntax and behaviors. I also know people who use slack via IRC and I have tried using Slack with a Jabber/XMPP client but its painful for anything but talking to individual people I found.

I looking at others and found…

But recently someone suggested trying Telegram groups and channels. Then using existing tools like Trello, Google Docs, etc.. for permanence? This may run back to the small pieces loosly joined way of working, which isn’t so attractive. But allows for diversity of uses, clients and services. Dare I say something to think about when thinking work 2.0?

Part of my worry is slack trying to be the end point for everything. Its seductive and easy like Facebook is, but scratch one of the sides and you find the walls are more concrete than expected. Yes there are permalinks, bots and markdown content but it feels very hidden?

Why Ade should be at Mozfest

https://twitter.com/cubicgarden/status/749985923597819904

I had a read of Adewale’s blog about Cargo cults and progressive web apps stores. While reading it, I thought this is perfect for the Mozfest space we are crurating this year. The tale of two cities: dilemmas in connected spaces.

What Ade is tackling is the notion that app stores or the walled gardens are bad and more native fuctionality is heading out on to the web. He ponders if this is a good thing or not?

I know the recent Web USB draft certainly got a few peoples noses out of joint; for good reason to be honest, especialy on security grounds. However I’m personally not convinced by the legacy background Adewale mentions.

It’s easy to forget that app stores emerged as a response to the difficulties of dealing with carriers to get your content ‘on deck’getting your apps preinstalled and the extremely closed nature of that ecosystem.

Yes that was then and this is now. I clearly remember the pain of installing apps on my PocketPC devices. It was painful and clearly early adopter like myself were the only ones who would put up with it. However legacy isn’t a good reason to back an closed garden model?  Its a call card for the open web right? I mean Adewale’s reasoning is good…

  • give an obvious place to find apps that have particular functionality (try searching for “games that don’t need wifi” in the Play Store)
  • give developers an obvious place to find large numbers of users.
  • give developers a structured mechanism for exposing the features of their app so that users can filter the set of available apps for apps that have those features.
  • give users an obvious place to review apps.
  • give developers an obvious place to accrue reputation for their apps.
  • give platform vendors a place to assert policies that drive developer behaviour.
  • give every app on a platform a canonical URL ( for example here are iOS and Android URLs for the same game).

But its merly a step in the right direction, and to be fair most these features are just merely cracks in a flaw model of the walled garden or the garden trying to emulate the web? However I do also think there are lessons which can be learned from them.

Instead of ‘cargo culting‘ the app stores we should be asking what web-centric solutions to the problem would look like. For me that means lots of competing and opinionated PWA directories rather than one central PWA Store or even a popular search engine.

This is the start of not only a good workshop at Mozfest, but also the start of a good exhibit/experience/dilemma. He (or someone) really needs to submit a proposal for Mozfest before August 1st.

https://twitter.com/ade_oshineye/status/749996138393112577

Run a session in the tale of two cities at Mozfest

Global Village at Mozfest

The call for proposals is up and Mozilla are asking for diverse, interactive and workshops from the savvy public. This year the proposals can be in French, Spanish and Arabic. Also this year the theme in the physical area is the Tale of Two Cities

A tale of two cities

Dilemmas in connected spaces

This space will allow makers and learners to explore these dilemmas through a series of interactive experiences and mischievous interventions. Participants might nap on a squishy chair that generates sleep data; cook a snack in a connected kitchen where appliances only sometimes do as you say; and hack on IoT hardware.

The theme builds on 2014’s ethic dilemma cafe and raises the stakes by forcing people to consider the choices we all make during our digital and physical lives.

Are you a consumer or maker? Rather do your bit in the open garden or prefer the confort of a walled garden? Want everything free or rather pay what you like? Rather device automation or manuel control?

Each one of these have different factors and considerations, and we will let them play out as physical spaces. We’d love to see workshops which explored these types of decisions we make with our physical & digital interactions. There are many more we haven’t even considered, which I know you will…

Sessions don’t have to be super sketched out, we can work it up into something special together. You will also be able to see how we discuss and select sessions on Github, as we did last year. Radical transparancy could be a nice dilemma to explore?

You know what to do… Put in a proposal before August 1st

Large scale epaper displays from Fluxuri

At long last after much much talk and some interesting developments from some of the bigger players. Fluxuri have showed their huge displays.

Fluxuri establishes a new type of innovative display technology that offers to affordably create mutable surfaces of any shape and size. It is a thin, highly flexible and reflective passive medium that only requires mechatronic or manual action to change its characteristics. In the former, special plotters and printers become feasible means even for very large areas. For the latter, hands and fingers themselves are amazing means enough to write and draw. Depending on their orientation, light strokes reveal different colours.

Fluxuri has a characteristic granular surface that is capable of variability in pixel sizes, densities and optical properties such as colour, finish, reflectivity, iridescence, fluorescence, phosphorescence, and more – and even in materials, with plastic used today, and other surface materials highly possible in the future. This makes Fluxuri a unique, sustainably versatile, and aesthetic medium.

Its fair to say I have been talking with Fluxuri, and although the video is blury. I have personally seen the display working close up. Its impressive and has plenty of great things which are certainly exciting at such sizes and so thin!

Expect to see them coming very soon…