Been thinking about machine bias again recently

Amazon AR haircut

Yesterday I met up with some friends to celebrate a birthday. We went to the Wharf in Castlefield, Manchester. Nice outdoor space with a massive teepee to help with Manchester’s typical rainfall.

I had a few drinks so visited the toilet a few times and of course washed my hands well so needed to dry them. A few times I tried the hand dryer but there was a red light, so assumed it wasn’t working from a fault or due to the spread of germs? Once I noticed the paper towels were refilled and used that.

However the last time I went in there was white man using the hand dryer, I was surprised and naturally thought it must be fixed now. So afterwards attempted to use it. Did it work, did it heck!

This doesn’t come as too much of a shock as its not the first time and there are many examples on youtube. However with a lot more knowledge now, I’m pretty peed off about it. I wanted to record it but needed a white hand to trigger it and at the end of the night, very few people would join my video experiment. I can tell you I moved, flipped, waved, even touched the sensor with my hand. Nothing would trigger it.

After returning to the table, I asked if the men had used the hand dryer but didn’t get a clear yes or no. So I’ll have to go back to the Wharf soon to film this I think.

Another interesting point also came up after the hand dryer discussion.

Amazon opens its first hair salon, where customers can use augmented reality to experiment with hair colors

I instantly wanted to know if Amazon’s AR app will actually work on non-white people? From all the press pictures, its all pictures of white skin women. If it doesn’t work on non-white skin, expect an explosion of coverage, but it would speak volumes about the total bias of this whole industry. Something many have covered but watching Coded Bias during Mozfest made super clear.

We need a magic leap for the other senses

Good friend Dave mentioned Magic Leap and sent me a link to how it may work. I had a read and although it was a reasonable read, I was less impressed than I maybe should have been. I get Magic Leap is the thing lots of people are getting a little moist about, its seems incredible but I share a small amount of the view-point of the blogger..

Regardless if it turns out to be a consumer success or not, this is the first example of real innovation the tech industry has seen in some time. I am extremely excited to see what happens next for them and looking forward to the shake up this will put on the industry in general.

To be clear, I’m not down on Magic Leap, it is innovative but its more of the same. I only really interested in disruption right now. Something the tech industry needs (imho).

I already mentioned my thoughts about mixed reality and it hinges off the fact it’s not just visual and audible. I draw your attention to the interaction design rant (Touch), Smell and media (Smell) and of course the deeply problematic (Taste).

This paper‘s summary, sums up my thoughts, I feel…

The senses we call upon when interacting with technology are very restricted. We mostly rely on vision and audition, increasingly harnessing touch, whilst taste and smell remain largely underexploited. In spite of our current knowledge about sensory systems and sensory devices, the biggest stumbling block for progress concerns the need for a deeper understanding of people’s multisensory experiences in HCI. It is essential to determine what tactile, gustatory, and olfactory experiences we can design for, and how we can meaningfully stimulate such experiences when interacting with technology. Importantly, we need to determine the contribution of the different senses along with their interactions in order to design more effective and engaging digital multisensory experiences. Finally, it is vital to understand what the limitations are that come into play when users need to monitor more than one sense at a time.

Being able to drive and combine all these things together (even in a basic way – multisensory) has the potential to be far more exciting and immersive than Magic leap could even dream about. And its happening in dark and acdemic corners (I was maybe more excited by the vibrate API draft than learning about how magic leap may work – sad, who knows?). I’m sure they might be thinking the same but the fascination of the tech industry is on higher density A/V. Multisensory is moon shot. Being able to drive these on demand in an ethical, sustainable and contextual way is something I think a lot about with Perceptive Media. Being able to enable anyone to create their own experiences to share is the next thing.

Mindmapping the VR space

Chris McCann started mapping  out the VR ecosystem on his medium blog. I found it interesting but noticed a few missing things. I was going to craft a tweet to him but decided actually this might make better sense in a mindmap, because the stated aim is…

I wanted to get a better understanding of all of the different players and how the whole ecosystem fits together.

So I created a mindmap using the excellent mindmup and I got a chance to try out their new atlas service to show and share. I’m already thinking about collaborating with people I know and connecting some of the items together. I also wouldn’t mind doing the same on the AR side of things.