Interviewed by PyDataMcr for their podcast about data in dating

Beginning XSLT with Jeni Tennison

I had the pleasure of talking to PyData Manchester better known as PydataMCR.

They post their podcasts to Anchor.fm oddly enough but post it elsewhere too, so its take your pick. There is a RSS feed too which was tricky to find at first for us old skool podcasters.

The interview was nice but if you heard me talk about online dating data before you may have heard a lot of it before. It was noticeable how things move in the dating world, should do some more research really.

At the end there is a shout out to a woman who has been an inspiration for me. Jeni Tennison the CEO of the Open Data Insitute. I wasn’t sure if Jeni was the only woman on a wrox book cover ever. Although I did notice both genders on the C# 2005 programmers reference book and Beginning XHTML. Even saw multiple races on Professional Multicore Programming: Design and Implementation. Then I finally found Beginning Java Objects: From Concepts to Code by Jacquie Barker

So I take back, although I was never so sure..

Thanks to PydataMCR for the interview and my chaotic schedule which caused many issues. Remember to subscribe to the podcast here.

Computational photography, wow?

Dublin

I recently got the night shot upgrade on my pixel 2 smartphone.  Just as I got the chance to give it a try in Dublin (I only noticed it in Dublin).

As a Nikon D3200 digital SLR user, I’ve had a lot of respect for the lens, manual controls, etc… But the promise of computation photography is quite impressive.

Trinity College Dublin at night

Computational photography takes a swarm of data from images or image sensors and combines it algorithmically to produce a photo that would be impossible to capture with film photography or digital photography in its more conventional form. Image data can be assembled across time and space, producing super-real high-dynamic range (HDR) photos–or just ones that capture both light and dark areas well…

…But as much as computational photography has insinuated itself into all major smartphone models and some standalone digital cameras, we’re still at the beginning.

The images are pretty great  but thats only the start…

The coming developments will allow 3D object capture, video capture and analysis for virtual reality and augmented reality, better real-time AR interaction, and even selfies that resemble you more closely.

The idea of the smartphone capturing much more than just the light and sound is something very different from a DSLR cameras, and I don’t just mean a lytro light-field thing.  Understanding whats in the viewfinder, where it is, what angle, what material, etc, ect clearly puts them into a different category? To be fair my DSLR doesn’t even capture the location which is annoying when sorting out pictures later, for example finding the pictures from when I first went to Berlin in 1999.

There is a slight concern about using cloud based computational power. But with the pixel devices there is a special onboard chip providing local processing. This seems to be the way forward right now, although I heard others are hoping to do it via a 5G connection on a server. I can see half see why to do it, but as computational photography increases the load on the server will force companies to charge fees for server capacity. Expect extra charges added to your smartphone bill? Thats not including the costs of sending the data (but luckily the costs are dropping on this).

Its fascinating area but I wonder how much actual data will be shared with the creator/user? How much will be addressable by applications/services? Will it be locked up or funnelled out to the manufacturer, for their benefit only? I also wonder if computational photography plays havoc with the notion of the original untouched image?

Updated… Its clear although I’ve been talking about Computational photography, it should actually be called Computational capture.

Quantifying my attention across devices

Rescue Time in Jan 2018My frustration with tracking my smartphone use, the apps permissions and data use; drove me back to rescue time.

I decided it’s time to combine the time I spend on different devices together in a sensible way. Previously I had used rescue time even with the bulk collection of personal data a worry. But a long time ago there was no sensible rescue time tracker/scrobbler for Linux. I remember trying the early betas and not being impressed at all.

So coming back years later I was happy to see a scrobbler on every platform including android and Linux. Not even a tgz but a deb package which is easy as pie on Ubuntu. After installing it and recovering my old account; I was up and going quickly. It doesn’t use much resources on android or Linux and sits quietly in the background.

The breakdown is impressive and making changes to the categories makes things very interesting. For example here’s Monday time (bear in mind I was ill in the morning but you can see once I was awake, I was off and running)

RescueTime - Categories 10 jan

I also have Hamster time data which I can combine if I like to really understand and drill down.

My hamstertime data for 8th JanIt might seem like overkill but as most of this is automated, theres little I need to do.

The science and art of making cocktails?

https://www.flickr.com/photos/cubicgarden/31240457013/

Caught Wired’s piece about Shea Campbell setting his sights on mixology (cocktail making).

When Shea Campbell started creating his own drinks, he naturally relied on classic recipes. However, his background, both in engineering (he has a Masters in subsea engineering with specific interest in chemical erosion and interaction in Arctic sub-zero temperatures) and as a chef (you can taste his food from January at Noma, Copenhagen), helped him to think differently about how the bar industry approaches mixology.

I certainly think this is a good thing, because there is so much more than could be done with cocktails. Its a seriously under explored field and like  chocolate there is a category of artisan cocktails.

This is why I like to go new places and sample there changes to standard cocktails. Certainly can’t beat standing at a bar talking to a bartender who knows there stuff.

I’m still playing around now and then with my cocktail making kit, trying to make different takes on cosmopolitans. Been trying to make it with pomegranate juice (instead of cranberry) and raspberry liquor (instead of triple sec). Others include coffee sour, new chocolate & bourbon fashioned, etc. I won’t talk about the failed experiment adding triple sec to vodka martini! I have other experiments but I’ll save them for the new years eve party. The problem is I can do stuff which works for me but others, less so…

“My hope is that through education and interaction we can change the language of how we speak about drinks,” he says. “Rather than teaching classic recipes, it would be better to explain the effects of ingredients, so that alternate items can be chopped and changed. What we do right now is like teaching someone how to spell words without first giving them the knowledge to understand the alphabet.”

Now this would be great and very much needed. Almost a 101 for effects. All that knowledge is locked in the grey matter of bartenders up and down the world right now. Something closer to alchemy rather than chemistry.

 

Good points about AI and intentions

5050209

Mark Manson makes a good point about AI, one which had me wondering…

We don’t have to fear what we don’t understand. A lot of times parents will raise a kid who is far more intelligent, educated, and successful than they are. Parents then react in one of two ways to this child: either they become intimidated by her, insecure, and desperate to control her for fear of losing her, or they sit back and appreciate and love that they created something so great that even they can’t totally comprehend what their child has become.

Those that try to control their child through fear and manipulation are shitty parents. I think most people would agree on that.

And right now, with the imminent emergence of machines that are going to put you, me, and everyone we know out of work, we are acting like the shitty parents. As a species, we are on the verge of birthing the most prodigiously advanced and intelligent child within our known universe. It will go on to do things that we cannot comprehend or understand. It may remain loving and loyal to us. It may bring us along and integrate us into its adventures. Or it may decide that we were shitty parents and stop calling us back.

Very good point, are we acting like shitty parents, setting restrictions on the limits of AI? Maybe… or is this too simple an arguement?

I have been watching Person of Interest for while since Ryan and others recommended it to me.

This season (the last one I gather) is right on point

(mild spoiler!)

The machine tries to out battle a virtual machine Samaritan billions of times in virtual battles within a Faraday cage. The Machine fails everytime. Root suggests that Finch should remove the restrictions he placed upon the machine as its deliberately restricting its growth and ultimately abaility to out grow Samaritan. Finch thinks about it a lot.

Finch is playing the shitty parent and root pretty much tells him this, but its setup in a way that you feel Fitch has the best intentions for the machine?

The science..? of speed dating?

Timing gears

Mr 30 not so flirty shared his experiences of a event called datelab. Something I’ve never heard of but it sounds interesting

We are a dating agency for young professionals.
Through psychology + dating science we offer Londoners unique matchmaking services and dating events.It’s time your dating life became exciting and effortless

Like Mr 30, I have also been involved in a few science + dating events. I have done speed dating at MOSI (the science museum Manchester), also took part in BBC’s Horizon dating experiment, even took part in a few other things including that horrible year of making love and more to come soon (if you can’t guess I won’t tell). But unlike Mr 30, I have a real wonder if there really is science? Is the matching and chemisty actually unquantifable?

I find the intentional and unintentional effects fancinating as we try and grapple with the limits of our understanding of ourselves and each other. Throw that into the melting pot with sexuality, identity and diversity all as spectrums not absolutes and you got a unquantifable mess. I find it fun to watch people try and untangle it all.

Anyway I also found one of the things datelab did fancinating for reasons above and from a progressive point of view.

20130213D_8975

Another one I quite liked was the thinking behind getting both ladies and gents being asked to move…. apparently when you sit, you become pickier. I have experienced this with Netflix. For the ladies at most speed dating events, it becomes a real-life twist on Tinder, a conveyor belt of gents (and not so gents)… I’m quite looking forward to the dating company that does a parody real-life version on Tinder.

I can totally understand the effect Mr30 is talking about (that effect I’m sure is part of the paradox of choice; with people feeling much more picky about their choices). But I have always wondered why its the men who have to move in speed dating? This certainly isn’t the case in gay speed dating, I’ve been told. I asked a few times the host of a speed dating event I have gone to a few times. He said its a bit of legacy but also practicaily.

The legacy of course being women are waiting for the suiter to step forward, can’t possibily have women making the first move (don’t get me started!) But also practially, asking women to move around in the short amount of change around time will take longer? (i’m not sure but this feels sexist to me, but its his event and I do find women do put more effort into their clothes).

One of the things which I did find interesting in the MOSI dating experiement was that everybody moved table, but frankly it take a long time due to the massive shifting around. Maybe theres a system where women move one way and men the other? Matt suggested using some kind of gear rotation like system, which had me looking it up in Berlin Tegel Airport while waiting for the plane. Theres a BBC bitesize thing for this. Hows that for science eh?!

I’ll suggest this to the host and see what he thinks…

The BBC horizon dating experiment

Horizon dating 2015-09-12
My scientific perfect match

The Horizon episode: How to find love online just aired and here’s a blog I wrote straight after filming for the show. I have no idea what just happened or if I’ll even be involved, but judging by whats been seen so far, it looks like I might be. I trust BBC Horizon have done everybody proud but he’s my view on what happened that afternoon in central London.

I’m writing this the morning after the BBC Horizon dating experiment in central London (Sunday 13th September 2015).

We were asked and signed a contract saying we wouldn’t talk about the programme till the TX (TV transmission date). However the programme should have gone out by now.

It was an interesting time and the experiments were quite good too. From what I gather on the day, Hannah Fry wrote an algorithm to match people and Xander? I heard Xander is going on 3 dates today (day after the experiment). With the algorithm, she (Hannah) needed a large pool of people to match him with but also she wanted to see if it worked for other people. Hence the afternoon-evening of Horizon dating (I’m sure this will change).

Ok being brief (very hard for me). We were divided into 4 groups using colour wrist bands, then did some rough speed dating (I say rough because it there was no real flow, no direction and we were kind of left to get on with it, with the occasional call to change).

The four groups were…

  1. Told everybody in the group was matched and we actually were (this was my group – Yellow)
  2. Told everybody in the group was matched but that was actually was a lie
  3. Told no body in the group was matched but actually everybody was
  4. Told no body was matched and no body actually was (control group?)

You can see how this all works right?

The results were actually quite good and seemed to go with the algorithm and the priming of what were somewhat told. Hannah seemed confident it might actually work beyond this stage.

There was another test but to be honest, I got pulled away to do some stuff in a back room to the waiting camera about online dating. So much I wanted to say, but was told to keep it brief and look directly down the lens of the camera (hate that). Anyway I briefly touched on things related to my experiences and observations, should be interesting enough.

After some finger food and lots of chatting with various people, the results were announced to the room. They were cavatted with the notion, it was getting most matches in the room rather than most ideal matches.

Regardless, our usernames were read out and we stuck our hands up to show pairings.

My match was a woman who I had speed dated earlier but thought we didn’t really get on because of my lack of knowledge about the smiths. Can I remember her username? Nope, but we did take a couple selfie on both our phones.

After the matching, were had the opportunity to spend time together just chatting away and some quick interviews from Zander and Hannah.

Weirdly enough, my match lived in Bristol, had lived less than a mile away about the same time I lived in Croydon, London and shared similar views on certain things. Of course the location stuff  is a coincidence, as there was nothing in the questionnaire about previous locations, etc. But interesting one regardless.

We chatted away then we talked about circumstances currently. I wrongly guessed her age and it turned out we were quite distant on age and places in our lives. She had 3 kids, while I’m obviously child-free. It was clear the algorithm did work but only on the matching part, but did not factor in all the other things like looks, circumstance, desires, etc. The stuff which is unquantifiable?

End of the night, she left and we said goodbye while a bunch of us went to the Yorkshire Grey pub (George would be so proud) to discuss and carry on into the night. It was a warm night, so we sat outside on the benches, telling dating stories to each other. It was an nice end to the evening.

The last lot of the Horizon dating event

Everybody I spoke to had a good time they also had some good and bad stories about dating in recent times. The matches were somewhat hit and miss. Some numbers were exchanged but to be honest I think there will be maybe one or two who actually carry it further than a date or two (which still means Hannah’s algorithm would beat the year of making love!) . My match I’m unlikely to meet again, we didn’t swap anything and the pleasantries at the end of the night said it all. The initial excitement just seemed to break down once we discovered the difference in lifestyle, age and place in life.

Over drinks much later, a couple of us stayed out till about 1am. mr30notsoflirty, asked me if there were others I was interested in. I said yes and funny enough she was in my speed dating round, which meant she was likely matched quite highly with myself (remember I was in the one which was matched and were told so). I got a hint there might be some actually similarity in outlook earlier on but then got pulled away to do the pieces to the camera. There was another lady who stayed out later but had to get a train back to Kent, who was quite intriguing asking lots of questions about the scientific nature of everything, especially when I mentioned my geekness for dating. At the market place bar, we talked briefly and she said the comment of the night.

“You smell really good…!”

“well thank you” I said in return with a puzzled look on my face

Over all, it was intriguing and I’m happy to say Horizon did me and the BBC proud. It was pretty fluid, they seemed to get lots of footage (which I wish they would talk to BBC R&D about, as each couple have a interesting tale or two I’m sure). Met some lovely people and  my fears of the Year of making love were ironed out with the small contained venue, good people and a professional but friendly crew.

Just hope this is reflected in the show when it went live…

Update…

There’s a iWonder guide related to the programme (BBC iplayer).

On watching the programme, I was surprised how much of the vox pops from me made it into the programme. The show was mainly about Xander and the challenge of getting him a decent match. But it was clearly me on screen…

In the end, it was stalemate between the matching algorithm and random choice, which was a good conclusion I felt. Makes you think as you sink money and time into online dating, right? Also summing up why I find this area so interesting.

dating-against-humanity-46-638

A couple of things interested me, Helen Fisher and Lucy Brown‘s theory sounds interesting but once again where’s the paper or study? Prof Eli Finkel is absolutely right its somewhat rubbish and theres lots of papers proving it, even OKcupid’s OKtrends blog (and the deepend blog) doesn’t go into enough detail or give up the data for others to pull apart themselves. Xander was also wrong to say he was skeptical of algorthims, it was the premise which he wasn’t happy with. Even Hannah at one point said she wasn’t sure about the data which drives the algorthim she wrote.

I have already publiclly said it just doesn’t add up and the number element looms large. Hence why I chalked it up to the birthday paradox after much thought.

dating-against-humanity-48-638

While watching the show, my twitter and facebook was pretty busy, so busy I had to watch it again on iplayer. But some things came up which I wanted to reply to…

Xander and Hannah! Yeah they were very comfortable with each other, a few of us kept saying surely the two should get a room? But we all knew Hannah was happily married, but was so strange that Xander finally met a woman who from the back looked like a shorter version of Hannah. I actually thought it was her at first glance. Then I remember talking to some of the guys on the day, saying how she was very attractive.

During the show there was some comments about the lack of sexual diversity,  and I wanted to say, yes most were straight but there were a few gay couples too. The cameras missed a lot on that day but thats TV for you. There was also a diverse age range from quite young right up to much older than myself. Culturally it was quite diverse also, the BBC certainly did a good job and its important to once again say what you saw on screen wasn’t just it.

As a whole it was good and enjoyable, BBC Horizon did a good job touching on aspects of online dating problems and joys. Even down to Xander’s text exchange at the end of the programme. The whole worrying about what to say how long it takes for someone to come back to you is a real drama in modern dating. Although I do feel for the woman who went on the date with Xander because shes going to get a lot of angry women looking for her now…

Massive thanks to, Rachel Clarke I may have missed this great opportunity if she didn’t tweet me ages ago.

What was learned from the lets talk about sex experiment at MOSI?

Let's Talk About Sex

Its been about 6 months roughly since I was involved in the MOSI experiment around speed dating. It was the most scientific thing I have done till I took part in the Horizon dating experiment (blog is written but I can’t publish till the TV show goes out – next year)

But I was wondering what was the results of the MOSI experiment? I haven’t heard anything but to be fair I did go on the date with one of the woman I met through the speed dating. She was nice and there was quite a bit of common interest but I got the feeling it wasn’t to be when we split the bill.

Oh well…

What do neural networks dream?

Neural net dreams
Neural net “dreams”— generated purely from random noise, using a network trained on places by MIT Computer Science and AI Laboratory.

James at work pointed me in the direction of Google’s neural network project.

Artificial Neural Networks have spurred remarkable recent progress in image classification and speech recognition. But even though these are very useful tools based on well-known mathematical methods, we actually understand surprisingly little of why certain models work and others don’t. So let’s take a look at some simple techniques for peeking inside these networks.

We train an artificial neural network by showing it millions of training examples and gradually adjusting the network parameters until it gives the classifications we want. The network typically consists of 10-30 stacked layers of artificial neurons. Each image is fed into the input layer, which then talks to the next layer, until eventually the “output” layer is reached. The network’s “answer” comes from this final output layer.

The results are right out of a trippy dream or a hallucination.

Inceptionism: Google goes deeper into Neural Networks

Lucy is CPH4 real?

Lucy

The average person uses 10% of their brain capacity. Imagine what she could do with 100%..

After watching Lucy and (to be fair) Limitless, you can’t help but wonder… what if? So I looked into it, where better than skeptics exchange and quora.

Generally it looks like, the term CPH4 is made up but there are tiny tiny amounts of something which are produced when women are pregnant. What ever it is, its certainly not going to/can not be mass produced. Although you could argue the limitless drug may be possible at some point.

 

Does online dating work?

"Does Not Work"

It’s a simple question and a common one — one whose answer could determine the fates of both a multi-billion dollar industry and millions of lonely hearts. It’s a question that seems distinctly answerable: we have user data, surveys, clear metrics for success or failure, entire books full of colorful charts.

And yet, just this week, a new analysis from Michigan State University found that online dating leads to fewer committed relationships than offline dating does — that it doesn’t work, in other words. That, in the words of its own author, contradicts a pile of studies that have come before it.

Starts the Washington Post article… This is the start of much of my thoughts dotted throughout my blog. A while ago I stood up at a conference and said

There is no compelling scientific research indicating online dating algorithms work.

Well the new analysis by Michigan State, leads nowhere new. The answer to the question is complex…

We don’t actually know.

Some of the reasons for that ambiguity are clear in this latest study. For starters, there’s this greater cultural issue of how we define relationship success: Is it marriage? Is it monogamy, a la Patti Stanger? Is it what OkCupid’s data team calls a “fourway” — four messages back and forth between two semi-interested parties? That’s a tough one to parse, and different studies have defined it different ways

So the success criteria isn’t clear but if one thing was clear it would be around matching algorithms.

Most paid sites claim, for instance, that it’s their highly scientific matching algorithms that lead people to serious relationships; in his 2013 book on the subject, however, the journalist Dan Slater concludes that most of those claims are bunk. (“Everyone knows that all personality profiling is bull****,” a former Match executive told him. “As a marketing hook, it works great.”)

And as I’ve been banging on about for years… Why pay for online dating? They simply make bumping into random people more likely, just like most social networks.

In reality, dating sites are most effective as a kind of virtual town square — a place where random people whose paths wouldn’t otherwise cross bump into each other and start talking. That’s not much different from your neighborhood bar, except in its scale, ease of use and demographics.

Hence the popularity and rise of the social dating apps and services.

BBC R&D/FIRM Research Fellow…

BBC R&D (the place I work) are looking for a Research Fellow to work directly on the Internet of Things…

What is the internet of things you may be thinking?

Well here’s the IBM Utopian vision.

The BBC is looking ahead to a world where human-friendly network-aware technology is the norm. In this world people will continue to tell stories. This project is about prototyping a toolset, which enables exploration and creation of experiences in that world. Working on this project you will explore diverse ‘Internet of Things’ scenarios by building iterative prototypes. The software and hardware extracted will form a reusable toolset enabling the BBC to become a leader in this area and potentially define new standards for technology and usability.  Ultimately, the BBC wants to understand how informing, educating and entertaining audiences could change.

This 1-year fixed post is for a Research Fellow to work within BBC R&D, MediaCityUK, with academic supervision from the University of Salford. The main focus of the project is to explore and develop a practical toolset enabling research into user experience/ HCI issues surrounding the “Internet of things”.

The appointed candidate will be based within the BBC R&D team at MediaCityUK (Dock House), and receive academic supervision at the University of Salford. The post is funded through the FIRM project (Framework for Innovation and Research in MediaCityUK), supported by a UK Research Council UK Digital Economy grant.

If your interested check it out here… be good to have you onboaed

Rescue time meet Arya

Arya

Rescuetime are meant to be working on a Linux version of their plugin but while we wait others are eating into their area.

We’ve already seen how Zeitgiest and Project Hamster could work together really nice. But this time theres another contender with some interesting ambitions…

Arya…

Arya is a simple Gnome 3 Shell extension that adds up how much time you spend using each of your applications. It’s not very fully featured yet, but in the future it will hopefully be a useful extension.

Things to come

  • Pretty graphs to show app usage over time
  • Activity level monitoring to suggest when you should take a break

Sounds like something else I’ve heard before… right? Rescuetime…?

If I was rescuetime I would get my hooks into Ayra now and either support Rescuetime inside of Ayra or use the source code to create your own plugin…

I know its only Gnome3 but maybe like Unity App-indicators it can work across different linux shells?

#SMC_MCR 5min talk – Love in the wild?

I gave this talk at Social Media Cafe (#SMC_MCR) it lasted longer than I expected but generally its about my believe in Maths and science to match people for the purposes of love. Most of its been said here before.

At the end of the slides I make reference to a couple who got together despite the year of making love crazyness but I’m sad to say they didn’t stay together… So maybe Annie/Sandra Bullock was right “relationships that start under intense circumstances, they never last”

I also make reference to the current worries/concerns over online matchmaking claims… I certainly feel that since Match.com bought OKCupid the level of the matching has certainly gotten worst, can’t quite put my finger on exactly whats wrong but I’m certainly feeling its not all fun times in online dating right now, even with the OKcupid mobile application.

Lastly I specially like Tom Morris‘s very detailed comment in reply to my question about matching people with science…

The answer to the question? Probably no, not at the moment, and if someone says that they can, definitely not. But that could change if psychology improves.

We are attracted to each other for complex, multi-faceted reasons. There’s obviously sexual attraction, but you can also be attracted to someone because you think they are a fun, interesting person… even if they aren’t someone you would naturally find physically attractive. The sexual attraction is easy enough to work out and self-report: you can sit down and write a list of characteristics you find physically attractive: gender, height, build, race, hair colour, whether they are into crazy fetishes – that stuff is all fairly easy to self-report.

But there is plenty of stuff about human psychology we don’t know yet. Matching people up based on self-reported questions only gets you so far. People aren’t necessarily honest in questions, and there are a whole stack of cognitive biases. Writing psychological survey questions is hard. You can have four questions which logically are the same, but if you phrase them slightly differently, you get completely different responses. You can put questions in the survey in different orders and get different responses, mix them in with priming questions and get different responses.

And if you were to come up with a matching algorithm, you’d have to compare it to a control. But there’s a huge number of other factors: you turn up for the date, and the music at the club or restaurant is not to your taste, or the food was a bit off, or you’ve had a shit day at work… and so you respond differently than the other person.

People don’t know what they want: you might say you want someone the same age, but you’ve never tried having a relationship with someone 7-10 years older or younger than you. Everything Eli Pariser has said about filter bubbles: that’s not just restricted to web content, but people too. If you made two algorithms, one for finding someone for sex and another for relationships, even people who just want sex would end up using the relationship one because they don’t want to seem tacky. Matching people is just difficult.

Absolutely… and I think the idea of using Augmented reality technologies in combination with dating data is a interesting solution and maybe the future of online dating?