Google reaches deeply into the app data

There is something special about the experience of Google now and now something extremely magical about Google now on tap.

I’ve just gotten a chance to play around with an early build of Now on Tap, Google’s wild new feature that, in essence, does Google searches inside apps automatically. It works like this: when you’re in an app — any app — you hold down the home button. Android then figures out what is on the screen and does a Google Now search against it. A Now search is slightly different from your usual Google search, because it brings back cards that are full of structured data and actions, not just a list of links.

When I first watched the keynote, I thought of the Tim Burners-Lee Semantic Web vision (paid pdf only now).

The real power of the Semantic Web will be realized when people create many programs that collect Web content from diverse sources, process the information and exchange the results with other programs. The effectiveness of such software agents will increase exponentially as more machine-readable Web content and automated services (including other agents) become available.

Its not the semantic web thats for sure, the problem is that its amazing and the user experience is magical but its all within Googles own stack. This rather bothers (even) me for many of the ethics of data reasons. I’m sure app developers may be a little miffed too?

Following my thought, Wired had a intriguing headline Google’s Ingenious Plan to Make Apps Obsolete.

What makes Google Now’s pull away from apps even more compelling is that it was joined at I/O by a series of gentle pushes in the same direction. Google’s doing everything it can to get us all back to the web.

Now if I think the Wired piece is interesting but they are shouting down from the wrong tree. Google are climbing another tree somewhere else. Ok enough with the analogies what do I mean?

If I saw Google on tap working in the browser instead of on top of apps I would be extremely impressed and be really making solid ties between Tim Berners-Lee’s agents in the semantic web. But instead we are left with something slightly disappointing, like a parlour trick of sorts.

Don’t get me wrong its impressive but its not the big deal which I first thought it was. I’m sure the Chrome team are already working on ways to surface semi structured data to Google now, and when they do… wow!

Best bits of Google now

Nearby Tasks - UI Mockup for a Google Now To-Do

I won’t lie. I do love google now and he’s my favourite google now commands…

“Ok Google, What’s this song?” – Goodbye Shazam and Soundhound

“Ok Google, Remember to call Jane when I get home” – The reminder system is good but not bulletproof as it doesn’t seem to go into my task list. However…

“Ok Google, note to self copy files to a USB drive for work” – Does go into my google tasks.

“Ok Google, how many hours difference is it between Boston and London ?” – Useful when planning virtual meetings and hangouts

“Ok Google, What am I doing tomorrow? – Useful but my calendar is clogged up with USA TV show schedules, so I usually get that first. But at least I can see the rest in one complete overview. Great for when taking the lift in the morning.

“Ok Google, do I need a umbrella today” – Very useful in Manchester!

“Ok Google, where is the nearest petrol station” – this was useful when driving through Wales a while ago.

Best for purpose apps on wearables

Android Wear and Moto 360 Smartwatch

Found via Adewale on Google+ of all places..

Watered-down smartphone apps are spreading like weeds on Google’s new wearable platform.  If you want an example of everything wrong with smartwatch apps right now, just look at all the Android Wear calculators.

Since I got the pebble smart watch, I have been asked again and again why not get a Android Wear?  For me besides the questionable battery life and overkill on screen size, I also haven’t seen much which makes me want one. Yes Google Now is compelling but not enough to fork out serious money.

However the questionable app question does apply across the board. There are some very questionable apps on the pebble too. They can do with looking at the recommend developer list.

  • Does the app provide a useful service in specific situations where taking out a phone is impractical?

  • Does the watch show users something important that they’d miss if they didn’t take out their phones in time?

  • Does the watch app save significant time without sacrificing significant functionality?

These are pretty good points… And some of the examples make sense.

Delta’sAndroid appis another example of a wearable app done right. If you check into a flight on your phone, the watch automatically provides up to date gate information right on your wrist (question two) and presents your boarding pass to use at the gate (question three).

Similarly,Allthecooks’ Android Wear functionscan save time by showing recipe instructions on your wrist. Having those instructions follow you around the kitchen makes a lot more sense than having to constantly look back to your phone or tablet for reference.

The pebble has little to no input but I have already seen apps which try and input data via a bluetooth back channel from a bluetooth headset via the phone. For goodness sake, leave it alone!

The pebble is great for notifications and to be honest I wouldn’t want to see it used for much more. Getting developers to accept its limits should be easier than Android wear but you know what people are like, push and push.

As Adewale says…

The future isn’t about trying to do everything with one device – it is about finding therightdevices to do thingsyouwant to do, and to do them in thebest possible way. Forcing an app onto a form factor it is ill suited for does injustice to both you, the concept of the app, the platform, and worst of all – your users.

Couldn’t agree more…

Why I bought a pebble watch

Pebble on my arm

Bobby asked me why I didn’t get Androidware.

I bought the pebble watch from Amazon mainly because I’m a fan of eink (although I read via steve its not actually eink but rather the generic epaper) and I’m not a fan of worrying about charging items, especially things we take for granted like watches. I tried to get one from ebay a while ago but it was at that point when they started to get popular and the price jumped up. Maybe I should have backed the kickstarter at the time.

Androidware looks really good and I love the idea of Google Now on most things but to be honest, it needs to be reliable. And reliable for me includes not having to worry about charging it everyday.

I’m sure I’ll do an update of how I’m finding the pebble in months to come. But right now I’m quite happy with the notifications coming through on the phone screen. i did play with a couple of apps and I like the idea of evernote on my arm and I need to check if I can get google tasks and calendar on there too. Also wonder if theres ifttt.com support yet?

Things which google have done which bug me in the last year

how google perpetuates itself

Most people would say I’m a fan of google services but I just find them the best of a bunch. Don’t necessary buy their old do no evil stance but they do a good job on most things. One of my favourates is of course Google Now. However there some thing which have bugged me over the last year, heres my list…

  • Offline maps
    I don’t quite understand why they got rid of offline maps but its frustrating, as it use to save me tons of money in roaming charges. If I go on holiday somewhere, I could make a offline version of that city and happily know I have most places to hand. The best thing is it still worked with GPS, so I could be in a taxi or on a bus and track where I was going to the exact moment. Now Google have removed the feature and I’m aware of the “OK Google” trick but its not the same.
  • Hangouts vs Gtalk vs Google Voice
    I know Google have changed Gtalk to fit into Hangouts. Great but whenever I say lets hangout, people assume you mean video and audio, which is a hangout on air? Where does Google Voice fit into this frame? I have no idea… Don’t get me wrong, I love hangouts but the application does kill batteries and I quite liked Gtalk, as I could use it with Pidgin.
  • Google Voice for the UK
    The one thing skype has over hangouts is the ability to call and text phones. Google Voice does this but its not come to the UK still, even after years. I also don’t understand why it works on my android tablet (I have £10 worth of credit) but it won’t work on my android phone?
  • The built in browser in Android
    On Android there is the built in browser but you can install multiple alternative browsers. So I have Browser, Chrome, Firefox and Opera on most of my android devices. You can make any of them the default but I don’t really understand why Chrome isn’t the default?
  • Circles vs Categories for contacts
    Google Plus has been on the market for some time now and I like the circles, but what I don’t get is the categories which run parallel to the circle methodology. Ideally would be able to convert your gmail contact categories into circles. But Google have done nothing. Worst still Circles acts like taxomomies rather then folksonomies meaning there a duplicate scheme to sort contacts. If one was tag/folksomy based then it would be understandable.
  • Google Task API
    I know there is a Task API but it seems so flaky or at least all the apps which connect to it like any.do
  • Inconsistency of staring something in Drive vs making it offline
    In the past, anything you stared in Drive/Doc would automatically be downloaded on Android devices. Some time recently that stopped being the case and you now have to manually select download on every device you want it on. This also can not be done remotely (from what I’ve seen). So I might have made it offline on my phone but not my tablet. The star system was better
  • Offline access generally
    Offline access generally isn’t ideal, its almost like someone at google hasn’t really experienced offline for long. Take for example Google Calendar. Offline mode, generally works without internet access, so you can go forward and backwards over a few months. But if you want to add or edit a something, forget it.
  • Google reader
    Of course no list about issues with Google wouldn’t be complete without a dig about Google Reader!

Tell us about your morning habits?

Early morning Manchester

Got a message on Twitter which originally thought was spam from HabitClock.

We are looking for the morning routines to inspire people with our new app HabitClock. You can help us by sharing the morning routine you wish to gain. Thank You!

I thought it was kind of interesting so I submitted my own morning routine.

This is what I wrote

I am woken by my lightclock. I get up straight away going to the nearest loo before checking my phone and Google Now for what I need to do for the rest of the day. At the same time, I trigger the latest Tech News Today (Twit network) on my XBMC raspberry Pi setup (Xbian) via my HTC phone. The podcast is usually about 45-50mins long.

Then I go to my kitchen boil an egg or two using my egg boiler. While that is boiling I jump in the shower, dry myself, have a shave and brush my teeth the sounds of my FM shower radio tuned into the podcast via a FM transmitter.

The eggs usually finish just after I finish in the bathroom and I can continue listening to the podcast on a FM radio in the kitchen, while I make toast and tea.

By the time the podcast is finished I have eaten, checked twitter, torrents and most important emails. And I’m ready to hit the road street to go to work. I pretty much time where I am in the podcast with how late or early I am. Although my body clock does go out of sync when the daily podcast is running long or short that day.

And that is the honest truth, although most of the time, the podcast does finish way before I’m leaving for work. So I usually start another one which slows me down again. Also forgot to mention looking at tasks and using Any.do, but heck it will do. Also reminds me I need to hook up the last.fm reporting to xbian.

Of course you can submit your own here.

Welcome to the world of the implicit

Advertising?

A while back I wrote a blog about how implicit data is the dark matter to the explicit. I also write about it in my wired/tired/expired post.

Well I thought its about time I started writing why the implicit is so rich and may become the dominating model in the future. Of course if you know anything about me and the BBC R&D project Perceptive Media, I have an interest in this area, I actually talked about context before but didn’t really make it clear that context is a part of the implicit dataset.

It started with personalised ads, currently sits with Google Now and ends with the end of internet advertising as a thing.

Yes I said it… The end of advertising… (which isn’t the same as the end of marketing btw)

Most people now prefer targeted advertising than wholesale advertising but hate the idea of minority report’s advertising nightmare. What was missing was the context.

Duhhh… In the future, surely a smart advert wouldn’t show tom cruise cars and expensive gifts while he was running down the shopping centre trying to escape. Yes it sounds pretty dumb when you add the context to the scene. Maybe showing Tom visions of holidays and trainers would make much more sense.

The end of advertising might seem a little premature but look at Google now. Then imagine Google now serving up adverts instead…

Double Duhhh… of course Google will be using the same algorithm to serve adverts if it can be proven to be even a slight bit more effective.

Although its far from perfect, the fact is with enough data and a insight into your context and implicit motivations. Google really can start to serve up adverts for things I want before I realise I actually want it (sounds freakish but its already happening). And if that fills you with fear, you better get ready as its not easily stopped. This might rely on the likes of our government not being greedy and short sighted, actually reflect the good of the people who put them there.

I’m thinking about a future where its too expensive and too inefficient to do the mass/wholesale advertising…A future where adblockers and VRM – Vendor Relationship Management is the norm, people pay to never see the adverts not targeted at you. Yes a bit of a dream but you got to dream a little bigger darling.

I have been using the term, Micro Data which is a specific part of the Big Data puzzle. Micro data is the implicit data, the data which is personal and we generate all the time. Its that Microdata which will power the next generation of services, apps and products. You can clearly see why I’m at the Quantified Self conference

Starting the day in the ideal way

Any.do new feature

I use google tasks quite a lot for many things but I’ve found Google a little crappy in support for a useful feature. The Google Task API is good and pretty universal (means even ubuntu will be supported, shame getting things gnome doesn’t), but the apps are not great.

So I started looking at applications which innovate on top of the Google task API.

Any.do stuck out by a long way. Its a very slick and I like the Android ice cream sandwich halo style. The only problem was the google tasks sync wasn’t too hot and I ended up with lots of duplicates across my google tasks list.

I stopped using it for a while but didn’t un-install it.

So I was surprised when it was in the status area.

Any.do now has a feature (any.do moment) which forces you to look at your list of tasks for the week. It sounds like a pain but honestly its actually really good.

Generally I use Google Now then I have Any.do run through my tasks. Now if only I could get Google Task syncing working reliably! Any.do I would pay money for this!

Any.DO Moment from Any.DO on Vimeo.

Black mirror s2e1: Be right back

Black Mirror s2ep1

Black Mirror season 2 episode 1

Martha (Hayley Atwell) and Ash (Domhnall Gleeson) are a young couple who move to a remote cottage, where Ash’s parents used to live. Ash is a big user of social media, tapping away on his phone, just a bit too much. Martha doesn’t really mind, she loves him and they’re looking forward to their new life together. The day after the move, Ash is killed, returning the hire van. At the funeral, Sarah (Sinead Matthews), a friend of Martha’s, tells her about a new service that lets you stay in touch with the deceased. By using all his past online communications and social media profiles, a new ‘Ash’ can be created – disarmingly ‘real’ and a help to a grieving partner. Martha is disgusted by the concept and wants nothing to do with it. Martha decides to stay in the cottage, despite her sister, Naomi (Claire Keelen), being worried about her isolation. Then one morning Martha receives an email from ‘Ash’. Sarah has signed her up. Martha is furious and deletes the message. But then she discovers she is pregnant and in a confused and lonely state Martha decides to talk to ‘him’.

*Spoilers ahead, you were warned*

Excellent episode which involves a woman losing her partner. A friend sets up her with a special system which takes all the public data of that person and generates a avatar of the data. So all those public tweets, flickr pictures, etc. First it emulates the voice and then it starts to emulates other aspects. In the end the woman is lured into levelling up  to a physical avatar.

While it seems somewhat insane… Its not as far future as you may think.

When I first started watching it, I instantly thought about Weavrs

Weavrs are your alter egos crafted from the threads of the social web.

Imagine Weavrs + Google Now…! Yes be afraid, be very afraid… You think sleeping with your partner as weavr is bad, wait till you point it at someone eles’s weavr! Or worst pointing it at yourself!  Scary and freaky stuff!

Charlie Brooker did a preview showing of black mirror at the BFI last month, which I need to watch when I get a chance (can’t get it to play on my xbmc setup unforgettably). Thanks to tim dobson for reminding me of tomscott’s piece about this a while ago… well worth watching like most of his stuff

 

Why no twitter import?

I said on Techgrumps 66 recently that I found it very strange that there was no Twitter dump import tools/services?

Now I have my twitter data/dump, I want to host it myself which is pretty easy because there is JSON and HTML (already thought about transforming it into XML for easier transformation in the future) but I don’t understand why Tent.io, Status.net, Facebook or heck Google don’t have an option to import your twitter data?

When Twitter made the data available to you, it was clearly yours. Aka you own the rights to all of it. So you can do what you like with it now. Including handing it over to someone else to mine and use if you so wish.

It was something we talked about again while at the dataportability group, data providers who would handle, mine and make sense of your data on your behalf.

I would consider allowing Google mine the data, if it improved my already great Google Now experience.

I would also like to see my Tent.io allow me to upload all my tweets, therefore making it a heck lot more interesting and useful.

Update… Imran reminds me Timehop supports your twitter data, actually I’ve been looking at singly.com recently…

Implicit data is the anti-matter of big data

Dylan [Two thumbs up for Photographers]

Almost everything we’ve focused on recently has been the explicit actions and feedback of people. But as pointed out in Perceptive Media, the rich stuff is the implicit actions and feedback. This is also the stuff which advertisers would cream in their pants for… And it sometimes feels too intimate for us to ever let it be collected… However that has never stopped anyone.

This obviously scares a lot of people including myself but I think the future is about the implicit.

I wrote a blog following a audio piece about how 2012 was the year of big data. But the fundamentally all that data is explicit data not implicit. Something I also made clear during a panel in London at last years Trans-media festival.

In a recently interview Valve’s Gabe Newell talked about the Steam Box’s future. Steam is a very interesting gaming ecosystem and recently Valve’s been moving to Linux after Microsoft said Windows 8 must work the way they said it does. Anyhow the important thing is Gabe’s discussion regarding implicit forms of data

Speaking of controllers, what kind of creative inputs are you working on?
Valve has already confessed its dissatisfaction with existing controllers and the kinds of inputs available. Kinect? Motion?

We’ve struggled for a long time to try to think of ways to use motion input and we really haven’t [found any]. Wii Sports is still kind of the pinnacle of that. We look at that, and for us at least, as a games developer, we can’t see how it makes games fundamentally better. On the controller side, the stuff we’re thinking of is kind of super boring stuff all around latency and precision. There’s no magic there, everybody understands when you say “I want something that’s more precise and is less laggy.” We think that, unlike motion input where we kind of struggled to come up with ideas, [there’s potential in] biometrics. We have lots of ideas.

I think you’ll see controllers coming from us that use a lot of biometric data. Maybe the motion stuff is just failure of imagination on our part, but we’re a lot more excited about biometrics as an input method. Motion just seems to be a way of [thinking] of your body as a set of communication channels. Your hands, and your wrist muscles, and your fingers are actually your highest bandwidth — so to trying to talk to a game with your arms is essentially saying “oh we’re going to stop using ethernet and go back to 300 baud dial-up.” Maybe there are other ways to think of that. There’s more engagement when you’re using larger skeletal muscles, but whenever we go down [that path] we sort of come away unconvinced. Biometrics on the other hand is essentially adding more communication bandwidth between the game and the person playing it, especially in ways the player isn’t necessarily conscious of. Biometrics gives us more visibility. Also, gaze tracking. We think gaze tracking is going to turn out to be super important.

I’ve recently upgraded my phone to run Google now and its so weird…

When talking about it, people say show me and I have nothing to show them except the weather and maybe a couple of calendar things like someone birthday or a appointment I have upcoming. But when waking up this morning, the phone had tons of information about getting to work. Every time I would look at the screen another option was available to me (as time passed). The lack of ability to dig up stuff and look back at stuff is really interesting, as google now is simply that… Now!

Interestingly like google now, I discovered when showing people the first perceptive media prototype, futurebroadcasts.com. I would need to use my own machine because it relies on your implicit data for parts of the play. Meaning I couldn’t just load it up on another persons machine (or at least reliably), and expect it to work the same way.

I already said its the difference which in the future will be more interesting than the similarities, and I stick to that.

I know how people love quotes… So here’s one… Implicit data is the anti-matter of big data

The trends, forecasts, etc will all be displaced (change) once we know implicit data’s place in the over all sum. We’ll throw our hands in the air and shout, well of course! How silly of us to make judgements with an incomplete sum… The early adopters are already homing in on this fact.

I wish Google Now was my phone’s default homescreen

Edd Dumbill talks about Google Now and how he uses it. Just as I thought its a very useful thing to have.

…After some weeks of use, I wish Google Now was my phone’s default homescreen. I’d happily swipe left or right to get to my apps such as email or games, but I more often search than not. The ambient information is a useful start, and I hope will get better over time.

Google Now as a home page would be great, but imagine Google Now as a alarm clock… Now we’re cooking with fire…