Category: xml and web 2.0

Linked data on youtube?

Triples on youtube?

I thought I’d try writing some RDF/Turtle as I see it on youtube.

<http://youtu.be/jP6kzKygaOs>
dc:title "Jason Silva on London Real talks about Vanilla Sky";
dc:publisher "London Real";
dc:subject [
  dc:subject "Vanilla Sky"
  dc:type "Film" imdb:homepage <http://www.imdb.com/title/tt0259711/>
  tmdb:homepage <http://www.themoviedb.org/movie/1903-vanilla-sky>
  ]
cities:city "London".

Kind of reminds me of when people started hacking Triples into Flickr by using Machine tags. Still its interesting to see Youtube adding the ability to add a triple in a nice clean way (if its a well used ontology of course)

The first Manchester Quantified Self Meetup

Life logging

I can happily tell the world that Manchester’s first Quantified Self Meetup will be Friday 5th July at MadLab.

Madlab will update their calendar real soon but you can sign up using Meetup.com for free.

I will be giving a talk about my work time, foodfeed.us blog and fitbit to kick start discussions. Of course we’re looking for other speakers to join me and talk about there own experiences in quantified self.

When:
Friday, July 5, 2013 – 6:30 – 8:30PM
Where:
Mad Lab: 36-40 Edge Street, Manchester, United Kingdom

Details:
Manchester QS meetup consists of Show & Tell where people present or simply talk for 10-15 mins about their experience and experiments with self-tracking, quantifying and self-hacking whether it involves devices, applications or not.

This part lasts till about 8:30pm. We then move next door to Terrance or Common, which is an essential and integral part of the meetup, as important as the first part the ‘Show & Tell’. If you can join us, I encourage you to do so. Not only it’s always good fun, the conversations are equally interesting.

Google driving…

GoogleDrive

You got to hand it Google, ups and downs…

I’ve been looking for somewhere to host my Twitter archive, and I was going to host it at cubicgarden.com but haven’t got around to sorting that out. When I saw Kevinmarks tweeted about hosting your twitter archive on Google Drive, my mind instantly went into overdrive.

Not only is Google drive a storage space but its a active webspace, where you can run scripts.

I haven’t had a play with the scripting yet, but my twitter archive is now hosted on my google drive.

One step at a time, shame you can’t run XSL on Google drive, because I would be well away!!!

Where next for the quantified self?

QSAms_NIK8113

The guardian has a article titled What next for the quantified self…

The quantified self movement – the idea that tracking metrics about yourself can lead to self-improvement – appears to be gathering steam. With products such as the FitBit One, Jawbone Up and Nike+ FuelBand boasting impressive sales numbers (the FuelBand reportedly sold out within four hours of its launch), it seems that self-tracking is finding traction and on the way to becoming an ubiquitous feature of daily life.

But how exactly can it break into the mainstream, and where does the future of the movement lie? Here are the five key areas where I see the quantified self going next.

The focus is on breaking into the mainstream which I’m not so bothered about but interesting the areas they identify.

  • App collaboration
    Agreed… The fact you have all these companies feeding date into their own ecosystems. Theres many projects to free the data from the ecosystems but thats just the start of the problem… don’t let me get my dataportability hat.
  • Real-time health tracking
    Yes the push towards real time is real and you can understand why…Faster, quicker, etc
  • Evolution of game mechanics
    I welcome an evolution because to date the game mechanics which have been used are pretty dreadful. I mean I’m a big guy, so whats the point of showing the amount of calories my super healthly friend is consuming. It almost like a kick in the teeth… “hey you fat boy think about your friend Joe when you have that last spoon of rice!” Yeah up yours… Actually talking to my NHS dietation way back when, she suggested the gamification of such things was very bad and should be discouraged. And before you think well she didn’t get it. I’ll tell you she was young (25ish) and had an android phone. An evolution in thinking wouldn’t go a miss, not that I’m saying run zombies run is a bad idea.
  • Fix the food problem
    Yes this is a big problem, and everything I’ve seen before to solve this problem is painful. Even my idea of taking pictures of everything I had to eat wasn’t ideal. Its just not acceptable to pull out your phone, hover above your dinner and take a picture in a restaurant. Yes I know people do it, heck I did it a lot but I can understand the weird looks I was sometimes getting. And heck don’t get me started on the eatery.
  • Google Glass (or wearables)
    The article goes off on one about Google Glass and privacy concerns… When actually the link to the quantified self is tedious at best. Regardless, as an extension of the phone it could be useful for solving the food problem maybe…?

Where I think the Quantified Self should go is (where its going already) mindhacking, workhacking, dreamhacking and narrativehacking.. There’s more areas it could and has gone but I won’t go there/describe them right now…

Use your imagination. Self improvement through data and numbers, enough said (smile).

Can’t wait to see and hear tales from the edge at the quantified self europe conference 2013…

Fitbit wireless syncing, almost…

I have been using my fit bit everyday to give me feedback of how much exercise I’m getting or rather not getting in most cases. However I have no real log of details because the Fitbit won’t sync on Ubuntu or even my Android devices.

However this seems to be coming to an end…

From Fitbit’s blog

Additionally, we waited until now to launch a wristband because we wanted to be able to offer wireless syncing with Android phones as well as iPhones, iPads, and iPods with Bluetooth 4.0. We’re very excited to announce that our products will start syncing with the Samsung Galaxy SIII and Samsung Note 2 in late January/early February, and more devices will follow soon! Viva la mobile!

Its frustrating still because of course i don’t own of those devices however I noticed a comment on the Fitbit app feedback

I was extremely surprised to discover that Sync works on the Galaxy Note 10.1 (n8010) even though it’s not in the supported device list. Super app, though it does loose one star as the functionality and experience is still so far removed from the desktop interface. A little consistency would be welcome, such as the ability to access activity records. Useful if you want to sync your Fitbit on the go and log driving / traveling or any exercises. Keep up the great work though! Looking forward to the next update

Seems most of the samsung bluetooth stack is supported, so when I tried it out on my Samsung Tab 7+ it almost worked. Can’t quite get the sync working but its trying. While on my HTC One X it doesn’t even give me the option.

Indeed frustrating… but I can’t wait for the next update. Reminds me I need to check in on what happening with LibFitbit

Why no twitter import?

I said on Techgrumps 66 recently that I found it very strange that there was no Twitter dump import tools/services?

Now I have my twitter data/dump, I want to host it myself which is pretty easy because there is JSON and HTML (already thought about transforming it into XML for easier transformation in the future) but I don’t understand why Tent.io, Status.net, Facebook or heck Google don’t have an option to import your twitter data?

When Twitter made the data available to you, it was clearly yours. Aka you own the rights to all of it. So you can do what you like with it now. Including handing it over to someone else to mine and use if you so wish.

It was something we talked about again while at the dataportability group, data providers who would handle, mine and make sense of your data on your behalf.

I would consider allowing Google mine the data, if it improved my already great Google Now experience.

I would also like to see my Tent.io allow me to upload all my tweets, therefore making it a heck lot more interesting and useful.

Update… Imran reminds me Timehop supports your twitter data, actually I’ve been looking at singly.com recently…

Reconnecting with half the memories

hajimemashite watashin wa. Ian desu. dozo yoroshiku

Its great looking through my Twitter archive/dump but its frustrating that I can only read half of the conversation.

Funny looking back at this tweet as it was less than a week before I had my brush with death…

6 May 10
These early morning meetings are killing me, wondering what people would say if I started setting meetings for 6pm and 7pm?

Yes just imagine… Anyway I can clearly see the gap in my tweeting From 7th May 2010 to June 9th 2010. Not a single tweet…! I also noticed theres no Direct messages in the archive so I can see… Which is a good and bad thing I guess?

Anyway enough doom and gloom…

Here’s is that classic moment which I’ve used to talk about how great open sharing can be/or how twitter is better than facebook.

From 4th January 2009…

Unfortunately you will need to read it from the bottom upwards

Although you know what happens, so it doesn’t really matter 🙂

“thank you but…” passing the card back.”I have a boyfriend, he’s picking me up from the station” so no joy but thanks twitterverse View on Twitter

so I gave her the card and smiled. she looked at it read it with richards jp on one side and my contacts on the other and said…. View on Twitter

Ok headphones are off and shes packing up. Here comes my moment. Geez  View on Twitter

@richardsproject: Ok Richard wrote it, the card is ready. I just need to know what it says View on Twitter

At Stockport View on Twitter

So i was planning to offer her one of my kitkats but i like the card thing. if Richard tells me what it says  View on Twitter

@richardsproject: Tell me what it says and i’ll do it View on Twitter

@sheilaellen: Nope only 10mins left View on Twitter

@JeniT: Ummm like what? View on Twitter

@billt: Ok now i’m laughing out loud, thanks Bill. Think she is running Windows too actually. But shes watching a film View on Twitter

Just passed Mansfield so not long till we get to Manchester View on Twitter

@cisnky: Now that would be good. But how do I start that conversation 🙂 Geez I wonder what @tommorris makes of all of this View on Twitter

@davemee: The twitterverse is my strategy, come on people I got 30mins left to make a good impression and type up my blog entries View on Twitter

@sheilaellen: Shes got headphones on, so that won’t work View on Twitter

Sitting opposite a stunning Japanese lady with a oversized acer laptop. Playing footsie under the table but no joy… View on Twitter

Microblogging dataportability at last?

Twitter data dump

Finally got the ability to download my tweets… Over 6 years of tweets in 6.8 meg of files.

It comes in a zip file not a tar file which is interesting because Facebook uses Tars for its data dumps. Structures interesting because its less of a dump and more a formal backup of your data complete with HTML file bring it all together. Theres a README.txt file which reads…

# How to use your Twitter archive data
The simplest way to use your Twitter archive data is through the archive browser interface provided in this file. Just double-click `index.html` from the root folder and you can browse your entire history of Tweets from inside your browser.
—
In the `data` folder, your Twitter archive is present in two formats: JSON and CSV exports by month and year.

  • CSV is a generic format that can be imported into many data tools, spreadsheet applications, or consumed simply using a programming language.
  • ## JSON for Developers
  • The JSON export contains a full representation of your Tweets as returned by v1.1 of the Twitter API. See https://dev.twitter.com/docs/api/1.1 for more information.
  • The JSON export is also used to power the archive browser interface (index.html).
  • To consume the export in a generic JSON parser in any language, strip the first and last lines of each file.

To provide feedback, ask questions, or share ideas with other Twitter developers, join the discussion forums on https://dev.twitter.com.

Most of the data is JSON which bugs me a little only because I would personally have to transform it all to XML but alas I’m sure everyone loves it. The CSV spreadsheets are odd and could do with being XML instead of CSV but once again sure its useful to someone out there. The nice thing is there is tons of meta around each microblog/tweet including the geo-location, time and device/client. Even the URLs have some interesting things around it, because I was wondering how they were going to deal with shorten urls, retweets and mentions…

 “urls” : [ {
“indices” : [ 69, 89 ],
“url” : “http://t.co/GSzy55vc”,
“expanded_url” : “http://epicwerewolf.eventbrite.com/”,
“display_url” : “epicwerewolf.eventbrite.com”
} ]

Doesn’t always work… specially when using urls shortener which don’t keep the url after a certain time period. Interesting internally twitter always uses its own t.co for everything…

Right now I’m just interested in the period around my brush with death… Real shame theres no references to mentions you’ve had, as I would have loved to have seen some of those. Guess Twitter were not going to delve into that can of worms…

I want to know why theres no status.net inporter?

Cnet have a overview of how and what to do with the archive. Thanks Matt

Big Data should be the word of the year

bigdata_network

I heard Geoff Nunberg’s piece on NPR’s podcast and I got to say, although I’m pretty much big dated out from BBC Backstage (in a nice way) I’m in total agreement. Here’s a few key points… Well worth listening to in audio form…

Whether it’s explicitly mentioned or not, the Big Data phenomenon has been all over the news. It’s responsible for a lot of our anxieties about intrusions on our privacy, whether from the government’s anti-terrorist data sweeps or the ads that track us as we wander around the Web. It has even turned statistics into a sexy major. So if you haven’t heard the phrase yet, there’s still time — it will be around a lot longer than “gangnam style.”

What’s new is the way data is generated and processed. It’s like dust in that regard, too. We kick up clouds of it wherever we go. Cellphones and cable boxes; Google and Amazon, Facebook and Twitter; cable boxes and the cameras at stoplights; the bar codes on milk cartons; and the RFID chip that whips you through the toll plaza — each of them captures a sliver of what we’re doing, and nowadays they’re all calling home.

It’s only when all those little chunks are aggregated that they turn into Big Data; then the software called analytics can scour it for patterns. Epidemiologists watch for blips in Google queries to localize flu outbreaks; economists use them to spot shifts in consumer confidence. Police analytics comb over crime data looking for hot zones; security agencies comb over travel and credit card records looking for possible terrorists.

It’s the amalgamation of all that personal data that makes it possible for businesses to target their customers online and tailor their sales pitches to individual consumers. You idly click on an ad for a pair of red sneakers one morning, and they’ll stalk you to the end of your days. It makes me nostalgic for the age when cyberspace promised a liberating anonymity. I think of that famous 1993 New Yorker cartoon by Peter Steiner: “On the Internet, nobody knows you’re a dog.” Now it’s more like, “On the Internet, everybody knows what brand of dog food you buy.”

Your Tent, My Tent

Sziget 2008: Tent Interior

Tent.is just launched yesterday… Unlike twitter, its a distributed service which means you can run your own or jump on someone else’s. Its not just Microblogging either, its more than just that.

Tent.is is a Tent host. Tent is a protocol for distributed communications. Tent can be used as a personal data vault, a single sign on service, and/or a distributed social network. Anyone can host their own Tent server and/or write Tent apps. In addition to Tent hosting, Tent.is provides a few basic apps to help users get started, a server admin app, and a microblogging app. This was literally the simplest app we could write for Tent. We started with microblogging because we were personally frustrated with the centralized options in the industry. The next set of apps will take Tent much further beyond Twitter-style functionality. Since developers can define new post and profile types, Tent could be used for file backups, video chats, controlling robots, and probably teleporters. Think of Tent as a way to store any kind of information forever, that you control. You might choose to share some of it with friends or colleagues in real time or long after you created it. Most importantly, Tent is yours.

Ade Oshineye has been posting some interesting things about distrubuted microblogging along with myself.

Of course I’m giving Tent a whirl although I’m just connected to the main tent.is server right now. Be keeping an eye on this one in the near future… Be great to see what new service pop up on peoples tent servers.

Is federated microblogging this easy?

everything you need for decentralised Twitter?

I’m wondering if I should bite the bullet and install these alpha and beta plugins under Cubicgarden.com? In my mind it seems what you need for a federated/distributed blogging system is just a few plugins away?

OStatus for WordPress turns your blog into a federated social network. This means you can share and talk to everyone using the OStatus protocol, including users of Status.net/Identi.ca and WordPress.com

WhisperFollow turns your wordpress blog into a federated social web client.
In it’s current form it aggregates RSS feeds in a page on your blog called “following” which it creates.
The links it aggregates are the ones from your blogroll with rss feed data.

And many more…

These would be a good time to have a duplicate setup of cubicgarden.com to test these and many more plug-ins out on..

Could Rebelmouse be used in distributed dating?

There is something which has been in the back of my mind for ages. Its the concept of distributed and dating.

It drives me crazy to see how closed the online dating world is and even if one breaks the glass, there sharply put out of business or bought. Wheres the innovation, really? I already wrote my rough idea which I believe could change the way online dating is done for the better (I won’t even point out how useful the Okcupid journals are)

On top of that is the problem of being stuck in a silo or stuck on one platform. Wheres the data portability? Wheres the interchange? Look at whats happening with Twitter and the whole controlling yourself or owning your own words.

Anyway, I was reading my feeds and came across Rebelmouse.

The service bills itself as “Your Social Front Page” and while it currently only offers up the ability to connect Facebook and Twitter to power your Lifestream, it does provide some unique features worth discussing.

So I gave it a try and its not bad, certainly a step in the right direction of what I was proposing with my online dating idea. The problem seems to be is its lack of inputs right now, which there working on. So you can only import from Twitter and Facebook. If they had generic RSS too, that would be great. The best part I like is the ability to control the flow (yes flow rather than creation) of subsets of the data. For example I can set twitter hashtags searches to…

  • save tweets to draft, ignore retweets
  • publish only tweets, not retweets
  • publish tweets and retweets
  • save tweets and retweets to draft
  • save tweets to draft, ignore retweets
  • just show timeline

So you can really craft/curate the page with minimal effort… which means you can’t just insert content unless its coming from somewhere else. Imagine if Facebook or Google+ had the same thing instead of deciding whos going to see it. I would suggest this is the more realistic way to manage a timeline because if its online, everyone sees it anyway (imho). But I digress…

I created one as a test for Perceptive Media…. and you can easily see how I could create one for myself or as a replacement for my dating profile, if I wanted too… So the next stage is to move all the stuff away from a central server and on to my own domain. Something I’ll be looking deeper at in the near future.

Google Now

At Google a lot was announced but one of the other things which didn’t receive much attention was Google Now…

Its deceptive because whats really going on… But if you read the Tim Burners-Lee piece from years ago, where he outlines the semantic web as masses of agents skimming over a universe of rich data (big data).

The real power of the Semantic Web will be realized when people create many programs that collect Web content from diverse sources, process the information and exchange the results with other programs. The effectiveness of such software agents will increase exponentially as more machine-readable Web content and automated services (including other agents) become available. The Semantic Web promotes this synergy: even agents that were not expressly designed to work together can transfer data among themselves when the data come with semantics.

I’m not saying Google just built the first agent. that would be stupid. But what they did do is capture Tim’s vision is a extremely nice way which you can see would be instantly usable for many.

Its easy to see why people write it off as a siri copy but in fact it couldn’t be further from the truth.

Like Perceptive Media, context informs the answer. I’m already seeing this happen on my Google Tasks manager Any.Do. Its looking deep into my calendar, my current phone calls, etc to understand what I want to write a task about. Leo Laporte said Now was creepy but to be honest, if it can truly help me so I don’t need to clog my mind with alternative directions, will I be able to make my appointments, etc. Then I got to say personally thats a good thing.

Demand your data from Google and Facebook

Data Portability logo

Tim Dobson sent me this over twitter for my consideration…

Tim Berners-Lee says demand your data from Google and Facebook…

World wide web inventor says personal data held online could be used to usher in new era of personalised services

Absolutely…

Seems people have forgotten the work which took place during the late 00’s as one of the founders of the Data Portability group (which still exists by the way). The group was made up of quite a few people all over the world and we successfully convinced the likes of Yahoo, Plaxo, Myspace, Google, Facebook, etc to take data portability seriously.

The turning point was when Robert Scoble tried to take his contacts out of Facebook and into Plaxo. Interesting to see Tim Berners-Lee finally getting the point.

Although to be fair he goes much further thinking about a standard way to export data.

Right now both Google and Facebook have export features and each one is very different in structure. I personally regularly export my data from them every month along with my wordpress and others. I find Google’s Data Liberation centre the best because it gives you control across the board, but then again Google do have more data from me. But right now its all just for back up purposes.

The next step which Tim hints at is the ability to transform and import the data in a standardised way. To be honest its something we (data portability group) talked and thought about, but we were maybe a little too early. Now seems about right to think about the interchange of data more than ever.

There has always been space for startups to be brokers and transformers of the data. Someone like ifttt.com could make a killing in this space, specially if they start charging for use of their pipes (something I suggested while doing the xml pipeline stuff). Could make a nice sustainable business

 

Bring your own bucket of photos

A little break from perceptive media, but don’t worry it will be back once we have something solid in that area.

I was intrigued to see two things happen one after another. I’ll have to store this one under the decentralised magic or something.

First Tim sends me a tweet about OpenPhoto which is a decentralised flickr (my words not theres)

The inception of OpenPhoto was a desire to liberate our photos and take back control. Like you, our photos are the most valuable digital files we have. Also like you, we’ve used Flickr, Picasa and Smugmug and wound up with our photos scattered across numerous sites on the web.

So I signed up and will be looking to move my pictures from Flickr to OpenPhoto when the flickr subscription runs out in May. Which reminds me I need to download all my photos using this lovely app on Ubuntu. It requires you to bring your own bucket or storage system. So right now you can either use Amazon S3 or Dropbox

Then almost like magic, Dropbox quietly announced they were doing Google+ like automatic upload of photos to your dropbox account.

Even though the holidays have passed, we’re really stoked to give you guys one more present — a new experimental release! Under the wrapping you’ll find a bunch of new toys, including a brand new Camera Upload feature. Here are the release notes:

• Automatically uploads photos and videos in the background using Wi-Fi or data plan

Together you have a complete solution to sidestep Google’s Picassa, Flickr’s reach and all other solutions. I just hope some of Flickr’s magic has rubbed off on OpenPhoto, as a decentralised Flickr is no easy feat. And I have to wonder how they stay sustainable if the money is going to Dropbox and Amazon.

Update – If OpenPhoto and SpiderOak would work together, I wouldn’t have to move anything at all. Although I’m wondering how permissions work? Wouldn’t want to just hand over my Spideroak authentication, as it has lots of my private backups. However its worth noting SpiderOak does support dropbox-like shares and Oauth, so that could work…