Computational photography, wow?

Dublin

I recently got the night shot upgrade on my pixel 2 smartphone.  Just as I got the chance to give it a try in Dublin (I only noticed it in Dublin).

As a Nikon D3200 digital SLR user, I’ve had a lot of respect for the lens, manual controls, etc… But the promise of computation photography is quite impressive.

Trinity College Dublin at night

Computational photography takes a swarm of data from images or image sensors and combines it algorithmically to produce a photo that would be impossible to capture with film photography or digital photography in its more conventional form. Image data can be assembled across time and space, producing super-real high-dynamic range (HDR) photos–or just ones that capture both light and dark areas well…

…But as much as computational photography has insinuated itself into all major smartphone models and some standalone digital cameras, we’re still at the beginning.

The images are pretty great  but thats only the start…

The coming developments will allow 3D object capture, video capture and analysis for virtual reality and augmented reality, better real-time AR interaction, and even selfies that resemble you more closely.

The idea of the smartphone capturing much more than just the light and sound is something very different from a DSLR cameras, and I don’t just mean a lytro light-field thing.  Understanding whats in the viewfinder, where it is, what angle, what material, etc, ect clearly puts them into a different category? To be fair my DSLR doesn’t even capture the location which is annoying when sorting out pictures later, for example finding the pictures from when I first went to Berlin in 1999.

There is a slight concern about using cloud based computational power. But with the pixel devices there is a special onboard chip providing local processing. This seems to be the way forward right now, although I heard others are hoping to do it via a 5G connection on a server. I can see half see why to do it, but as computational photography increases the load on the server will force companies to charge fees for server capacity. Expect extra charges added to your smartphone bill? Thats not including the costs of sending the data (but luckily the costs are dropping on this).

Its fascinating area but I wonder how much actual data will be shared with the creator/user? How much will be addressable by applications/services? Will it be locked up or funnelled out to the manufacturer, for their benefit only? I also wonder if computational photography plays havoc with the notion of the original untouched image?

Updated… Its clear although I’ve been talking about Computational photography, it should actually be called Computational capture.

Gnome Extensions vs Unity Lens

Fedora 16 & Gnome3

For sometime I’ve been trying to get Gnome Extensions (still alpha) going but for some reason most of the good ones failed to install. However when I head home (after Christmas in Bristol) I give it a try, and it suddenly all works.

Its a bit of a hassle to get it working without Firefox but now I got quite a few installed.

Including…

  • Activities Button Text – changed the text to say cubicgarden now
  • Music Integration – useful to know whats playing and change the seek
  • Coverflow Alt-Tab – Back to the Compiz style switching
  • Calculator – Great for quick calculations
  • Journal – Seems to bring up relevant stuff in the overlay mode
  • Jump Lists – You can search for categories not just apps
  • Notes Search Provider for Gnote/Tomboy – Search notes (more on this in the next post)
  • Recent Items – Rearranges the search by recent items
  • App Search – Searches for available apps not just installed apps
  • Status only icon – Removes your name from the top right

Generally I’ve installed many of them but turned off the ones I don’t really like.

Although I really like Gnome3 Extensions, I’m really liking the look of the Unity Lens extensions (for example, Youtube, Piratebay, TomboyNotes Lens) I’m seeing going by in my Google reader via sites like OMGUbuntu and Webup8.

I’m not totally sure how hard it is to create the Gnome Extensions but I gather its mainly Python with a smidgeon of JS and CSS? It would be great to see even more extensions including some of the Unity Lens ones. Certainly could make use of some of the internet connected ones…

Generally I like what the Gnome team is doing, installing a Unity Lens is much more trouble than a Gnome Extension, now all we need is many more of them and a better way to search and sort them.