September 11th, 2008

Radiohead's City Street

Available to download from Google is a small part of the data set from Radiohead's recent House of Cards music video, shot entirely without cameras — just LIDAR and 3D capture. Part of the idea is that fans will be able to remix the "footage" or mash it up in some way.

This is tremendously cool and very thoughtful of Radiohead to copyleft this part of their work.

Unfortunately Google or Radiohead has only provided a one minute sample of the animation data, which isn't much to work with. Of the 14,000 data downloads and counting, I think this probably explains why no one has come up with anything too striking on the YouTube Remix Group.

Still, I grabbed the data and got to work. First step: better tools. Personally I feel the Processing code is just too slow and painful to work with. OpenGL really needs to be run through native code.

So the first app I wrote is a Obj-C based first-person browser of the city street landscape (which includes 1.3 million vertices). It's intel Mac-only and completely untested, but if you're daring it might be fun to play with. It takes a couple seconds to load all the points, but then runs surprisingly fast. I get 30fps on my first-generation MacBook Pro.

hoc-teaser.png

You can download it [FIXME: HOC-CitySceneViewr.zip] or watch a quick demonstration on YouTube.

Two more apps are on their way. One just displays the other landscape; the other is a facial animation viewer of Thom. These projects are layered on top of a custom OpenGL threaded graphics framework I built four years ago — just something that comes in handy from time to time. In a way it has kind of evolved into its own mini-version of Processing, without the performance penalties.

If Google decides to release more of the data, one thing I suggested is not distributing the vertex points as CSV data. It makes it much bigger to download and slower to parse. Why CSV anyway? Hopefully people aren't opening this stuff up in Excel. Save it as binary! We can handle it. Here's some code to do it:

http://files.carsonbaker.org/hoc/csv_to_binary.c.txt

Also — for anyone that might know:

It's not clear to me how the Geometric Informatics capture hardware works. What's the technology behind it? How much does their GeoVideo system cost? I'm having a hard time finding this out.