Benjamin Lupton

Founded Bevry, DocPad, and Startup Hostel. Accomplished in JavaScript, Node.js, Web Development and Open-Source. Enthusiast of Quantitative Psychology, Philosophy and Trading. Available for consulting, training and speaking. Contact. Referrals.

This is an idea that I've had for quiet some time; with me occasionally enjoying the good country, blues n roots, or trance festival.

Background

PhotoSynth Introduction

A few years ago Microsoft came out with PhotoSynth; the idea behind PhotoSynth isn't anything new, but the fact that they were actually able to pull it off is more than amazing (my brain explodes whenever I try and imagine how it works). For those who don't know (and didn't bother to click the reference to find out - darn lazy people!) you give PhotoSynth a collection of photos of one particular place and it re-creates the entire environment in 3D allowing you to float around the 3D environment as well as view the source images in their actual positions and camera direction.

Original Applications of PhotoSynth

The original application the PhotoSynth people saw was its use with recreating landscapes for the use in technologies now known as Microsoft Maps and Google Earth. Which is awesome too, as no doubt in 50 years we will be able to open a 3D Earth Viewer and when we browse be able to see all the relevant photos of that location in the actual location/direction they were taken from - or even be able to generate terrain imagery from those images alone - and scan through the timeline of available imagery.

The Current Festival Experience

Your Favourite Song

You're favourite song just come on by your favourite band, you whip out your HD phone and take a few photos and a video to capture that memory forever. You also notice that everyone else is doing the same thing. The position you have in the crowd is okay, and the best you could do considering how crammed it is - but perhaps part of your view is blocked, or a tall person is in the way, but regardless you are content with where you are.

Reliving The Experience

You get home and you upload the video from your camera to youtube and watch it - but it never comes close to the shear awesomeness. You quickly realise that while you were filming that one perspective, when you were there you were looking everywhere, taking it all in, able to move around and interact with the environment, you could feel all this awesomeness that this one perspective of your camera couldn't capture.

Let's Upgrade Your Experience

Your Favourite Song

You're favourite song just come on by your favourite band, you whip out your HD phone and take a few photos and a video to capture that memory forever. You also notice that everyone else is doing the same thing. The position you have in the crowd is okay, and the best you could do considering how crammed it is - but perhaps part of your view is blocked, or a tall person is in the way, but regardless you are content with where you are. ecstatic because you know that this was your perspective and your experience of the event, and when it comes to reliving it - you'll be able to be wherever you want to be.

Reliving The Experience

You get home and you upload the video from your camera to youtube and watch it - while uploading you decide to wait that extra little bit so youtube can extract the geo-location and time of the video, then it says it's doing some awesome hard-core 3D stuff. The video is ready to watch, as your watching it you notice that the video is in a canvas which is placed in a 3D world, there is also a sidebar menu showing other videos of the event as well as a interactive timeline down the bottom. You decide to zoom out from your video and the 3D world adjusts - you can now see the back of your head and you holding your camera - you realise that someone must have been filming you a few feet back. You zoom out some more, and yep there is that person with the camera - their line of sight is clickable so you click it - you are now watching their video of your favourite song. AWESOME - their video is better quality! Must have been a iPhone 4 :P - plus you can see yourself in the video - you quickly tag yourself in the video. A dialog appears showing other videos that may contain you, there are about 3 - you decide to click through them. Wow, someone got you dancing to a song about a half an hour earlier - you've noticed the timeline down the bottom has changed to reflect the new time. You also notice that this current uploader has also taken 3 other videos - you can through the timeline and watch the 3D world change and re-construct perfectly with the time change.

Monetisation Options

Rich Multiple Perspective 3D HD Discs

Captilise on the growing 3D and HD market, as well as the richness of new media and players to create a HD disc that contains a 3D reconstruction of the event - in 3D perspective. Premium features could be to order a disc from youtube directly of all the videos and images that contain you.

Google Earth / Microsoft Maps Partnerships

Integrating this experience into a 3D Earth application will be amazing - imagine walking through the timeline of a showground over a year. You'll be able to get all the best festivals from any perspective you want.

Problems

The Record Industry

As this would rely on user submitted videos of concerts - which record labels pretty consider stealing... this idea could be an issue - though hopefully they can stick enough DRM on the 3D HD Discs to feel safe and move this along til it gets pirated and open-source.

Conclusion

What do you guys think? For myself I can't wait til this happens - would be willing to work on this undertaking too as a UI Designer and Creative Lead. Licensed under the Attribution-ShareAlike 3.0 Australia (CC BY-SA 3.0) and Copyright Benjamin Arthur Lupton 2011.