Could your desk ever be anything more than a cluttered mess of stationery, gadgets, cables and sundry other objects? Apparently, it can, according to Carnegie Mellon researchers Chris Harrison, Scott Hudson, and Robert Xiao. The team has created a system using which you can turn regular work desks into interactive surfaces on which you can use smartphone applications via augmented reality. Desktopography, as it’s called, is still a research project, but points towards the kind of technology we could have at our disposal in the near future.
The main idea behind Desktopography is to blur the lines between physical and virtual objects. As complex as that sounds, the system only really requires a depth sensor and a projector light to make that possible. Both of those components are housed within a standard light bulb fixture in the prototype created by the team.
The purpose of the projector is to beam the augmented reality screen of an Android phone onto any surface. Meanwhile, the depth sensor creates a three-dimensional map of the surface, allowing Desktopography to keep track of the various objects placed on it. With those in place, users can interact with smartphone applications on any surface, their work desk likely being the most common use-case. The system recognizes gestures to move the screen around, resize it, interact with apps, and minimize icons. And interactivity isn’t limited to the desk itself; objects placed on top of it can be used as part of the screen as well.
Xiao explains the team’s findings in a post titled “Supporting Responsive Cohabitation Between Virtual Interfaces and Physical Objects on Everyday Surfaces.” According to him, one of the main barriers to the creation of technology like Desktopography is the complexity of surfaces like desks; they’re always in constant flux, both in terms of the nature of the objects placed on them and their position. They aren’t the ideal surface on which to project a screen; we would all agree. However, the proof of concept by the team at Carnegie Mellon smartly embraces that unpredictably instead of trying to overcome it.
One way it does that is by recognizing new objects introduced on the desk, and adjusting the screen accordingly. So if you place a notebook on it, the projected screen will move and resize to accommodate itself to the nearest empty region. You can also make physical objects part of the screen by tacking apps onto them. For example, you can have the buttons of the calculator app beamed onto the cover of a notebook. The system can track the movement of any object that has an app attached to it, so you don’t have to worry about moving stuff around as long as it remains under light incident from the project bulb.
Desktopograhy cost the research team about $1,000 to build as a one-off project, but Chris Harrison tells Wired that manufacturing it at volume could bring the price down to as little as $50. That’s a small price to pay for augmented reality technology that seamlessly brings virtual objects into the physical world, and also gives you a great excuse to leave your desk messy.
Prateek Jose is a writer and engineering undergrad from India with an unhealthy obsession for obscure historical trivia. Conversations about absurdist fiction and the technological singularity make his day. He’s already uploading parts of his brain to servers by writing for websites such as this one.
- Apple September 2018 Event: iPhone XS, XS Max, and More - September 13, 2018
- Apple September 2018 Event: What’s in Store - September 11, 2018
- E3 2018 – The Highlights - June 15, 2018
I will say that the video using the system was a nice touch. This is something that would be hard to sell without the demonstration!
I am not sure that I would find a use for something like this. My desk is already tight enough the way it is and I have everything that I need right where I need it to ensure I am as productive as possible.
This could be a lot of fun if you have the time to mess around with it. I wonder how long before we see something like this featured in a movie.
If I were an investor, which I am not, I would be wondering how the company is going to get the costs down without losing the quality of the product. With delicate electronics involved here, things like that are important to know.
I would like to see this Iron Man like project for myself! It seems a little unlikely that the price could be brought down to just $50 for something like this, but you never know. The price point is what will drive the success of it that is for sure.
LOL. That is a great point. It all does seem very Iron Man like. We have all watched other television shows and movies predict tech for the future, why wouldn’t Iron Man?
I remember seeing something like this, but I think it was for a touch tone phone or computer keyboard? This type of technology has been around for a little while now and it is nice to see it being used for other applications!