MIT Invents A Shapeshifting Display You Can Reach Through And Touch

The Tangible Media Group at MIT's Media Lab has unveiled a futuristic display made of atoms, not pixels.

We live in an age of touch-screen interfaces, but what will the UIs of the future look like? Will they continue to be made up of ghostly pixels, or will they be made of atoms that you can reach out and touch?

At the MIT Media Lab, the Tangible Media Group believes the future of computing is tactile. Unveiled today, the inFORM is MIT's new scrying pool for imagining the interfaces of tomorrow. Almost like a table of living clay, the inFORM is a surface that three-dimensionally changes shape, allowing users to not only interact with digital content in meatspace, but even hold hands with a person hundreds of miles away. And that's only the beginning.

Created by Daniel Leithinger and Sean Follmer and overseen by Professor Hiroshi Ishii, the technology behind the inFORM isn't that hard to understand. It's basically a fancy Pinscreen, one of those executive desk toys that allows you to create a rough 3-D model of an object by pressing it into a bed of flattened pins. With inFORM, each of those "pins" is connected to a motor controlled by a nearby laptop, which can not only move the pins to render digital content physically, but can also register real-life objects interacting with its surface thanks to the sensors of a hacked Microsoft Kinect.

To put it in the simplest terms, the inFORM is a self-aware computer monitor that doesn't just display light, but shape as well. Remotely, two people Skyping could physically interact by playing catch, for example, or manipulating an object together, or even slapping high five from across the planet. Another use is to physically manipulate purely digital objects. A 3-D model, for example, can be brought to life with the inFORM, and then manipulated with your hands to adjust, tweak, or even radically transform the digital blueprint.

But what really interests the Tangible Media Group is the transformable UIs of the future. As the world increasingly embraces touch screens, the pullable knobs, twisting dials, and pushable buttons that defined the interfaces of the past have become digital ghosts. The tactile is gone and the Tangible Media Group sees that as a huge problem.

"Right now, the things designers can create with graphics are more powerful and flexible than in hardware," Leithinger tells Co.Design. "The result is our gadgets have been consumed by the screen and become indistinguishable black rectangles with barely any physical controls. That's why BlackBerry is dying."

In other words, our devices have been designed to simulate affordances--the quality which allows an object to perform a function, such as a handle, a dial or a wheel--but not actually have them. Follmer says that's not the way it's supposed to be. "As humans, we have evolved to interact physically with our environments, but in the 21st century, we're missing out on all of this tactile sensation that is meant to guide us, limit us, and make us feel more connected," he says. "In the transition to purely digital interfaces, something profound has been lost."

The solution is programmable matter, and the inFORM is one possible interpretation of an interface that can transform itself to physically be whatever it needs to be. It's an interesting (and literal) analogue to skeuomorphism: while in the touch-screen age we have started rejecting interfaces that ape the look of real world affordances as "tacky" in favor of more pure digital UIs, the guys at the Tangible Media Group believe that interface of the future won't be skeuomorphic. They'll be supermorphic, growing the affordances they need on the fly.

Although the inFORM is primarily a sandbox for MIT to experiment with the tactile interfaces to come, it would be wrong to dismiss this project as mere spitballing. "We like to think of ourselves as imagining the futures, plural," Follmer says. "The inFORM is a look at one of them." But while the actual consumer implementation may very well differ, but both Follmer and Leithinger agree that tangible interfaces are coming.

"Ten years ago, we had people at Media Lab working on gestural interactions, and now they're everywhere, from the Microsoft Kinect to the Nintendo Wiimote," says Follmer. "Whatever it ends up looking like, the UI of the future won't be made of just pixels, but time and form as well. And that future is only five or ten years away. It's time for designers to start thinking about what that means now."

Add New Comment

56 Comments

  • Si yo estudio Ciencias de la Computacion puedo hacer eso o me conviene estudiar otra cosa como ingenieria de software . Por favor necesito su ayuda . Muchas gracias . Saludos desde latinoamerica .

  • melodicmizery

    this idea kind of fails for a number of reason. first let me say the idea is pretty neat it could lead to alot better designs so its a good start. ok so the bad stuff. first off the price is going to be ridiculous. look at that enormous machine that hting isnt going to be cheap and for the amount you pay for that machine you could prob buy 100 plane tickets. 2nd the size of that machine takes up a huge amount of space. and youll need both machines which is even more money and space. the only good thing you could use this for is holding hands with a loved one, but you cant do that at the same time since you have to use 2 diff machines at the same time and then switch machines. one person is always on the laser analyzing end while the other is on the square block end. so while you may be holding your hands on one end, the other end the person is feeling your hands with the blocks. youll have to switch back and forth which isnt very genuine its kinda pointless really. i really dont see any use at all for this machine, and even if you do find use like i said only one side gets the pleasure of it while the other side is doing the work. itd be a neat machine for like 50 bucks to toy around with for a day. but the price is going to be enormous

  • Tim Streker

    Your list is flawed. Price? Look at every other piece of major technology and how it started? The first computer wasn't cheap. Then first Blu-ray player? Size is another weak example. Look at cell phones. This is the first step to something larger. You're basically over analyzing and complaining about the model T. You're really blind enough to not see any use for digital control over a distance? Really?

  • Bube

    I'd really like to see the psychological effects of this technique in phone calls; not in the phone-sex sense, but 'hold my hand, I miss you' kind of sense.

    What I mean is, what would the participants feel when they experience pseudo-physical contact with loved ones?

  • melodicmizery

    it kind of fails because its one sided trying to touch someones hands you cant feel interaction at the same time you have to take turns

  • ystocks

    I hypothesize that it would be just like real. "It's the thought that counts"....and when someone on the other side of the call tries to hold your hand to comfort you or to signal his/her feelings for you, then your mind interprets it in the same way as if that person was there. The physical sensation of human skin, warm hand (although sounds good), probably matters much less.

  • Aaliyah

    Awesome invention.. can change the way of doing thing.. but little bit smaller.. if compiled on large scale.. it can increase its work scope.

  • Carlyle

    well.....you look the board, it still so big and full of cables attched, maybe, cannot have a good sex experince at all.

  • Ian Martin Adams

    This looks good, but can this be made much smaller. and the squares to be much smaller for further detail. Great concept.

  • longlivethephoenix

    i love how this could revolutionize industries everywhere....and the first thing we go to is porn and sex.....

  • markvturner

    Yes, and considering how much time and energy we spend on sex combined across all of humanity, that is perfectly appropriate.

    Not everything needs to cure cancer or do something equally serious. We need to have some fun too. Take it easy, jeez!