In HideOut, a smartphone-sized projector lets kids (or adults!) control digital content "thrown" onto physical surfaces.

Motion-tracking technology in the projector ensures that the anamorphic projected images stay oriented in a way that preserves the illusion of 3-D, relative to the viewer.

HideOut’s interface might be just as useful outside children’s media. Here it is being demo’d as a photo browser.

Machine-vision codes printed in ink only visible in the infrared spectrum control HideOut’s interactivity.

HideOut’s prototype projector is about the size and shape of a smartphone--and may be embedded into them in the near future.

A children’s picture book augmented with HideOut’s "invisible ink," which controls the interactive projections.

HideOut’s digital interactions are embodied via the projector "in a lightweight and exploratory way," according to Disney Research.

HideOut’s technology creates an illusion where projected characters seem to be "really there" in the physical world, interacting with tangible objects.

Invisible computer-vision codes in the tangible pieces make the projected characters react to them. Here, the characters march away from a brick wall they can’t pass through.

HideOut can augment physical board games in intriguing ways, by combining digital characters with tangible game pieces.

Co.Design

Disney's Magical Flashlight Brings Kids' Books To Life

A focus on "lightweight interactivity" makes this prototype feel fun, not overly fussy.

Maybe being the dad of a toddler makes me overly skeptical of "enhanced" or "augmented" children’s books and toys, but I’m usually unimpressed with efforts to future-ify an experience that seems to work just as fine now as it did when Goodnight Moon was first written 66 years ago. Then I saw HideOut, a new prototype from Disney Research that uses a handheld projector to bring animated characters to life on the surface of a book or board game. Okay, now I’m impressed:

A smartphone-sized handheld projector, surprisingly enough, looks like just the right kind of "extra" to add a bit of genuine magic to the experience of reading stories to your kid. What I love about HideOut is the un-fussiness of this interaction: There’s no app to launch, no requirement of peering at the "augmentations" through the keyhole of a screen. The child can move the projector around and watch what happens to the animated characters without "popping out" of the shared experience of reading together—experiencing the "interactive content in a lightweight and exploratory way," according to HideOut’s documentation.

Those two words—"lightweight" and "exploratory"—are the key, and for once they don’t sound like lip service. Karl Willis, the lead researcher on HideOut, tells Co.Design that "the projector acts like a digital flashlight through which you explore the physical world. This is much more immediate and 'physical’ than the screen-based augmented reality we commonly see." The book—a tangible artifact whose "user experience" has been perfected over the past, oh, six centuries—is still a book. But the dynamic digital layer is metamorphosed via the projector into a pseudo-tangible artifact as well, that responds in evident and meaningful ways to the physical environment it happens to be in. When a projected character in HideOut encounters a physical wall on a board game, or a drawn wall on a page, it responds to that object as if they were both "really there." To use designer Paul Dourish’s term, the interaction is "embodied."

The technical details of how HideOut creates this embodiment are clever—IR-printed machine-vision codes, invisible to the naked eye, act as triggers or controllers for the projector, which also uses a camera to track and match the projected images on-the-fly to physical orientations of the book or board game. What this means is that even if the child wiggles the projector around (which they will—how else are you supposed to play with a magic flashlight?), the illusion of three-dimensional "really-there-ness" in the digital characters won’t be broken. "If we cause people to suspend disbelief and 'believe’ that a projected character is riding across the top of a table, then we can again enhance our storytelling ability," Willis says. "The tracking solution we came up with supported this capability in a very lightweight way."

HideOut isn’t a product yet, but it should be. Smartphones may soon have onboard micro-projectors as standard equipment, just like cameras are now—which could be an easy way to deploy HideOut’s essential functionality. But a part of me hopes that Disney doesn’t go this route, and instead embeds it in a standalone product. My smartphone is mundane; my daughter sees me fussing with it all too often, and there’s nothing special about it to her. But a "magic flashlight" just for story time—and just for her? I can already see her eyes lighting up. And what could be more Disney than that?

[Read more about HideOut]

Add New Comment

2 Comments

  • Melanie Gasmen

    So weird to think how picture books will be with this technology. My company just made one called "Hide & Eek!" and it's supposed to work with a flashlight, and just thinking about how this technology could've applied to its development is crazy. I'm 23-years-old and I'm already wanting a HideOut for myself. Kids, get outta here.

  • Tiki Roommate

    Very groovy.  It feels like many 80s movies come alive, and I expect it'll only get more amazing at the technology matures.