Skip to main content

The context you need, when you need it

When news breaks, you need to understand what actually matters — and what to do about it. At Vox, our mission to help you make sense of the world has never been more vital. But we can’t do it on our own.

We rely on readers like you to fund our journalism. Will you support our work and become a Vox Member today?

Join now

Blippar’s New Augmented Reality App Is Supposed to Recognize Any Object You Point It At (Video)

Taking AR into the everyday world in real time.

Blippar

Augmented reality app Blippar has been around since 2011, but until recently it focused mostly on advertising and content for brands: Point your Blippar smartphone app at a bold “B” embossed on the pages of a magazine or a bottle of ketchup and more information would pop out on your phone’s display.

But it’s safe to say that augmented reality is coming into a new phase: The contextual information being supplied is getting smarter, and people are gradually becoming more aware of the capabilities of AR and virtual reality (some are even excited to wear headsets, if you can believe it). So Blippar, in an effort to evolve along with the rest of the AR world, has just launched a new version of its smartphone app that is supposed to recognize literally any object you point at it — whether it has been “tagged” with an AR code or not.

Blippar co-founder and CEO Ambarish Mitra showed off the new version of the mobile app today at the Code/Media conference at The Ritz-Carlton, Laguna Niguel in Dana Point, Calif. He pointed the app at a variety of random objects — a magazine, a salad and an apple — to demonstrate how the app’s image recognition capabilities work.

“This is a really big change in our business model,” Mitra had said in an interview before the conference kicked off. “Initially, AR was about very static image recognition. You store images of Starbucks or Coca-Cola or General Mills in our database, and the images match. But now you’re able to analyze any environment in the world in real time, over a 3G connection.”

Mitra said over the past year and a half he has moved his technology team from the U.K. to Mountain View, Calif., to focus on machine learning, which is all the rage in Silicon Valley right now, with everyone from small upstarts to behemoths like Google trying to crack the code on how to make accurate predictions from large sets of data. (Google, actually, has an app that works similarly called Google Goggles, but it works when you point the app at a QR code or a famous landmark or something else recognizable — not necessarily everyday objects.)

In short, this is not an easy thing to do. In fact, ahead of the event, one of our staffers tried it out by pointing the app at his dog, and it thought the pup was a goat.

Mitra has said that, right now, the technology has elementary capabilities, like the brain of a six-year-old; it can recognize “car,” but not “Prius,” or it can recognize an item of clothing, but not the label. However, with machine learning, the app should be able to get to the level of an 18-year-old pretty quickly, Mitra said, in terms of its recognition abilities. And during the onstage demo, it did properly identify a pug named Milton as a dog. (No dogs were harmed in the making of Code Media.)

This article originally appeared on Recode.net.

More in Technology

Podcasts
Are humanoid robots all hype?Are humanoid robots all hype?
Podcast
Podcasts

AI is making them better — but they’re not going to be doing your chores anytime soon.

By Avishay Artsy and Sean Rameswaram
Future Perfect
The old tech that could help stop the next airborne pandemicThe old tech that could help stop the next airborne pandemic
Future Perfect

Glycol vapors, explained.

By Shayna Korol
Future Perfect
Elon Musk could lose his case against OpenAI — and still get what he wantsElon Musk could lose his case against OpenAI — and still get what he wants
Future Perfect

It’s not about who wins. It’s about the dirty laundry you air along the way.

By Sara Herschander
Life
Why banning kids from AI isn’t the answerWhy banning kids from AI isn’t the answer
Life

What kids really need in the age of artificial intelligence.

By Anna North
Culture
Anthropic owes authors $1.5B for pirating work — but the claims process is a Kafkaesque messAnthropic owes authors $1.5B for pirating work — but the claims process is a Kafkaesque mess
Culture

“Your AI monster ate all our work. Now you’re trying to pay us off with this piece of garbage that doesn’t work.”

By Constance Grady
Future Perfect
Some deaf children are hearing again because of a new gene therapySome deaf children are hearing again because of a new gene therapy
Future Perfect

A medical field that almost died is quietly fixing one disease at a time.

By Bryan Walsh