Skip to main content

The context you need, when you need it

When news breaks, you need to understand what actually matters — and what to do about it. At Vox, our mission to help you make sense of the world has never been more vital. But we can’t do it on our own.

We rely on readers like you to fund our journalism. Will you support our work and become a Vox Member today?

Join now

Snapchat filters: the engineering behind augmented-reality selfies

If you’ve been seeing selfies enhanced with dog noses and flower crowns lately, and you wondered where they all came from, the answer is Snapchat, the social network preferred by people born during or after the (sigh) 1990s. The mobile app allows people to look into a magic mirror of sorts by altering and enhancing their faces in real time with a different set of filters every day. In this video, we explain how the technology works.

Snapchat has been around since 2011, but it wasn’t until last fall that the platform introduced “lenses,” the filters that distort or accessorize faces in real time. (You may recall seeing clips of people with bush baby eyes puking rainbows around that time.)

The feature came from a Ukrainian startup called Looksery, which Snapchat acquired for $150 million. Looksery envisioned the app as a solution for people who feel insecure during video communication and want to “modify [their] eye color, nose size, facial shape, and skin.”

But the more popular filters are often the ones that don’t beautify but rather make people laugh:

Filters are also pretty fun when they fail — when they misread your face and assume, for instance, that your nostrils are eyeballs:

Augmented reality is something teens might shrug at, but to those of us born before smartphones existed, this technology is like sorcery. So we looked through Looksery’s patents to find out how it works. Check out the video above for a peek into the engineering behind Snapchat’s filters.

More in Video

Video
What would J.R.R. Tolkien think of Palantir?What would J.R.R. Tolkien think of Palantir?
Play
Video

How The Lord of the Rings lore helps explain the mysterious tech company.

By Benjamin Stephen
America, Actually
The progressive plan to reclaim the working classThe progressive plan to reclaim the working class
Podcast
America, Actually

Progressive caucus chair Rep. Greg Casar on his movement’s new playbook.

By Astead Herndon
Video
The Department of Holy WarThe Department of Holy War
Play
Video

What Pete Hegseth’s fascination with the Crusades can tell us about the war in Iran.

By Nate Krieger
Video
Live Nation lost. Will anything change for ticket prices?Live Nation lost. Will anything change for ticket prices?
Play
Video

A jury ruled Live Nation and Ticketmaster a monopoly, but what that means for ticket prices is not so simple.

By Frank Posillico
Eating the Ocean
Why are states unleashing millions of these fish?Why are states unleashing millions of these fish?
Play
Eating the Ocean

America’s fishing paradox.

By Nate Krieger
Video
Why Americans can’t escape credit card debtWhy Americans can’t escape credit card debt
Play
Video

Credit card APRs are now as high as 20 percent.

By Frank Posillico