If someone says he or she can see around corners, up to now it’s been nothing but a metaphor. Now MIT researchers say the superpower is getting closer to reality.
The researchers have developed a simple algorithm that processes video and converts it to a one-dimensional image of what’s going on around the corner, said Katie Bouman, a leading member of the team who received her PhD in electrical engineering and computer science from the school this year.
Imagine you’re standing up against a wall in front of a corner. You can’t see what’s happening around the corner, but you can see a fuzzy shadow at the base of the corner where the two walls meet.
You point your video camera at the shadow and run the video through your computer. The algorithm translates the information from the shadow into a one-dimensional map of the people who are moving in the room.
Bouman said the algorithm takes advantage of the fact that “the reflected light you see on the floor is related to the hidden scene in a very special way.”
As people walk around the room, they are blocking a tiny portion of the light, changing the intensity, Bouman said.
The algorithm takes the video images and “smushes” them into a one-dimensional map with lines on it that represent the activity in the room.
By tracking the movement of the lines, Bouman and her team can tell how many people are moving around the corner, the pattern of their motion, how fast they’re going, and more.
“Anybody can just download the software and take a video on a tripod, as long as it’s stable, at the base of a corner, and run this code to see one-dimensionally what’s around the corner,” said Vickie Ye, another member of the team and a master’s degree student at MIT.
“People think of this as a superpower, but I think there’s a lot of real applications it can have,” Bouman said.
For instance, while the algorithm only works on a steady camera for now, Ye and MIT researcher Felix Naser are working to apply it to moving cameras so it can be used in more scenarios.
The researchers envision their technology being used someday in hostage and barricade situations and search and rescue missions. On self-driving cars, it might be able to help avert tragedy when a child runs out into the street.
“I think it would be really nice, if you had someone . . . about to dart out, to be able to predict that in advance,” Bouman said. “When you first think about this, you might think it’s crazy or impossible, but we’ve shown that it’s not if you can understand the physics of how light propagates.”
The fashion industry is built on glamour and allure, but many models, especially the very young, know it for something else: sexual exploitation and abuse.Continue reading »
The increase in arrests of undocumented immigrants in the last fiscal year signals that President Trump is pushing to fulfill a campaign vow on bolstering enforcement.Continue reading »
Suffolk District Attorney Daniel Conley will not seek reelection in November, vacating the high-profile job he’s held since 2002.Continue reading »
A sleek, relatively new vaping device called a “Juul” has school administrators sending warning e-mails home.Continue reading »
What happens when you become president of the world’s most prestigious university? Suddenly everyone has advice for you.Continue reading »
The case of Haleigh Poutre has involved one stunning turn after another.Continue reading »
In November, Massachusetts voters are likely to consider a ballot question legalizing recreational marijuana.Continue reading »
Parkland. Las Vegas. Sutherland Springs. Newtown. On and on: In America, mass shootings have become so familiar that they seem to follow the same sad script.Continue reading »
As a record number of Chinese students stream into American universities, verification companies help combat false applications.Continue reading »