New research aims to teach computers common sense

Advertisement

Advertise with us

PITTSBURGH, Pa. - Researchers are trying to plant a digital seed for artificial intelligence by letting a massive computer system browse millions of pictures and decide for itself what they all mean.

Read this article for free:


or

Already have an account? Log in here »

To continue reading, please subscribe:

Subscribe and receive a limited-edition Free Press branded hat or tote.

Digital Subscription

One year of digital access for only $205*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles

*First annual payment billed as $205.00 + GST for one year. This annual subscription will automatically renew at $233.00 + GST every 52 weeks (10% off the regular annual price of $259.35). Offer available to new and qualified returning subscribers only. Cancel any time.

To continue reading, please subscribe:

Add Free Press access to your Brandon Sun subscription for only an additional

$1 for the first 4 weeks*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles
Start now

*Your next Brandon Sun subscription payment will increase by $1.00 and you will be charged $17.95 plus GST for four weeks. After four weeks, your payment will increase to $24.95 plus GST every four weeks.

Hey there, time traveller!
This article was published 24/11/2013 (4652 days ago), so information in it may no longer be current.

PITTSBURGH, Pa. – Researchers are trying to plant a digital seed for artificial intelligence by letting a massive computer system browse millions of pictures and decide for itself what they all mean.

The system at Carnegie Mellon University is called NEIL, short for Never Ending Image Learning. In mid-July, it began searching the Internet for images 24/7 and, in tiny steps, is deciding for itself how those images relate to each other. The goal is to recreate what we call common sense — the ability to learn things without being specifically taught.

It’s a new approach in the quest to solve computing’s Holy Grail: getting a machine to think on its own using a form of common sense. The project is being funded by Google and the Department of Defence’s Office of Naval Research.

In this Thursday, Nov. 21, 2013 photo, Abhinav Gupta stands near one of the computer clusters used in his research at one of the computer server areas on campus at Carnegie Mellon University in Pittsburgh. The school is letting hundreds of computers run constantly to scan millions of images off the Internet, and have the computers make connections on their own. The plan is to let the system run forever. (AP Photo/Keith Srakocic)
In this Thursday, Nov. 21, 2013 photo, Abhinav Gupta stands near one of the computer clusters used in his research at one of the computer server areas on campus at Carnegie Mellon University in Pittsburgh. The school is letting hundreds of computers run constantly to scan millions of images off the Internet, and have the computers make connections on their own. The plan is to let the system run forever. (AP Photo/Keith Srakocic)

“Any intelligent being needs to have common sense to make decisions,” said Abhinav Gupta, a professor in the Carnegie Mellon Robotics Institute.

NEIL uses advances in computer vision to analyze and identify the shapes and colours in pictures, but it is also slowly discovering connections between objects on its own. For example, the computers have figured out that zebras tend to be found in savannahs and that tigers look somewhat like zebras.

In just over four months, the network of 200 processors has identified 1,500 objects and 1,200 scenes and has connected the dots to make 2,500 associations.

Some of NEIL’s computer-generated associations are wrong, such as “rhino can be a kind of antelope,” while some are odd, such as “actor can be found in jail cell” or “news anchor can look similar to Barack Obama.”

But Gupta said having a computer make its own associations is an entirely different type of challenge than programing a supercomputer to do one thing very well, or fast. For example, in 1985, Carnegie Mellon researchers programed a computer to play chess; 12 years later, a computer beat world chess champion Garry Kasparov in a match.

Catherine Havasi, an artificial intelligence expert at the Massachusetts Institute of Technology, said humans constantly make decisions using “this huge body of unspoken assumptions,” while computers don’t. She said humans can also quickly respond to some questions that would take a computer longer to figure out.

“Could a giraffe fit in your car?” she asked. “We’d have an answer, even though we haven’t thought about it” in the sense of calculating the giraffe’s body mass.

Robert Sloan, an expert on artificial intelligence and head of the Department of Computer Science at the University of Illinois, Chicago, said the NEIL approach could yield interesting results because just using language to teach a computer “has all sorts of problems unto itself.”

“What I would be especially impressed by is if they can consistently say ‘zebra, zebra, zebra’ if they see the animal in different locations,” Sloan said of the computers.

Gupta is pleased with the initial progress. In the future, NEIL will analyze vast numbers of YouTube videos to look for connections between objects.

“When we started the project, we would not sure it would work,” he said. “This is just the start.”

Neither Mountain View, Calif.-based Google Inc. nor the Office of Naval Research responded to questions about why they’re funding NEIL, but there are some hints. The Naval Research website notes that “today’s battlespace environment is much more complex than in the past” and that “the rate at which data is arriving into the decision-making system is growing, while the number of humans available to convert the data to actionable intelligence is decreasing.”

In other words, computers may make some of the decisions in future wars. The Navy’s website notes: “In many operational scenarios, the human presence is not an option.”

NEIL’s motto is “I Crawl, I See, I Learn,” and the researchers hope to keep NEIL running forever. That means the computer might get a lot smarter.

Or it might not.

___

Online:

www.neil-kb.com

Report Error Submit a Tip

More Stories

Kids need some sense of split parents’ situation

Maureen Scurfield 5 minute read 2:00 AM CDT

DEAR MISS LONELYHEARTS: On our last day at a beach rental cabin the kids and I were packing up later than the rules asked for, when a familiar car pulled in next door. It was my ex-husband with his new woman and her kids.

My children yelled out, “Look Mom, it’s Daddy! He came to the lake to see us!” and ran over to him for hugs. His girlfriend had the cabin keys dangling, nodded at me, and went inside quickly.

I said to my former husband, “Fancy meeting you here! Come on kids, we’re going home now.” My ex said, “Oh, settle down. Give me a few minutes with my kids, will you?”

So, I finished packing and locked the cabin door, and waited for the kids for 30 minutes in our car. Then I started to cry. It just came gushing out and I couldn’t control it. Finally, my ex brought the children back out. He could see I’d been crying and said in disgust, “Get over it, princess. I have!”

Demolition ordered after fire in vacant city home

Free Press staff 2 minute read Preview

Demolition ordered after fire in vacant city home

Free Press staff 2 minute read 11:56 AM CDT

A Winnipeg firefighter was assessed by paramedics and an emergency demolition was ordered after a vacant house caught fire Thursday morning for the second time in less than three months.

The two-storey home, at Argyle Street and Disraeli Freeway, in South Point Douglas, was boarded up following a blaze that occurred June 1.

Firefighters returned to the house after flames were reported shortly after 6 a.m. Thursday. The house was engulfed when crews arrived.

“Due to heavy fire conditions, crews were unable to enter the structure,” a Winnipeg Fire Paramedic Service spokesperson wrote in an email to the Free Press.

Read
11:56 AM CDT

ATV, generator stolen from Manitoba cottage

1 minute read Yesterday at 9:53 AM CDT

RCMP are seeking the public’s help to identify a person of interest after an all-terrain vehicle and other belongings were stolen from a cottage in southern Manitoba.

The theft happened near near Provincial Road 440 in the Rural Municipality of Louise, about 150 kilometres southwest of Winnipeg, on Aug. 11.

Police said surveillance video showed a man walking onto the property at about 2:30 p.m. while covering his face and holding power tools.

A grinder was used to open a locked shipping container, where a 1982 Honda ATC200 all-terrain vehicle, a Honda EU2000i generator and a Stihl FS90 trimmer were among the items stolen, RCMP said. One of two Spypoint trail cameras was also reported stolen.

Man pleads guilty to shotgun slaying

Erik Pindera 5 minute read Preview

Man pleads guilty to shotgun slaying

Erik Pindera 5 minute read 2:01 AM CDT

A Winnipeg drug dealer has pleaded guilty to second-degree murder in a March 2025 killing that saw the body of a 30-year-old man dumped in a garbage bin and dragged to a West End alleyway.

Frederick Francis Mathias Baker, who was 28 upon his arrest early last year, shot Bronson Emery Dale Kequahtooway once in the thigh with a sawed-off shotgun and left him with a fatal wound, Crown prosecutor Matt Armstrong told Court of King’s Bench Justice Brian Bowman on Wednesday.

A split second after Baker shot Kequahtooway in the thigh, the victim was shot in the head with a sawed-off .22 rifle. The man accused of being armed with the rifle, Eric Matthew Morrissette, remains before the court on a second-degree murder charge.

“Either wound would have been fatal on its own,” said Armstrong.

Read
2:01 AM CDT

Somali refugee admits he helped to smuggle African migrants into Manitoba for money

Erik Pindera 6 minute read Preview

Somali refugee admits he helped to smuggle African migrants into Manitoba for money

Erik Pindera 6 minute read Yesterday at 5:54 PM CDT

A Somali refugee who was twice caught by RCMP assisting in the smuggling of desperate African migrants into Manitoba during the frigid winter — including while out on bail, months after he was first arrested with eight foreign nationals in his vehicle — has admitted he did so for money.

Read
Yesterday at 5:54 PM CDT

Mole Mobile on move for your dermatological needs

Sheldon Birnie 4 minute read Preview

Mole Mobile on move for your dermatological needs

Sheldon Birnie 4 minute read 6:00 AM CDT

After soaking up the summer sun, there’s no better time to get a skin checkup.

This weekend, the Mole Mobile will set up shop at three Winnipeg Walmart locations. The mobile clinic, which receives support from the Canadian Dermatology Association, will have certified dermatologists on site to screen suspicious-looking moles or lesions for skin cancer on a first-come, first-served basis.

First launched in 2023 in Ontario, the Mole Mobile is intended to promote prevention and early detection of skin cancer. Last weekend, the clinic visited Brandon, Portage la Prairie and Selkirk, a first for Manitoba.

“We saw a number of patients who had spots that they weren’t sure if they were normal or not,” says Dr. Alexis Botkin, a local dermatologist working the Manitoba Mole Mobile stops. “It was wonderful to provide that skin screening for people who were on a wait list (to see a specialist), as well as those who don’t have a primary care provider.”

Read
6:00 AM CDT