ÐÇ¿Õ´«Ã½

Sci-Tech

    • Chatbots sometimes make things up. Not everyone thinks AI's hallucination problem is fixable

    Share

    Spend enough time with ChatGPT and other artificial intelligence chatbots and it doesn't take long for them to spout falsehoods.

    Described as hallucination, confabulation or just plain making things up, it's now a problem for every business, organization and high school student trying to get a generative AI system to compose documents and get work done. Some are using it on tasks with the potential for high-stakes consequences, from psychotherapy to researching and writing legal briefs.

    "I don't think that there's any model today that that doesn't suffer from some hallucination," said Daniela Amodei, co-founder and president of Anthropic, maker of the chatbot Claude 2.

    "They're really just sort of designed to predict the next word," Amodei said. "And so there will be some rate at which the model does that inaccurately."

    Anthropic, ChatGPT-maker OpenAI and other major developers of AI systems known as large language models say they're working to make them more truthful.

    How long that will take -- and whether they will ever be good enough to, say, safely dole out medical advice -- remains to be seen.

    "This isn't fixable," said Emily Bender, a linguistics professor and director of the University of Washington's Computational Linguistics Laboratory. "It's inherent in the mismatch between the technology and the proposed use cases."

    A lot is riding on the reliability of generative AI technology. The McKinsey Global Institute projects it will add the equivalent of $2.6 trillion to $4.4 trillion to the global economy. Chatbots are only one part of that frenzy, which also includes technology that can generate new images, video, music and computer code. Nearly all of the tools include some language component.

    Google is already pitching a news-writing AI product to news organizations, for which accuracy is paramount. The Associated Press is also exploring use of the technology as part of a partnership with OpenAI, which is paying to use part of AP's text archive to improve its AI systems.

    In partnership with India's hotel management institutes, computer scientist Ganesh Bagler has been working for years to get AI systems, including a ChatGPT precursor, to invent recipes for South Asian cuisines, such as novel versions of rice-based biryani. A single "hallucinated" ingredient could be the difference between a tasty and inedible meal.

    When Sam Altman, the CEO of OpenAI, visited India in June, the professor at the Indraprastha Institute of Information Technology Delhi had some pointed questions.

    "I guess hallucinations in ChatGPT are still acceptable, but when a recipe comes out hallucinating, it becomes a serious problem," Bagler said, standing up in a crowded campus auditorium to address Altman on the New Delhi stop of the U.S. tech executive's world tour.

    "What's your take on it?" Bagler eventually asked.

    Altman expressed optimism, if not an outright commitment.

    "I think we will get the hallucination problem to a much, much better place," Altman said. "I think it will take us a year and a half, two years. Something like that. But at that point we won't still talk about these. There's a balance between creativity and perfect accuracy, and the model will need to learn when you want one or the other."

    But for some experts who have studied the technology, such as University of Washington linguist Bender, those improvements won't be enough.

    Bender describes a language model as a system for "modelling the likelihood of different strings of word forms," given some written data it's been trained upon.

    It's how spell checkers are able to detect when you've typed the wrong word. It also helps power automatic translation and transcription services, "smoothing the output to look more like typical text in the target language," Bender said. Many people rely on a version of this technology whenever they use the "autocomplete" feature when composing text messages or emails.

    The latest crop of chatbots such as ChatGPT, Claude 2 or Google's Bard try to take that to the next level, by generating entire new passages of text, but Bender said they're still just repeatedly selecting the most plausible next word in a string.

    When used to generate text, language models "are designed to make things up. That's all they do," Bender said. They are good at mimicking forms of writing, such as legal contracts, television scripts or sonnets.

    "But since they only ever make things up, when the text they have extruded happens to be interpretable as something we deem correct, that is by chance," Bender said. "Even if they can be tuned to be right more of the time, they will still have failure modes -- and likely the failures will be in the cases where it's harder for a person reading the text to notice, because they are more obscure."

    Those errors are not a huge problem for the marketing firms that have been turning to Jasper AI for help writing pitches, said the company's president, Shane Orlick.

    "Hallucinations are actually an added bonus," Orlick said. "We have customers all the time that tell us how it came up with ideas -- how Jasper created takes on stories or angles that they would have never thought of themselves."

    The Texas-based startup works with partners like OpenAI, Anthropic, Google or Facebook parent Meta to offer its customers a smorgasbord of AI language models tailored to their needs. For someone concerned about accuracy, it might offer up Anthropic's model, while someone concerned with the security of their proprietary source data might get a different model, Orlick said.

    Orlick said he knows hallucinations won't be easily fixed. He's counting on companies like Google, which he says must have a "really high standard of factual content" for its search engine, to put a lot of energy and resources into solutions.

    "I think they have to fix this problem," Orlick said. "They've got to address this. So I don't know if it's ever going to be perfect, but it'll probably just continue to get better and better over time."

    Techno-optimists, including Microsoft co-founder Bill Gates, have been forecasting a rosy outlook.

    "I'm optimistic that, over time, AI models can be taught to distinguish fact from fiction," Gates said in a July blog post detailing his thoughts on AI's societal risks.

    He cited a 2022 paper from OpenAI as an example of "promising work on this front." More recently, researchers at the Swiss Federal Institute of Technology in Zurich said they developed a method to detect some, but not all, of ChatGPT's hallucinated content and remove it automatically.

    But even Altman, at least for now, doesn't count on the models to be truthful.

    "I probably trust the answers that come out of ChatGPT the least of anybody on Earth," Altman told the crowd at Bagler's university, to laughter.

    CTVNews.ca ÐÇ¿Õ´«Ã½

    Three men were injured after trying to subdue a man armed with a knife during afternoon prayers at a Montreal-area mosque Friday afternoon.

    A 15-year-old boy who was the subject of an emergency alert in New Brunswick has been arrested.

    Police have arrested an 18-year-old woman who allegedly stole a Porsche and then ran over its owner in an incident that was captured on video.

    Since she was a young girl growing up in Vancouver, Ginny Lam says her mom Yat Hei Law made it very clear she favoured her son William, because he was her male heir.

    The search for a missing six-year-old boy in Shamattawa is continuing Friday as RCMP hope recent tips can help lead to a happy conclusion.

    Canada

    • Three men were injured after trying to subdue a man armed with a knife during afternoon prayers at a Montreal-area mosque Friday afternoon.

    • Police have arrested an 18-year-old woman who allegedly stole a Porsche and then ran over its owner in an incident that was captured on video.

    • The search for a missing six-year-old boy in Shamattawa is continuing Friday as RCMP hope recent tips can help lead to a happy conclusion.

    • The debate over sexual orientation and gender identity education in schools is heating up. Protests both for and against SOGI in the curriculum took place across the country Friday.

    • The parents of a teenager who died after allegedly consuming the poisonous products of a Mississauga man are now suing him, as well as several doctors involved in her care.

    • Relatives of a 60-year-old man who took his own life in a Nova Scotia jail after long periods of confinement in his cell have launched a lawsuit against the province.

    World

    Politics

    Health

    • A Nova Scotia woman has applied for a medically assisted death, saying after years of battling to receive out-of-country surgery for an illness that causes 'indescribable' pain, she struggles to maintain the will to live.

    Sci-Tech

    Entertainment

    • Getting a photograph of a rainbow? Common. Getting a photo of a lightning strike? Rare. Getting a photo of both at the same time? Extremely rare, but it happened to a Manitoba photographer this week.

    • It was the last show for longtime children's TV star Ron (Buck Shot) Barge Friday as hundreds of family, friends and fans attended a public memorial in Calgary.

    Business

    Lifestyle

    Sports

    • The Winnipeg Blue Bombers have won five in a row. The Edmonton Elks have won five of their last six games. They are the two hottest teams in the West. When they meet Saturday at Commonwealth Stadium, something has to give.

    • Agreement in principle has been reached to build a new NHL arena at LeBreton Flats has been reached between the Ottawa Senators and the National Capital Commission (NCC), the two sides announced Friday.

    • F1 star Max Verstappen punished over bad word

      Formula One points leader Max Verstappen was ordered to 'accomplish some work of public interest' after uttering an inappropriate word Thursday at the news conference ahead of the Singapore Grand Prix.

    Autos

    Local Spotlight

    Getting a photograph of a rainbow? Common. Getting a photo of a lightning strike? Rare. Getting a photo of both at the same time? Extremely rare, but it happened to a Manitoba photographer this week.

    An anonymous business owner paid off the mortgage for a New Brunswick not-for-profit.

    They say a dog is a man’s best friend. In the case of Darren Cropper, from Bonfield, Ont., his three-year-old Siberian husky and golden retriever mix named Bear literally saved his life.

    A growing group of brides and wedding photographers from across the province say they have been taken for tens of thousands of dollars by a Barrie, Ont. wedding photographer.

    Paleontologists from the Royal B.C. Museum have uncovered "a trove of extraordinary fossils" high in the mountains of northern B.C., the museum announced Thursday.

    The search for a missing ancient 28-year-old chocolate donkey ended with a tragic discovery Wednesday.

    The Royal Canadian Mounted Police is celebrating an important milestone in the organization's history: 50 years since the first women joined the force.

    It's been a whirlwind of joyful events for a northern Ontario couple who just welcomed a baby into their family and won the $70 million Lotto Max jackpot last month.

    A Good Samaritan in New Brunswick has replaced a man's stolen bottle cart so he can continue to collect cans and bottles in his Moncton neighbourhood.

    • The debate over sexual orientation and gender identity education in schools is heating up. Protests both for and against SOGI in the curriculum took place across the country Friday.

    • A fire that destroyed a historic bridge in Kamloops, B.C., is now being investigated as arson, local Mounties say.

    • A teenager has been charged with multiple offences related to stabbings that occurred in Surrey's Newton neighbourhood last week.

    • Police have arrested an 18-year-old woman who allegedly stole a Porsche and then ran over its owner in an incident that was captured on video.

    • The parents of a teenager who died after allegedly consuming the poisonous products of a Mississauga man are now suing him, as well as several doctors involved in her care.

    • Michael Ford, Ontario's minister of citizenship and multiculturalism, says he is taking a leave of absence from cabinet to prioritize his health.

    • BREAKING

      BREAKING

      The man accused of stabbing another man to death outside a Banff nightclub in two years ago has been found guilty of second-degree murder.

    • Calgary Mayor Jyoti Gondek is urging the Alberta government to preserve pieces of the massive Green Line transit project now being dissolved.

    • It was the last show for longtime children's TV star Ron (Buck Shot) Barge Friday as hundreds of family, friends and fans attended a public memorial in Calgary.

    • Agreement in principle has been reached to build a new NHL arena at LeBreton Flats has been reached between the Ottawa Senators and the National Capital Commission (NCC), the two sides announced Friday.

    • Police say a man, 34, who was taken to hospital in critical condition after being shot Thursday night has died.

    • Ottawa police are investigating a shooting downtown Friday afternoon.

    • Three men were injured after trying to subdue a man armed with a knife during afternoon prayers at a Montreal-area mosque Friday afternoon.

    • When Bernard Morissette got a call from Loto-Quebec on Sept. 18 and was asked if he was sitting down, he had no idea what was coming his way.

    • "We love you, Eddy!" screamed the 350 students at Terry Fox Elementary School in Pierrefonds. They didn't know the man their school is named after, but they knew Eddy Nolan who would visit regularly and encourage the students to participate in "the Terry Fox Run".

    • Two Edmonton Police Service officers have been criminally charged in connection with an assault.

    • There's a friendship in the Edmonton Oilers crease between Stuart Skinner and Calvin Pickard.

    • There are plenty of fun happenings in Edmonton this weekend. It's time to savour that last little bit of the summer season before the leaves really start coming down.

    • A 15-year-old boy who was the subject of an emergency alert in New Brunswick has been arrested.

    • Relatives of a 60-year-old man who took his own life in a Nova Scotia jail after long periods of confinement in his cell have launched a lawsuit against the province.

    • Family, friends and fans of late hip hop artist and battle rapper, Pat Stay will gather at events held in his honour on Saturday and Sunday.

    • The search for a missing six-year-old boy in Shamattawa is continuing Friday as RCMP hope recent tips can help lead to a happy conclusion.

    • Pedestrians are getting a step closer to being able to cross Portage and Main.

    • A Manitoba veterinary clinic has two new ways of figuring out what’s causing a horse to be lame.

    • Five Regina schools were placed into lockdown or secure the building mode following a report of a weapons investigation at Miller High School on Friday.

    • A 21-year-old man from Codette, Sask. is facing numerous charges in connection to a fatal crash near Wapella, Sask. Wednesday night that claimed the life of a 22-year-old Alberta woman.

    • The City of Regina and provincial government have committed a combined $400,000 to Carmichael Outreach for an 80-person warming space set to open no later than Nov. 1.

    • Protests were held in front of Kitchener City Hall on Friday, both for and against LGBTQ2S+ inclusive education and queer rights in schools.

    • Levels of hydrogen sulfide gas are being monitored at Brantford Collegiate Institute after a leak in their geothermal system.

    • Police have arrested an 18-year-old woman who allegedly stole a Porsche and then ran over its owner in an incident that was captured on video.

    • The Métis Nation of Saskatchewan has pulled out of a national body representing Métis, citing problems with an Ontario group and throwing the future of the Métis National Council into question.

    • The second-degree murder trial of Thomas Hamp is being adjourned until December so an expert witness central to the trial can testify.

    • A 69-year-old woman from Outlook, Saskatchewan is dead and three people are injured after a truck and SUV collided on Highway 15 on Thursday.

    • Emergency crews in northern Ontario found the bodies of four people inside a home where a fire broke out Thursday night.

    • Police have arrested an 18-year-old woman who allegedly stole a Porsche and then ran over its owner in an incident that was captured on video.

    • A 26-year-old driver from Surrey, B.C., has been charged with three counts of criminal negligence causing death and bodily harm in a crash that killed two youths in northern Ontario last year.

    • A new outdoor music festival is launching this weekend in London - tickets are still available for the inaugural Fairway Fest at East Park.

    • A man is in hospital with life threatening injuries following a collision between a motorcycle and a vehicle on Friday afternoon.

    • Members of the 2SLGBTQ+ community and supportetrs greatly outnumbered the people attending a '1 Million March 4 Children' event along Central Avenue.

    • Two men from Barrie have been charged after a deadly shooting at a park in Keswick on Wednesday.

    • Provincial police investigating the death of a cat that was allegedly set on fire in Orillia earlier this week released surveillance video of a person of interest in the case.

    • A 17-year-old from Markham is facing serious charges after an August 11 shooting at a party in Caledon.

    • The Special Investigations Unit (SIU) is searching for the occupants of a vehicle caught on security cameras during a fatal police-involved shooting on Goyeau Street.

    • Windsor police say a 25-year-old mother has been charged with the drowning death of her 5-year-old child in the family’s backyard pool.

    • A peaceful transition of power is taking place at the Caldwell First Nation after its recent election held on Sept. 14.

    • New Democrat Leader David Eby has launched his British Columbia election campaign a day early, making the key battle ground of Surrey his first stop.

    • The Old Man Lake wildfire near Sooke is the only one currently burning on Vancouver Island. It’s a region of the province that this year saw a drastic drop in blazes in the backcountry.

    • The debate over sexual orientation and gender identity education in schools is heating up. Protests both for and against SOGI in the curriculum took place across the country Friday.

    • A pair of runaway pigs are in the custody of an animal sanctuary in the Okanagan after evading police and volunteers for hours earlier this week.

    • The Red Bridge, a historic landmark in Kamloops, B.C., was completely destroyed by fire early Thursday morning.

    • Animal protection officers in British Columbia have rescued three pit bulls – including one that gave birth to 10 puppies – from a rat-infested home in Kelowna.

    • A Lethbridge resident is facing charges after police seized drugs and weapons at a traffic stop for bicycle equipment violations.

    • A Vulcan, Alta., man has been charged with a Lethbridge woman's murder after her body was found in the Oyen area.

    • A Lethbridge couple got a good reminder as to why you should keep your vehicle doors locked at all times.

    • A 26-year-old driver from Surrey, B.C., has been charged with three counts of criminal negligence causing death and bodily harm in a crash that killed two youths in northern Ontario last year.

    • Ontario Provincial Police say three suspects from southern Ontario have been charged and drugs worth $300,000 have been seized following a traffic stop Sept. 16.

    • A Brampton driver, 27, was charged this week when northern Ontario police stopped the SUV he was driving on Highway 17 after a reported shooting and found more than $100,000 in cash.

    N.L.

    Shopping Trends

    The Shopping Trends team is independent of the journalists at CTV News. We may earn a commission when you use our links to shop. Read about us.

    Stay Connected
    Follow CTV News