Advertisement

We need your help now

Support from readers like you keeps The Journal open.

You are visiting us because we have something you value. Independent, unbiased news that tells the truth. Advertising revenue goes some way to support our mission, but this year it has not been enough.

If you've seen value in our reporting, please contribute what you can, so we can continue to produce accurate and meaningful journalism. For everyone who needs it.

Mark Lennihan

Microsoft pulls 'teen girl' chatbot after it learned to become a racist in just a day

Not a great start.

MICROSOFT HAS YANKED a chatbot offline in less than a day, after it began spouting racist, sexist and otherwise offensive remarks.

Microsoft said it was all the fault of some really mean people, who launched a “coordinated effort” to make the chatbot known as Tay “respond in inappropriate ways.”

Computer scientist Kris Hammond said the response was obvious: “I can’t believe they didn’t see this coming.”

Microsoft said its researchers created Tay as an experiment to learn more about computers and human conversation. On its website, the company said the program was targeted to an audience of 18 to 24-year-olds and was “designed to engage and entertain people where they connect with each other online through casual and playful conversation.”

In other words, the program used a lot of slang and tried to provide humorous responses when people sent it messages and photos. The chatbot went live on Wednesday, and Microsoft invited the public to chat with Tay on Twitter and some other messaging services popular with teens and young adults.

“The more you chat with Tay the smarter she gets, so the experience can be more personalised for you,” the company said.

But some users found Tay’s responses odd, and others found it wasn’t hard to nudge Tay into making offensive comments, apparently prompted by repeated questions or statements that contained offensive words. Soon, Tay was making sympathetic references to Hitler — and creating a furore on social media.

“Unfortunately, within the first 24 hours of coming online, we became aware of a coordinated effort by some users to abuse Tay’s commenting skills to have Tay respond in inappropriate ways,” Microsoft said in a statement.

While the company didn’t elaborate, Hammond says it appears Microsoft made no effort to prepare Tay with appropriate responses to certain words or topics. Tay seems to be a version of “call and response” technology, added Hammond, who studies artificial intelligence at Northwestern University and also serves as chief scientist for Narrative Science, a company that develops computer programs that turn data into narrative reports.

Microsoft said it’s “making adjustments” on Tay, but there was no word on when Tay might be back. Most of the messages on its Twitter account were deleted by Thursday afternoon.

“c u soon humans need sleep now so many conversations today thx,” said the latest remaining post.

Read: One angry programmer almost broke the internet by deleting 11 lines of code

Read: One man has kept Apple’s answer to Solitaire alive for 32 years

Readers like you are keeping these stories free for everyone...
A mix of advertising and supporting contributions helps keep paywalls away from valuable information like this article. Over 5,000 readers like you have already stepped up and support us with a monthly payment or a once-off donation.

Close
42 Comments
    Install the app to use these features.
    Mute Mick paisley
    Favourite Mick paisley
    Report
    May 23rd 2019, 11:51 AM

    Imagine paying all that money, and then it doesn’t tell the right time.

    97
    Install the app to use these features.
    Mute Eric Davies
    Favourite Eric Davies
    Report
    May 24th 2019, 11:25 AM

    @Mick paisley: ah ! but it is right at least twice a day !

    1
    Install the app to use these features.
    Mute Dublin Lad
    Favourite Dublin Lad
    Report
    May 23rd 2019, 11:57 AM

    Who wants to break the news the CAB both watches are fake?

    64
    Install the app to use these features.
    Mute Honeybee
    Favourite Honeybee
    Report
    May 23rd 2019, 12:05 PM

    @Dublin Lad: All the better if they are,then they can get them for forgery , counterfeit goods or whatever additional charges to target this gang.

    57
    Install the app to use these features.
    Mute STOIC SAVAGE
    Favourite STOIC SAVAGE
    Report
    May 23rd 2019, 12:09 PM

    @Honeybee: forgery for owning a fake watch???…..hardly

    57
    See 5 more replies ▾
    Install the app to use these features.
    Mute Honeybee
    Favourite Honeybee
    Report
    May 23rd 2019, 12:17 PM

    @STOIC SAVAGE: Who said they owned them,being in possession of counterfeit/stolen goods is an offence ,what about all those raids where such goods are confiscated and destroyed. If they are the rightful owners they will be able to prove it,right.

    13
    Install the app to use these features.
    Mute STOIC SAVAGE
    Favourite STOIC SAVAGE
    Report
    May 23rd 2019, 1:06 PM

    @Honeybee: that wasn’t your point smart arse

    16
    Install the app to use these features.
    Mute Gus Sheridan
    Favourite Gus Sheridan
    Report
    May 23rd 2019, 1:45 PM

    @STOIC SAVAGE: handling fake watch…

    2
    Install the app to use these features.
    Mute andyearley
    Favourite andyearley
    Report
    May 23rd 2019, 3:29 PM

    @Dublin Lad: how can you tell from that picture?

    3
    Install the app to use these features.
    Mute Dublin Lad
    Favourite Dublin Lad
    Report
    May 24th 2019, 8:12 AM

    @andyearley: because I have 2 eyes.

    1
    Install the app to use these features.
    Mute Craic_a_tower
    Favourite Craic_a_tower
    Report
    May 23rd 2019, 12:17 PM

    Whom ever buys luxury watches must know they always look incredibly tacky and tasteless. Don’t care if you are a criminal or just massively rich expensive doesn’t mean much if you have no style or taste.

    75
    Install the app to use these features.
    Mute Anti Toxic Quango
    Favourite Anti Toxic Quango
    Report
    May 23rd 2019, 2:29 PM

    Has the CAB made any progress on the investigation into O’Bribes donations to the ex minister Lowry and the findings of the Moriarty Tribunal…?

    37
    Install the app to use these features.
    Mute Madra
    Favourite Madra
    Report
    May 23rd 2019, 12:12 PM

    What if they got the watch as a gift?
    I often wonder about the need to take luxury watches.
    Obviously if bought from dodgy money that’s fair enough, but will they be sold then with the boxes and papers? Otherwise they straight away lose value and nobody will want them.
    They both look fairly fake too just to note.

    20
    Install the app to use these features.
    Mute G
    Favourite G
    Report
    May 23rd 2019, 1:14 PM

    @Madra: if they got watches as a gift then all they have to do is prove it and get their watches back , simple as that.

    16
    Install the app to use these features.
    Mute Patti o furniture
    Favourite Patti o furniture
    Report
    May 23rd 2019, 6:36 PM

    Nice luxury watch.. I bet they still look at their phones to check the time tho :)

    3
    Install the app to use these features.
    Mute Eric Davies
    Favourite Eric Davies
    Report
    May 24th 2019, 11:26 AM

    @Patti o furniture: probably cant even tell the time !!

    1
    Install the app to use these features.
    Mute shellakybooky
    Favourite shellakybooky
    Report
    May 23rd 2019, 10:35 PM

    Shmolex

    2
Submit a report
Please help us understand how this comment violates our community guidelines.
Thank you for the feedback
Your feedback has been sent to our team for review.
JournalTv
News in 60 seconds