Keeping AIs honest

Casual conversation between friends. Anything goes (almost).
User avatar
Kim O'Hara
Former staff member
Posts: 7047
Joined: Fri Nov 16, 2012 1:09 am
Location: North Queensland, Australia

Re: Keeping AIs honest

Post by Kim O'Hara »

Yes. This is the crux of the article, for me -
All technology can be harmful in the wrong hands, but the raw power of cutting-edge AI may make it one of a few “dual-class” technologies, like nuclear power or biochemistry, which have enough destructive potential that even their peaceful use needs to be controlled and monitored.

The peak of AI concerns is superintelligence, the “Godlike AI” referred to by Musk. Just short of that is “artificial general intelligence” (AGI), a system that can learn and evolve autonomously, generating new knowledge as it goes. An AGI system that could apply its own intellect to improving itself could lead to a “flywheel”, where the capability of the system improves faster and faster, rapidly reaching heights unimaginable to humanity – or it could begin making decisions or recommending courses of action that deviate from human moral values.

Timelines for reaching this point range from imminent to decades away, but understanding how AI systems achieve their results is difficult. This means AGI could be reached quicker than expected.
:toilet:

:quoteunquote: The End of the World is Nigh! :quoteunquote:

"How nigh?"
"Oh, maybe before Christmas. We don't really have much of an idea."

:rolleye:
Kim
User avatar
Chenda
Posts: 87
Joined: Wed Sep 15, 2021 1:58 pm

Re: Keeping AIs honest

Post by Chenda »

AI isn't going to take over the world anytime soon. We're gonna be reaping the benefits of an automated world and rot 6ft under before we start seeing AI overlords.
With the wisdom of threefold purity, dedicate all the virtue gained from having made such effort toward enlightenment. Dedicate it to clear away the suffering of infinite beings. This is the way of a Bodhisattva.
Gyalsé Ngulchu Tokmé (རྒྱལ་སྲས་དངུལ་ཆུ་ཐོགས་མེད་), The Thirty-Seven Practices of All the Bodhisattvas
User avatar
justsit
Posts: 1461
Joined: Wed Oct 21, 2009 9:24 pm
Location: Delaware

Re: Keeping AIs honest

Post by justsit »

Horse is gone, time to bolt the door. :coffee:

https://www.bbc.com/news/technology-65760449
User avatar
Kim O'Hara
Former staff member
Posts: 7047
Joined: Fri Nov 16, 2012 1:09 am
Location: North Queensland, Australia

Re: Keeping AIs honest

Post by Kim O'Hara »

Authors call for AI companies to stop using their work without consent

Margaret Atwood, Viet Thanh Nguyen and 8,000 others have signed an open letter asking that permission is obtained and compensation given when a writer’s work is used by AI
:reading: https://mail.google.com/mail/u/0/#inbox ... NrDKKcJcxK

They have a point but I don't think they are going to get anywhere.

:coffee:
Kim
Post Reply

Return to “Lounge”