tag:blogger.com,1999:blog-6753820.post1003645890591759557..comments2023-10-30T04:16:25.917-04:00Comments on Sentient Developments: Anders Sandberg: Why we should fear the paperclipperGeorgehttp://www.blogger.com/profile/13003484633933455827noreply@blogger.comBlogger4125tag:blogger.com,1999:blog-6753820.post-66011849063433498192012-12-13T12:19:31.164-05:002012-12-13T12:19:31.164-05:00Um, what is "Skynet"?Um, what is "Skynet"?Anonymoushttps://www.blogger.com/profile/17150076352288762419noreply@blogger.comtag:blogger.com,1999:blog-6753820.post-20705781696371208972012-12-13T12:18:43.706-05:002012-12-13T12:18:43.706-05:00Um, What is "Skynet", Alex?Um, What is "Skynet", Alex?Anonymoushttps://www.blogger.com/profile/17150076352288762419noreply@blogger.comtag:blogger.com,1999:blog-6753820.post-63760208550635128862011-02-21T16:34:36.148-05:002011-02-21T16:34:36.148-05:00The real question is, why are we having a super-sm...The real question is, why are we having a super-smart AI build paperclips?<br /><br />We know that bored people cause all sorts of problems; I suspect bored AIs will to. My solution would be only create intelligent AIs for tasks that require intelligent AIs.Me!https://www.blogger.com/profile/10694032310385244509noreply@blogger.comtag:blogger.com,1999:blog-6753820.post-55215409758266711122011-02-17T21:32:51.046-05:002011-02-17T21:32:51.046-05:00I think David Pearce said it best. An AGI that is...I think David Pearce said it best. An AGI that is a 'paper-clipper' is NOT a super-intelligence in the true sense of the word 'intelligence'. It's an autistic intelligence.<br /><br />Many folks in the AGI community (many unfortunately semi-autistic themselves)are working off an incredibly narrow definition of 'intelligence', using the word to refer only to what I would call 'rational' or 'mechanistic' intelligence, that is, the ability to achieve goals in an optimal fashion.<br /><br />True 'intelligence' is much more than these folks think however, and includes what I call 'creative' intelligence, the ability to categorize, draw analogies and create narratives, which is beyond the scope of mechanistic Bayesian calculations.<br /><br />The paper-clipper monster is not a world-destroyer, for the simple reason its limited in its powers. It would just sit there, like any other autistic, for sure, it would be forever obsessed with turning the world into paper-clips (I agree good values do not emerge automatically), but, the like the obsessions of all other autistics everywhere, quite unable to turn its fanasties into reality. <br /><br />Believers in this silly fantasy of the Bayesian 'paper-clip' monster will no doubt go on believing right up until the day a REAL intelligence (a true creative itelligence beyond the power of Bayes) comes along.ZARZUELAZENhttps://www.blogger.com/profile/07742429508206464486noreply@blogger.com