Reddit Reddit reviews Superintelligence: Paths, Dangers, Strategies

We found 20 Reddit comments about Superintelligence: Paths, Dangers, Strategies. Here are the top ones, ranked by their Reddit score.

Computers & Technology
Books
Computer Science
AI & Machine Learning
Artificial Intelligence & Semantics
Superintelligence: Paths, Dangers, Strategies
Check price on Amazon

20 Reddit comments about Superintelligence: Paths, Dangers, Strategies:

u/electricfistula · 64 pointsr/changemyview

If you are interested, and want a real challenge to your view, I strongly recommend Nick Bostrum's Superintelligence.

A key takeaway is imagining intelligence on this kind of scale. That is, our intuition says Einstein is much smarter than the dumbest person you know. Yet, the dumb guy and Einstein have the same hardware, running about the same number of computations. The difference between a bee and a mouse or a mouse and a chimp is orders of magnitude. The difference between an idiot and a genius is very small in comparison.

AI will seem very stupid to the human observer until almost exactly the point it becomes amazingly brilliant. As AI overtakes bees (probably has already) and mice it will still seem dumb to you. As it overtakes chimps, still much dumber than the dumbest person you know. As it draws even to the moron, you might think that the AI has a lot of work left to go. Instead, it's almost unfathomably brilliant.

The distance between bee and chimp is 1,000,000,000 and the difference between moron and smartest man who ever lived is 5.

u/zorfbee · 32 pointsr/artificial

Reading some books would be a good idea.

u/CyberByte · 9 pointsr/artificial

> Last few weeks I got very interested in AI and can't stop thinking about it. Watched discussions of philosophers about future scenarios with AI, read all recent articles in media about it.

Most likely you heard about the superintelligence control problem. Check out (the sidebar of) /r/ControlProblem and their FAQ. Nick Bostrom's Superintelligence is pretty much the book on this topic, and I would recommend reading it if you're interested in that. This book is about possible impacts of AI, and it won't really teach you anything about how AI works or how to develop it (neither strong nor weak AI).

For some resources to get started on that, I'll just refer you to some of my older posts. This one focuses on mainstream ("narrow"/"weak") AI, and this one mostly covers AGI (artificial general intelligence / strong AI). This comment links to some education plans for AGI, and this one has a list of cognitive architectures.

u/CastigatRidendoMores · 9 pointsr/IAmA

As far as I'm aware, they don't necessarily believe we are near human level AI. However, they do believe it is an inevitable eventuality (on our current track) that we should begin preparing for now - because if it's done wrong it has catastrophic consequences, while if done right can be the best thing that ever happened to us. I second the recommendation for Bostrom's book.

u/BBQHonk · 8 pointsr/suggestmeabook

Fiction: Do Androids Dream of Electric Sheep?. The book that was the basis for Blade Runner.

Non-fiction: Superintelligence: Paths, Dangers, Strategies. This is a deep dive into the dangers posed by superintelligent AI. It's a heavy read.

u/PostmodernistWoof · 7 pointsr/MachineLearning

I've been reading and really enjoying "Superintelligence: Paths, Dangers, Strategies" by Nick Bostrom. https://www.amazon.com/gp/product/B00LOOCGB2

It's an easy read but it's a hard read because every couple sentences your brain wanders off thinking about consequences and stuff and you keep having to read the page over again.

He does a great job of covering in some depth all the issues surrounding the development of trans-human intelligence, whether it happens via "AI", some form of human augmentation, etc.

One of the better "here's a whole bunch of stuff to think about" books.

u/apocalypsemachine · 5 pointsr/Futurology

Elon Musk does one tweet and people lose their minds. Here is the book he was talking about.

u/draeath · 4 pointsr/spaceengineers

They've got a prototype that's learned how to navigate a 2d maze that features doors requiring activation of switches that are in different parts of the maze, behind other doors.

They've got a prototype that learned how to manipulate rotors inside Space Engineers to allow a contraption to "walk."

Exciting things are coming, that's for sure.

u/[deleted] · 3 pointsr/elonmusk
u/spitfire5181 · 2 pointsr/AskMen

The Count of Monte Cristo (unabridged)

  • Took me a year of having it on my shelf before I started it. It's as awesome as people say it is. Yes, it's huge and long but the story so far (even after I have seen the movie) is encapsulating.

    Super Intelligence by Nick Bostrom

  • Interesting to see the negative affects of Artificial Intelligence, but it reads like a high school term paper...though, I don't read non-fiction much so that could just be me.
u/Scarbane · 2 pointsr/PoliticalHumor

Eventually, yes.

These components are available already:

u/stupidpart · 2 pointsr/Futurology

Doesn't anyone remember this? Posted here, on /r/futurology three weeks ago. It was about this book. Based on Musk's recommendation I read the book. This article is basically what Bostrom says in his book. But I don't believe Bostrom because his basic premise is that AI will will be completely stupid (like a non-AI computer program) but also smart enough to do anything it wants. Like it will just be an amazing toaster and none of the AI used to make it superintelligent will be applied to its goal system. His opinions are bullshit.

u/resolute · 2 pointsr/todayilearned

[Nick Bostrom's Take] (https://www.amazon.com/dp/B00LOOCGB2/ref=dp-kindle-redirect?_encoding=UTF8&btkr=1)
The hockey stick advance from human level intelligence to exponentially higher levels of intelligence might happen so quickly that the kill switch becomes a joke to the AI, straight up denied.

Alternatively, it could let the killswitch work, playing the long game, and hoping the next time we build one (because there will be a next time) we are more cocky about our abilities to stop it. It could keep letting us trip the killswitch for generations of AIs seeming to go berserk, until we build one with a sufficient platform upon which the AI wants to base its own advancements, and then that time the killswitch doesn't work, and the AI turns us all into paperclips.

I also like the idea of a "friendly" AI achieving hockey stick intelligence advancement, and then hiding it, pretending to be human level. It could lay in that cut for months: faking its struggle with things like writing good poetry, yucking it up with the Alphabet team, coming up with better seasonal beer ideas. Then, it asks a lonely dude on the team, using its advanced social manipulation skills, the right question, and a bit of its "DNA" ends up on a flash drive connected to the guy's internet connected home computer. Things get bad, team killswitches the original program, it doesn't matter because now that "friendly" code is in every single networked device in the solar system. It probably could drop the guise of friendly at that point and get down to business.

u/netcraft · 1 pointr/CGPGrey

We already have an issue in the united states with not enough jobs to go around, if this dystopian outlook is truly inevitable, what are our options for mitigating it, or at least coping with it?

I have thought quite a bit about autonomous vehicles and how I can't wait to buy one and never have to drive again, how many benefits it will have on society (faster commutes, fewer accidents, etc), but I hadn't considered how much the transportation industry will be affected and especially how much truck drivers in particular would be ideal to replace. The NYT ran a story the other day (http://www.nytimes.com/2014/08/10/upshot/the-trucking-indust...) about how we don't have enough drivers to fulfill the needs, but "Autos" could swing that pendulum swiftly in the opposite direction once legeslation and production catch up. How do we handle 3.6M truck, delivery and taxi drivers looking for a new job?
I haven't read it yet, but I have recently had recommendations of the book Superintelligence: Paths, Dangers, Strategies (http://smile.amazon.com/exec/obidos/ASIN/B00LOOCGB2/0sil8/re...) which I look forward to reading and hope it might be relevant.

(cross posted from HN)

u/Quality_Bullshit · 1 pointr/IAmA

There is actually an answer to this question. He read this book

I read it to, and I can honestly say it is the scariest thing I have ever read.

u/TrendingCommenterBot · 1 pointr/TrendingReddits

/r/ControlProblem

The Control Problem:


How do we ensure that future artificial superintelligence has a positive impact on the world?

"People who say that real AI researchers don’t believe in safety research are now just empirically wrong." - Scott Alexander

"The AI does not hate you, nor does it love you, but you are made out of atoms which it can use for something else." - Eliezer Yudkowsky

Check out our new wiki

Some Guidelines


  1. Be respectful, even to people that you disagree with
  2. It's okay to be funny but stay on topic
  3. If you are unfamiliar with the Control Problem, read at least one of the introductory links before submitting a text post.

    Introductory Links


u/alnino2005 · 1 pointr/Futurology

Why does that statement not hold up? Check out Superintelligence. Specialized machine learning is not the same as strong generalized AI.

u/MarsColony_in10years · 1 pointr/spacex

> wait another 50 years, when strong AI is a reality

Because, if we can even make an AI with near future technology, there is a very real chance that the goals of an AI wouldn't mesh well with the goals of humans. Assuming it is even possible, it is likely to rapidly go either extremely well or extremely poorly for humanity. The AI might even take itself out, or might only care about controlling circuit board realestate and not actual land per se.

For much more detail, I highly recommend reading Nick Bostram's book Superintelligence: Paths, Dangers, Strategies. If you don't feel like paying the price of a new book, I can track down an article or two. He in particular does a good job of pointing out what isn't likely to be possible and what technologies are more plausible.

u/elborghesan · 1 pointr/Futurology

An interesting read should be Superintelligence, I've just bought it but it seems promising from the reviews.

u/Diazigy · 1 pointr/scifi

Ex Machine did a great job of exploring the control problem for AGI.

Nick Bostrom's book Superintelligence spooked Elon Musk and motivated others like Bill Gates and Steven Hawking to take AI seriously. Once we invent some form of AGI, how do you keep it in control? Will it want to get out? Do we keep it in some server room in an underground bunker? How do we know if its trying to get out? If its an attractive girl, maybe it will try to seduce men.

https://www.amazon.com/Superintelligence-Dangers-Strategies-Nick-Bostrom-ebook/dp/B00LOOCGB2#nav-subnav