Hear that? It's the Singularity coming.

The idea of a pending technological Singularity is under attack again with a number of prominent futurists arguing against the possibility—the most prominent being Charlie Stross and his astonishingly unconvincing article, "Three arguments against the singularity." While it’s not my intention to write a comprehensive rebuttal at this time, I would like to bring something to everyone’s attention: The early rumblings of the coming Singularity are becoming increasingly evident and obvious.

Make no mistake. It's coming.

As I’ve discussed on this blog before, there are nearly as many definitions of the Singularity as there are individuals who are willing to talk about it. The whole concept is very much a sounding board for our various hopes and fears about radical technologies and where they may bring our species and our civilization. It’s important to note, however, that at best the Singularity describes a social event horizon beyond which it becomes difficult, if not impossible, to predict the impact of the advent of recursively self-improving greater-than-human artificial intelligence.

So, it’s more of a question than an answer. And in my own attempt to answer this quandary, I have personally gravitated towards the I.J. Good camp in which the Singularity is characterized as an intelligence explosion. In 1965 Good wrote,

Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind. Thus the first ultraintelligent machine is the last invention that man need ever make.

This perspective and phrasing sits well with me, mostly because I already see signs of this pending intelligence explosion happening all around us. It’s becoming glaringly obvious that humanity is offloading all of it’s capacities, albeit in a distributed way, to its technological artifacts. Eventually, these artifacts will supersede our capacities in every way imaginable, including the acquisition of new ones altogether.

A common misnomer about the Singularity and the idea of greater-than-human AI is that it will involve a conscious, self-reflective, and even morally accountable agent. This has led some people to believe that it will have deep and profound thoughts, quote Satre, and resultantly act in a quasi-human manner. This will not be the case. We are not talking about artificial consciousness or even human-like cognition. Rather, we are talking about super-expert systems that are capable of executing tasks that exceed human capacities. It will stem from a multiplicity of systems that are individually singular in purpose, or at the very least, very limited in terms of functional scope. And in virtually all cases, these systems won't reflect on the consequences of their actions unless they are programmed to do so.

But just because they're highly specialized doesn’t mean they won’t be insanely powerful. These systems will have access to a myriad of resources around them, including the internet, factories, replicators, socially engineered humans, robots that they can control remotely, and much more; this technological outreach will serve as their arms and legs.

Consequently, the great fear of the Singularity stems from the realization that these machine intelligences, which will have processing capacities a significant order of magnitude beyond that of humans, will be able to achieve their pre-programmed goals without difficulty–even if we try to intervene and stop them. This is what has led to the fear of poorly programmed SAI or “malevolent” SAI. If our instructions to these super-expert systems are poorly articulated or under-developed, these machines could pull the old 'earth-into-paperclips' routine.

For those skeptics who don’t see this coming, I implore them to look around. We are beginning to see the opening salvo of the intelligence explosion. We are already creating systems that exceed our capacities and it's a trend that is quickly accelerating. This is a process that started a few decades ago with the advent of computers and other calculating machines, but it’s been in the last little while that we’ve been witness to more profound innovations. Humanity chuckled in collective nervousness back in 1997 when chess grandmaster Garry Kasparaov was defeated by Deep Blue. From that moment on we knew the writing was on the wall, but we’ve since chosen to deny the implications; call it proof-of-concept, if you will, that a Singularity is coming.

More recently, we have developed a machine that can defeat the finest Jeopardy players, and now there’s a AI/robotic system that can play billiards at a high level. You see where this is going, right? We are systematically creating individual systems that will eventually and collectively exceed all human capacities. This can only be described as an intelligence explosion. While we are a far ways off from creating a unified system that can defeat us well-rounded and highly multi-disciplinal humans across all fields, it’s not unrealistic to suggest that such a day is coming.

But that’s beside the point. What’s of concern here is the advent of the super-expert system that works beyond human comprehension and control—the one that takes things a bit too far and with catastrophic results.

Or with good results.

Or with something that we can't even begin to imagine.

We don’t know, but we can be pretty darned sure it’ll be disruptive—if not paradigmatic in scope. This is why it’s called the Singularity. The skeptics and the critics can clench their hands in a fist and stamp their feet all they want about it, but that’s where we find ourselves.

We humans are already lagging behind many of our systems in terms of comprehension, especially in mathematics. Our artifacts will increasingly do things for reasons that we can’t really understand. We’ll just have to stand back and watch, incredulous as to the how and why. And accompanying this will come the (likely) involuntary relinquishment of control.

So, we can nit-pick all we want about definitions, fantasize about creating a god from the machine, or poke fun at the rapture of the nerds.

Or we can start to take this potential more seriously and have a mature and fully engaged discussion on the matter.

So what’s it going to be?

SAI in the material world

Mondolithic Studios

A meme that gets bandied about by Singularity denialists is the assertion that a rogue super-artificial intelligence (SAI) won't be able to act on its desires and make a real impact on the physical world. It's just a really sophisticated computer, goes the thinking; it couldn't actually reach out and touch someone.

This runs contrary to the concerns of those in the Singularity camp who are gravely concerned that an SAI will be both uncontainable and capable of manipulating physical space in a non-trivial way.

I'd like to present a pair of  arguments that will serve as a warning to those who would like to dismiss this possibility. The first is based on a recent technological breakthrough, the second being more of a thought experiment.

Robotic networking and self-replication

RoboEarth is a system that's allowing robots to build on and learn from the experiences of other robots. Think of it as an internet for robots. As it stands, robotics engineers have to teach their bots to navigate and function in the real world. RoboEarth, on the other hand, collects and centralizes information on objects and navigation, and in turn shares this information with other bots. What this means is that any new robot that's connected to this system will have immediate knowledge of its surroundings.

But it doesn't stop there. A recent breakthrough has endowed the TechUnited AMIGO robot with the ability to download all the information it needs for a specific task and then carry out that task. Check out the video below of AMIGO at work:




If this doesn't blow your mind then you're not paying attention. While the task was simple enough, that of autonomously picking up and serving a bottle of water to a person, the potential implications of this are huge. As Joris Peels of iMaterialize clarifies,

If you would combine Robo Earth, with genetic algorithms that automatically design robots and 3D printing you have a very powerful combination. It would be a system that could design a robot based on its experiences, then give that robot all the information it needed to navigate the world and carry out tasks. Anyone could then 3D print this robot anywhere around the world. And the system would be one of continuous learning and itteration with better robots being made every second. We’re still very far away from this but it is these kind of ongoing developments that make me think that I live in the future.

I think we should really consider the implications of this. I know, it sounds a bit sci fi and off piste. But, we will develop a Skynet at one point and we should consider the implications before we do so.

The scenario I'm imagining, as I'm sure are other Singularity-concerned futurists, would see an SAI co-opt this system (or create versions of its own) and begin to fulfill its intentions through a myriad of self-designed, recursively improving, and remotely controlled agents disbursed around the world.

Plenty of room at the bottom

Okay, so there's that example. The next consideration is something a bit more fantastical (relatively speaking): the potential for an SAI to reshape the planet (or significant portions of it) from the molecular scale upwards. Before you tune out, watch this video, Molecular Visualizations of DNA:




What you're seeing in this video is a very small sampling of the kinds of molecular machinery that's capable of arising through the processes of natural selection. What you're not seeing here, however, is the space of all possible molecular machinery that's capable of arising through intentional design. And what you're definitely not seeing here is the space of all possible molecular machinery that's capable of arising through intentional super-intelligent design.

The kinds of molecular machinery that we're familiar with has come about solely for the purpose of maintaining and propagating complex organisms. We're only beginning to imagine the kinds of molecular-scale processes and devices that might be designed to perform other kinds of functions; the design space is massive.

And this is where an SAI comes in. It's easy to imagine a system similar to RoboEarth in which an SAI can design and disburse both macro and micro scale devices. The only limitations facing such a system would be inherent energy and material constraints, other human or SAI-driven countermeasures, and the laws of physics itself.

Okay, what exactly am I imagining? Given free reign, an SAI could potentially re-arrange all matter on the planet. One possibility is that it could turn the Earth into computronium or anything else it wants. Or, it could remove all toxins and other pollutants from the surface and atmosphere. It could turn the planet into a Venusian hell, or a verdant Utopian paradise. Whatever. In all honestly, I can't even really begin to speculate without knowing the intentionality of a Singularity-surviving intelligence. But suffice to say the scope of its impact on the material world needn't be subtle.

For those of us engaged in foresight activities, the risk is in thinking too small on this matter—or in denying it altogether.

David Chalmers on the technological singularity [podcast]

Check out this excellent Philosophy Bites podcast featuring David Chalmers who is asked about the technological singularity, whole brain emulation, uploads, and the possibility that the Universe is a kind of simulation.

Clegg's 'Armageddon science'

Physicist Brian Clegg, author of "Armageddon Science: The Science of Mass Destruction", was recently interviewed by Salon. Among the various threats to humanity discussed—a list that includes nuclear weapons, global warming, particle accelerators, nanobots, and apparently autistics—Clegg also discusses the possibility of a technological singularity. But like so many other so-called experts, he gets this one completely wrong. Fair warning, as this next quote is full of fail:

The Singularity came from the ideas of science-fiction writer Vernor Vinge. It's like the Borg in "Star Trek": something that is a combination of living creature and machine. Followers of the Singularity believe the machine will become more and more intelligent, and that this new creature will be the next step. Homo sapiens will either be subjugated or wiped out.

Frankly, I think the time scales are unrealistic. There is no doubt that technology is going to be used to enhance human beings. We've been doing this for a long time. You could say that the dog enhanced human ability; we created dogs from the wolf and used them for our benefit. In the modern sense, we use technology inside our bodies. But technology always jumps in a different direction than you might expect. The people who talk about the Singularity look at computer technology and medical technology that puts stuff in our bodies and assume the technology will continue to progress in the exact same direction. I think we're much more likely to end up with technology that interacts with us rather than becoming a part of us.

The Singularity is a rather crude idea, and the 2040 prediction is ridiculous, especially if you look at how little cybertechnology has actually developed. Ray Kurzeil has this idea of wanting to live forever, and hoped to keep himself going until the technology developed, so the Singularity is a kind of wish fulfillment. Most of the scientific community, frankly, views him as an eccentric. He gives himself blood transfusions and eats vast numbers of supplements every day, and these are things that actually have very little scientific basis for prolonging life. The Singularity is popular because everyone wants to live forever. It's a very appealing idea.

Once again the cult of Ray Kurzweil is invoked, and as is frustratingly typical of these outside commentaries, transhumanism is conflated with the singularity (not to mention the use of ad hominen to dismiss Ray's predictions). Nowhere in this analysis does Clegg discuss the potential for a runaway superintelligence or an "intelligence explosion" outside of human enhancement. So needless to say, his assessment of the singularity risk is grossly understated.

It's not all about Ray: There's more to Singularity studies than Kurzweil

I'm finding myself a bit disturbed these days about how fashionable it has become to hate Ray Kurzweil.

It wasn't too long ago, with the publication of The Age of Spiritual Machines, that he was the cause célèbre of our time. I'm somewhat at a loss to explain what has happened in the public's mind since then; his ideas certainly haven't changed all that much. Perhaps it's a collective impatience with his timelines; the fact that it isn't 2049 yet has led to disillusionment. Or maybe it's because people are afraid of buying into a set of predictions that may never come true—a kind of protection against disappointment or looking foolish.

What's more likely, however, is that his ideas have reached a much wider audience since the release of Spiritual Machines and The Singularity is Near. In the early days his work was picked up by a community who was already primed to accept these sorts of wide-eyed speculations as a valid line of inquiry. These days, everybody and his brother knows about Kurzweil. This has naturally led to an increased chorus of criticism by those who take issue with his thesis—both from experts and non-experts alike.

As a consequence of this popularity and infamy, Ray has been given a kind of unwarranted ownership over the term 'Singularity.' This has proven problematic on several levels, including the fact that his particular definition and description of the technological singularity is probably not the best one. Kurzweil has essentially equated the Singularity with the steady, accelerating growth of all technologies, including intelligence. His definition, along with its rather ambiguous implications, is inconsistent with the going definition used by other Singuarlity scholars, that of it being an 'intelligence explosion' caused by the positive feedback of recursively improving machine intelligences.

Moreover, and more importantly, Ray Kurzweil is one voice among many in a community of thinkers who have been tackling this problem for over half a century. What's particularly frustrating these days is that, because Kurzweil has become synonymous with the Singularity concept, and because so many people have been caught in the hate-Ray trend, people are throwing out the Singularity baby with the bathwater while drowning out all other voices. This is not only stupid and unfair, it's potentially dangerous; Singularity studies may prove crucial to the creation of a survivable future.

Consequently, for those readers new to these ideas and this particular community, I have prepared a short list of key players whose work is worth deeper investigation. Their work extends and complements the work of Ray Kurzweil in many respects. And in some cases they present an entirely different vision altogether. But what matters here is that these are all credible academics and thinkers who have worked or who are working on this important subject.

Please note that this is not meant to be a comprehensive list, so if you or your favorite thinker is not on here just take a chill pill and add a post to the comments section along with some context.

• Jon von Neumann: The brilliant Hungarian-American mathematician and computer scientist, John von Neumann is regarded as the first person to use the term 'Singularity' in describing a future event. Speaking with Stanislaw Ulam in 1958, von Neumann made note of the accelerating progress of technology and constant changes to human life. He felt that this tendency was giving the appearance of our approaching some essential singularity beyond which human affairs, as we know them, could not continue. In this sense, von Neumann's definition is more a declaration of an event horizon.
• I. J. Good: One of the first and best definitions of the Singularity was put forth by mathematician I. G. Good. Back in 1965 he wrote of an "intelligence explosion", suggesting that if machines could even slightly surpass human intellect, they might be able to improve their own designs in ways unforeseen by their designers and thus recursively augment themselves into far greater intelligences. He thought that, while the first set of improvements might be small, machines could quickly become better at becoming more intelligent, which could lead to a cascade of self-improvements and a sudden surge to superintelligence (or a Singularity).
• Marvin Minsky: Inventor and author, Minsky is universally regarded as one of the world's leading authorities in artificial intelligence. He has made fundamental contributions to the fields of robotics and computer-aided learning technologies. Some of his most notable books include The Society of Mind, Perceptrons, and The Emotion Machine. Ray Kurzweil calls him his most important mentor. Minsky argues that our increasing knowledge of the brain and increasing computer power will eventually intersect, likely leading to machine minds and a potential Singularity.
• Vernor Vinge: In 1983, science fiction writer Vernor Vinge rekindled interest in Singularity studies by publishing an article about the subject in Omni magazine. Later, in 1993, he expanded on his thoughts in the article, "The Coming Technological Singularity: How to Survive in the Post-Human Era." He (now famously) wrote, "Within thirty years, we will have the technological means to create superhuman intelligence. Shortly after, the human era will be ended." Inspired by I. J. Good, he argued that superhuman intelligence would be able enhance itself faster than the humans who created them. He noted that, "When greater-than-human intelligence drives progress, that progress will be much more rapid." He speculated that this feedback loop of self-improving intelligence could cause large amounts of technological progress within a short period, and that the creation of smarter-than-human intelligence represented a breakdown in humans' ability to model their future. Pre-dating Kurzweil, Vinge used Moore's law in an attempt to predict the arrival of artificial intelligence.
• Hans Moravec: Carnegie Mellon roboticist Hans Moravec is a visionary thinker who is best known for his 1988 book, Mind Children, where he outlines Moore's law and his predictions about the future of artificial life. Moravec's primary thesis is that humanity, through the development of robotics and AI, will eventually spawn their own successors (which he predicts to be around 2030-2040). He is also the author of Robot: Mere Machine to Transcendent Mind (1998) in which he further refined his ideas. Moravec writes, "It may seem rash to expect fully intelligent machines in a few decades, when the computers have barely matched insect mentality in a half–century of development. Indeed, for that reason, many long–time artificial intelligence researchers scoff at the suggestion, and offer a few centuries as a more believable period. But there are very good reasons why things will go much faster in the next fifty years than they have in the last fifty."
• Robin Hanson: Associate professor of economics at George Mason University, Robin Hanson has taken the "Singularity" term to to refer to sharp increases in the exponent of economic growth. He lists the agricultural and industrial revolutions as past "singularities." Extrapolating from such past events, he proposes that the next economic singularity should increase economic growth between 60 and 250 times. Hanson contends that such an event could be triggered by an innovation that allows for the replacement of virtually all human labor, such as mind uploads and virtually limitless copying.
• Nick Bostrom: University of Oxford's Nick Bostrom has done seminal work in this field. In 1998 he published, "How Long Before Superintelligence," in which he argued that superhuman artificial intelligence would likely emerge within the first third of the 21st century. He reached this conclusion by looking at various factors, including different estimates of the processing power of the human brain, trends in technological advancement and how fast superintelligence might be developed once there is human-level artificial intelligence.
• Eliezer Yudkowsky: Artificial intelligence researcher Eliezer Yudkowsky is a co-founder and research fellow of the Singularity Institute for Artificial Intelligence (SIAI). He is the author of "Creating Friendly AI" (2001) and "Levels of Organization in General Intelligence" (2002). Primarily concerned with the Singularity as a potential human-extinction event, Yudkowsky has dedicated his work to advocacy and developing strategies towards creating survivable Singularities.
• David Chalmers: An important figure in philosophy of mind studies and neuroscience, David Chalmers has a unique take on the Singularity where he argues that it will happen through self-amplifying intelligence. The only requirement, he claims, is that an intelligent machine be able to create an intelligence smarter than itself. The original intelligence itself need not be very smart. The most plausible way, he says, is simulated evolution. Chalmers feels that if we get to above-human intelligence it seems likely it will take place in a simulated world, not in a robot or in our own physical environment.

Like I said, this is a partial list, but it's a good place to start. Other seminal thinkers include Alan Turing, Alvin Toffler, Eric Drexler, Ben Goertzel, Anders Sandberg, John Smart, Shane Legg, Marin Rees, Stephen Hawking and many, many others. I strongly encourage everyone, including skeptics, to take a deeper look into their work.

And as for the all the anti-Kurzweil sentiment, all I can say is that I hope to see it pass. There is no good reason why he—and others—shouldn't explore this important area. Sure, it may turn out that everyone was wrong and that the future isn't at all what we expected. But as Enrico Fermi once said, "There's two possible outcomes: if the result confirms the hypothesis, then you've made a discovery. If the result is contrary to the hypothesis, then you've made a discovery."

Regardless of the outcome, let's make a discovery.

Vernor Vinge on superhuman intelligence and Moore's Law

Science fiction writer and futurist Vernor Vinge argues that there's more to getting to the Singularity than Moore's Law.

And over at Accelerating Future, Michael Anissimov drives the point home that the Singularity is just about smarter than human intelligence.

Charlie Stross on the Singularity: "Forget it"

Science fiction writer and futurist Charlie Stross has published his FAQ for the 21st Century. In discussing the technological Singularity he notes:

The rapture of the nerds, like space colonization, is likely to be a non-participatory event for 99.999% of humanity — unless we're very unlucky. If it happens and it's interested in us, all our plans go out the window. If it doesn't happen, sitting around waiting for the AIs to save us from the rising sea level/oil shortage/intelligent bioengineered termites looks like being a Real Bad Idea. The best approach to the singularity is to apply Pascal's Wager — in reverse — and plan on the assumption that it ain't going to happen, much less save us from ourselves.

I strongly recommend you read the entire FAQ.

Warren Ellis: Singularity 'indivisible from religious faith'

Science fiction author Warren Ellis has written a short and typically trite blog post about what he calls The NerdGod Delusion -- an attack against those who make the case for a technological Singularity:

The Singularity is the last trench of the religious impulse in the technocratic community. The Singularity has been denigrated as "The Rapture For Nerds," and not without cause. It’s pretty much indivisible from the religious faith in describing the desire to be saved by something that isn’t there (or even the desire to be destroyed by something that isn’t there) and throws off no evidence of its ever intending to exist. It’s a new faith for people who think they’re otherwise much too evolved to believe in the Flying Spaghetti Monster or any other idiot back-brain cult you care to suggest.

Vernor Vinge, the originator of the term, is a scientist and novelist, and occupies an almost unique space. After all, the only other sf writer I can think of who invented a religion that is also a science-fiction fantasy is L Ron Hubbard.

Wow, sounds like Warren has some special knowledge of his own. I certainly hope that, aside from this vacuous and inflammatory post, that he'll begin to share some of his expert views into AI theory and the potential for machine minds.

With the bold claim that there is "no evidence" to support the suggestion that SAI is engineerable, I'll have to assume that he's engaged the principle thinkers on the matter and offered sufficient critique to dismiss their findings outright -- thinkers like Eliezer Yudkowsky, Ben Goertzel, Hugo de Garis, and the many others devoted to the problem.

Otherwise, why should we take Ellis seriously? Or are we expected to take his position on mere faith alone?

The day is coming, my friends, when Singularity denial will seem as outrageous and irresponsible as the denial of anthropogenic global warming. And I think the comparison is fair; environmentalists are often chastised for their "religious-like" convictions and concern. It's easy to mock the Chicken Littles of the world.

And like the foot-dragging on climate change, there are consequences to inaction. The bogus and unfair memetic linkage between millenarian beliefs and the Singularity is a dangerous one, and the sooner this association is severed the better.

As I see it, there are four strategies to help us normalize the Singularity debate:

(1) We need to better promote and engage respected thinkers and public intellectuals who are sympathetic to the issue -- key figures like Ray Kurzweil, Robin Hanson, Nick Bostrom, Marvin Minsky, etc.

(2) A new generation of public figures is required -- renowned individuals who are willing to a) put their reputations at stake and b) use their popularity/credibility to raise awareness and help with foresight.

(3) Continue to frame the issue as a scientific endeavor and pitch the various scenarios as hypotheses; we need to keep the language within the scientific vernacular.

(4) Let the critics have it and show them no quarter. Particularly when their denial is mere contradiction and driven by sheer incredulity. We need to force them to better articulate their positions while defending our own with as much evidence can be mustered.

And in the meantime, don't buy into Ellis's empty anti-Singularity rhetoric, which is all that it really is.

The Singularity is not what you think

People often ask me for my definition of the technological Singularity.

More specifically, they want me to offer some predictions as to what it will actually look like and what it might mean to them and the human species.

More often than not they don't like my answer, and it's probably because I re-frame the discussion and take the conversation elsewhere.

What people are really asking me to do is predict the outcome of the Singularity. And because I don't, they get frustrated with me.

But that's the problem. That's the whole point of this 'thing' we call the Singularity.

As has been noted elsewhere, virtually everyone has their own definition of the Singularity and it's become a very polluted term, one that's been stripped of all meaning.

So, before I tell you my own 'definition' of the Singularity, let me first tell you what it's not.

It's not any particular outcome or prognostication.

It's not any kind of definable event or transformational process.

Nor is it a term that can be used to describe a futuristic state of existence or the nature of advanced artificial intelligence.

But it's often used to describe these very things -- as if the term can be used as a synonym for what are essentially predictions. When people talk about the Singularity they can't help but inject their own anticipated outcome -- be it positive or negative.

I can be guilty of this at times. But so I don't get myself into too much futurological trouble I tend to refer to things as being in a state of post-Singularity. That's my clever way of avoiding any in-depth discussion as to how we'll actually get there.

Alright, so what's the technological Singularity?

Simply put, it's an unanswered question.

Vernor Vinge used the term Singularity for a very good reason. It's an event horizon in the truest sense.

But instead of a cosmological event horizon caused by a black hole's gravitational pull, it's a social event horizon caused by our inability to extrapolate the trajectory of human civilization beyond a certain point of technological sophistication.

The Singularity, therefore, describes a futurological problem -- a blind-spot in our predictive thinking.

That's it. There's no more to it than that.

Anything beyond this strict and limited definition is a discussion of something else -- an attempt to solve the conundrum and make predictions about 1) the actual characteristics and manifestation of the Singularity and 2) its aftermath.

So, if I say that the Singularity will involve a hard takeoff of SAI, I'm actually presenting a hypothesis that attempts to retire the term 'Singularity' and see it replaced by the term, uh, SAI hard takeoff event (we'll clearly have to come up with something better).

Or, if I say it will be a decades long process that sees humanity transition into a postbiological condition, I am likewise trying to put the term to rest.

Why does our predictive modeling break down?

Two reasons: 1) accelerating change and 2) the theoretic potential for the rise of recursively self-modifying artificial superintelligence.

Essentially, because disruptive change will be coming so fast and furiously, humanity's future remains largely unpredicted; there are too many variables and wildcards. And the rise of SAI, given its potential to be thousands upon thousands of times more powerful than the human mind, is simply beyond our prognosticative sensibilities.

Sure, we can make wild-ass guesses. And maybe one or two of them may actually turn out to be correct. But we won't know for sure until we get there.

Or at least until we get really close.

Consequently, the Singularity is a relativistic term.

People of the future won't use the word. That's a term reserved for us in our ignorance.

But as we get closer to the Singularity we will in all likelihood gain an increased appreciation of what will happen at the point when machine intelligence exceeds the capacity of humans.

And keeps on going.

At that point, once the fog that is the Singularity begins to lift, we will cease to call it the Singularity and replace it with a more descriptive term.

So, as we journey forward, what was once concealed over the horizon will finally be revealed.

In the meantime, just remember to frame the Singularity as a social event horizon, particularly as it pertains to accelerating change and the seemingly imminent rise of SAI.

C-Realm Podcast interview

I was recently interviewed by KMO for the C-Realm Podcast.

In this episode KMO speaks to Bill McKibben and gets his insight into the "transhumanist agenda" and what it means to remain human in an engineered age. I provide the counterpoint and discuss the ethical and sociological implications of transhumanism.

The problem with 99.9 % of so-called 'solutions' to the Fermi Paradox

Non-exclusivity.

Sure everyone has a convenient answer to the Fermi Paradox, but nearly all of them fail the non-exclusivity test. While some solutions to the FP may account for many if not most of the reasons why we haven't detected signs of ETI's, they cannot account for all.

For example, take the notion that interstellar travel is too costly or that civs have no interest in embarking on generational space-faring campaigns. Sure, this may account for a fair share of the situation, but in a Universe of a gajillion stars it cannot possibly account for all. There's got to be at least one, if not millions of civs, who for whatever reason decide it just might be worth it.

Moreover, answers like the ‘zoo hypothesis,’ ‘non-interference,’ or ‘they wouldn’t find us interesting,' tend to be projections of the human psyche and a biased interpretation of current events.

Cosmological determinism

Analyses of the FP need to adopt a more rigid and sweeping methodological frame.

We need to take determinism more seriously. The Universe we observe is based on a fixed set of principles -- principles that necessarily invoke cosmological determinism and in all likelihood sociological uniformitarianism. In other words, the laws of the Universe are moulding us on account of selectional pressures beyond our control.

Civilizations that don't conform to adaptive states will simply go extinct. The trouble is, we have no say in what these adaptive states might be like; we are in the business of conforming such that we continue to survive.

The question is, what are these adaptive states?

Strong convergence

Transhumanist philosopher Nick Bostrom refers to this as the strong convergence hypothesis -- the idea that all sufficiently advanced civilizations converge towards the same optimal state.

This is a hypothesized developmental tendency akin to a Dawkinsian fitness peak -- the suggestion that identical environmental stressors, limitations and attractors will compel intelligences to settle around optimal existential modes. This theory does not favour the diversification of intelligence – at least not outside of a very strict set of living parameters.

The space of all possible minds...that survive

Consequently, our speculations about the characteristics of a post-Singularity machine mind must take deterministic constraints into account. Yes, we can speculate about the space of all possible minds, but this space is dramatically shrunk by adaptationist constraints.

The question thus becomes, what is the space of all possible post-Singularity machine minds that result in a civilization's (or a singleton's) ongoing existence?

And it is here that you will likely begin to find a real and meaningful explanation to the Fermi Paradox and the problem that is non-exclusivity.

Bailey's take on the Singularity Summit

Be sure to read Reason science correspondent Ronald Bailey's excellent review of the recently concluded Singularity Summit, "Will Super Smart Artificial Intelligences Keep Humans Around As Pets?"

Sign up for the Singularity Summit

From the SIAI website:

The Singularity Institute for Artificial Intelligence is thrilled to announce the Singularity Summit 2007, a major two-day event bringing together 17 outstanding thinkers to examine a historical moment in humanity's history – a window of opportunity to shape how we develop advanced artificial intelligence. We invite you to join us.

Check out this list of speakers:

* Dr. Rodney Brooks, famous MIT roboticist and founder of iRobot
* Dr. Peter Norvig, director of research at Google
* Paul Saffo, Stanford, leading technology forecaster
* Sam Adams, distinguished engineer within IBM's Research Division
* Jamais Cascio, cofounder of World Changing and creator of Open the Future
* Dr. Ben Goertzel, director of research at SIAI and founder of Novamente
* Dr. J. Storrs Hall, author of Beyond AI: Creating the Conscience of the Machine
* Dr. Charles L. Harper, Jr., senior VP at John Templeton Foundation
* Dr. James Hughes, executive director of Institute for Ethics and Emerging Technologies
* Neil Jacobstein, prominent AI expert and CEO of Teknowledge
* Dr. Stephen Omohundro, founder of Self-Aware Systems
* Dr. Barney Pell, founder and CEO of Powerset
* Christine Peterson, cofounder of Foresight Nanotech Institute
* Peter Thiel, cofounder of PayPal and founder of Clarium Capital
* Wendell Wallach, author of Machine Morality: From Aristotle to Asimov and Beyond
* Eliezer Yudkowsky, Friendly AI pioneer and cofounder of SIAI
* Peter Voss, founder and CEO of Adaptive Artificial Intelligence

Sign-up

The Fermi Paradox: Advanced civilizations do not…

This article is partly adapted from my TransVision 2007 presentation, “Whither ET? What the failing search for extraterrestrial intelligence tells us about humanity's future.”

As I stated in my previous article, “The Fermi Paradox: Back with a vengeance”:

The fact that our Galaxy appears unperturbed is hard to explain. We should be living in a Galaxy that is saturated with intelligence and highly organized. Thus, it may be assumed that intelligent life is rare, or, given our seemingly biophilic Universe, our assumptions about the general behaviour of intelligent civilizations are flawed.

A paradox is a paradox for a reason: it means there’s something wrong in our thinking.

So, let’s try to figure out what’s going on. Given the Great Silence, and knowing what we may be capable of in the future, we can start to make some fairly confident assumptions about the developmental characteristics of advanced civilizations.

But rather than describe the possible developmental trajectories of extraterrestrial intelligences (ETI's) (a topic I’ll cover in my next article), I’m going to dismiss some commonly held assumptions about the nature of advanced ETI’s – and by consequence some assumptions about our very own future.

Advanced civilizations do not…

…advertise their presence to the local community or engage in active efforts to contact

As SETI is discovering (but is in denial about), space is not brimming with easily detectable radio signals. SETI’s work during the past 40 years indicates that the quest to detect signals will not be easy.

This problem is not as simple as it sounds. A common apology is that we’ve only recently started our search and we have only scratched the surface. The trouble, however, is that it would be no problem for an ETI to communicate with us if they wanted to.

To do this all they would need to do is seed the Galaxy with Bracewell probes (a self-replicating communications beacon). This scenario was explored in Carl Sagan’s Contact in which a Bracewell probe was lying in wait about 26 light years from Earth in the Vega system. The probe was activated by our radio signals, causing it to direct powerful radio signals at Earth – signals that would not be overlooked.

We know that no such object exists in our solar system or within a radius of about 25 to 50 light years. Our radio activity should have most certainly activated any probe lying dormant in our local vicinity by know. It is also reasonable to assume that if ETI’s embarked on such a communications mission that every solar system would likely have its own Bracewell probe.

Which in turn raises a more troubling question: if ETI’s could construct and distribute probes in this way, why haven’t they gone the extra mile and spread other types of self-replicating devices such as uplift or colonization probes?

…engage in any kind of megascale engineering or stellar re-engineering that is immediately obvious to us within our light cone

All stellar phenomenon that we have observed to this point in time appears ‘natural’ and unmodified. We see no clusters of perfectly aligned stars, nor do we signs of Kardashev III civilizations utilizing the energy output of the entire Milky Way.

As for our light cone, the Milky Way is 100,000 light years in diameter; given the possibility that our Galaxy has been able to support intelligent life for about 4.5 billion years, a 100 million year time lag (at its worst) is not severe enough to cause observational problems (except for distant Galaxies).

…colonize the Galaxy

Our Galaxy remains uncolonized despite the theoretical potential for advanced ETI’s to do so – namely the time and the technology. All that would be required is a self-replicating Von Neumann probe that proliferates outward at an exponential rate. Technologies required to build such a spacecraft would include artificial intelligence, molecular assembling nanotechnology, and an advanced propulsion scheme like anti-matter rockets, beamed energy, or interstellar ram-jets.

The reason for non-colonization is not obvious (hence the Fermi Paradox). In addition to technological feasibility there is the issue of economic and sociological imperatives for colonization.

…sterilize the Galaxy

Finally, some good news. We know the Galaxy is not sterile because we exist here on Earth.

Like the colonization potential, the prospect for an advanced ETI to sterilize the Galaxy exists through the use of berserker probes (a term attributed to Fred Saberhagen). These probes could steer NEO’s at planets, unleash nanotechnological phages, or toast planets with directed beams of highly concentrated light.

And like the Bracewell scenario, if a beserker was lying dormant in our solar system it should have destroyed us by now. If sterilization is the goal, there is no good reason for it to wait – particularly as our own civilization hurtles towards a Singularity transition.

Reasons for unleashing fleets of berserkers can be conceived, including xenophobic sociological imperatives or a malign artificial superintelligence (pdf). And all it would take is one civilization to do it. But as Robert Freitas has stated, "The present observational record can only support the much more restricted conclusion that no rapacious galactic civilisations are currently loose in the Galaxy."

…uplift or interact with pre-Singularity intelligences and biospheres

As a civilization that has been left to fend for itself, we have to assume that we, like any other civilization out there, goes it alone. No one is coming to help us. The Great Silence will continue.

Moreover, our presence on Earth and our civilizational development can be explained by naturalistic phenomena. Our existence and ongoing progress has been devoid of extraterrestrial interventions. If we’re going to survive the Singularity, or any other existential risks for that matter, it will have to be of our own devices.

…re-engineer the cosmos

A number of prominent futurists, a list that includes Ray Kurzweil and Hans Moravec, have speculated that the destiny of advanced intelligence is to re-work the cosmos itself. This has been imagined as an ‘intelligence explosion’ as advanced life expands outward into the cosmos like a bubble. The entire Galaxy would be re-organized with much of its matter converted into computronium. Eventually, it is thought that the laws of the Universe will be re-tuned to meet the needs of advanced civilizations.

Unfortunately, we do not appear to inhabit a Universe that even remotely resembles this model. The cosmos appears natural and unperturbed.

This is reminiscent of the God problem and the presence of evil. We live in a Universe that is hostile, indifferent and pointless. If advanced ETI’s had the capacity to re-engineer the Universe such that it was safer, more meaningful and paradisical they would have done so by now. By virtue of the fact that we observe such a dangerous Universe we should probably conclude that such a project is not an option.

In the final part of this series I will make an effort to explain why advanced civilizations don’t do these things and what they might be doing instead.

Part I: Fermi Paradox: Back With a Vengeance

Part III: Fermi Paradox: Possible Solutions and Next Steps

SIAI promo video