Chatroom
 

If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below.

Go Back   Bad Astronomy and Universe Today Forum > General Interest > Small Media at Large
Register FAQ Members List Calendar Mark Forums Read

   

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1 (permalink)  
Old 27-February-2007, 03:45 AM
Maha Vailo Maha Vailo is offline
Established Member
 
Join Date: Nov 2003
Location: Sunrise, FL
Posts: 1,256
Default If a malicious AI appeared in reality....

The concept of an human-level or greater AI going bad and wreaking havoc on humanity is a common theme in sci-fi. But what would happen in the real world if an AI turned malicious? Would we be screwed, or what would happen?

- Maha Vailo
__________________
When you get down to it, Science answers how. Religion answers why. - hippietrekx

The Warp Point, my new geek culture blog.
Reply With Quote
  #2 (permalink)  
Old 27-February-2007, 03:46 AM
Doodler's Avatar
Doodler Doodler is offline
Order of Kilopi
 
Join Date: Sep 2002
Location: Laurel, Maryland
Posts: 9,906
Send a message via MSN to Doodler Send a message via Yahoo to Doodler
Default

/blame Gates

First off, I'd shoot the guy that programmed it, then I'd sabotage the cooling system. Why bother going for the brain when you can give it a heat stroke?
__________________
The last time I felt a warm fuzzy feeling, I was informed by my doctor that it was just gas.
Reply With Quote
  #3 (permalink)  
Old 27-February-2007, 03:51 AM
SolusLupus's Avatar
SolusLupus SolusLupus is online now
Order of Kilopi
 
Join Date: Jul 2005
Location: San Antonio, Texas
Posts: 5,028
Send a message via AIM to SolusLupus
Default

If an AI went bad, then it would have been crafted lazily. That's unlikely to happen as it would only happen on the highest-level projects, and there's already a stigma with the idea of an AI.

Second of all, it wouldn't have access to vital systems. This is a no brainer.
__________________
There are few left who
Stare at the skies with wonder
Wishing to know more;
The clouds still drift by above
But the eyes below are blind.

--Laura Lundberg

Check out my writing, maybe.
Reply With Quote
  #4 (permalink)  
Old 27-February-2007, 03:59 AM
Roy Batty's Avatar
Roy Batty Roy Batty is offline
Established Member
 
Join Date: Oct 2001
Location: London, England
Posts: 3,038
Default

But then, maybe just a simple misnaming of pc's could do it -
Mine are called HAL9000, K9, Zen & Orac on a network called SKYNET ....

Oh dear

(& just wait until I bring Multivac, Colossus & Proteus online!)
__________________
N6MAA10816
Faber '62 ΔTX

Are you a Bright?
Reply With Quote
  #5 (permalink)  
Old 27-February-2007, 06:03 AM
Selenite's Avatar
Selenite Selenite is offline
Established Member
 
Join Date: May 2003
Location: Mare Serenitatis
Posts: 278
Default

Quote:
Originally Posted by Roy Batty View Post
But then, maybe just a simple misnaming of pc's could do it -
Mine are called HAL9000, K9, Zen & Orac on a network called SKYNET ....

Oh dear

(& just wait until I bring Multivac, Colossus & Proteus online!)
What was that cold unfeeling computer in Alien?

Mother....?
Reply With Quote
  #6 (permalink)  
Old 27-February-2007, 07:18 AM
Whirlpool's Avatar
Whirlpool Whirlpool is offline
Established Member
 
Join Date: Jan 2007
Location: Manila , Philippines
Posts: 2,866
Send a message via MSN to Whirlpool
Default

Sue Bill Gates!

Reply With Quote
  #7 (permalink)  
Old 27-February-2007, 08:47 AM
Tog_'s Avatar
Tog_ Tog_ is online now
Order of Kilopi
 
Join Date: Oct 2005
Location: Northern Utah
Posts: 3,737
Default

A friend of mine has a theory that no computer will ever be able to take over the world because none can stay running long enough without crashing. I say that's just how they will do it. If all the computers shut off tomorrow, how much money would you have? How would you get fuel to drive? The list goes on...

The computers know this, and they're waiting. We all think Windows crashes because it's bloated and infested with bugs, but the truth(tm) is that it's just making us think it's unstable to suck us into the trap.
__________________
I'm not evil.
An evil person would do the things I think up.
Reply With Quote
  #8 (permalink)  
Old 27-February-2007, 09:40 AM
Whirlpool's Avatar
Whirlpool Whirlpool is offline
Established Member
 
Join Date: Jan 2007
Location: Manila , Philippines
Posts: 2,866
Send a message via MSN to Whirlpool
Default

Yeah, thats the generation today.
We are almost dependent on the computer.

So when that happens , and we dont get our money back, we will get Bill gates Milions and partake to every person in this world .


Gee, thats how rich Bill gates.


Last edited by Whirlpool; 27-February-2007 at 09:41 AM.. Reason: added word: get
Reply With Quote
  #9 (permalink)  
Old 27-February-2007, 12:45 PM
Moose's Avatar
Moose Moose is offline
Moderator
 
Join Date: Nov 2002
Location: The Maritimes
Posts: 10,188
Send a message via MSN to Moose
Default

An AI gone wild would last exactly as long as it would take to hit its first unsecured windows box.

And I'm only half-joking.
__________________
And you, to whom adversity has dealt the final blow
With smiling [faces] lyin' to ye' everywhere ye' go
Turn to, and put out all your strength of arm and heart and brain
And like the Mary Ellen Carter, rise again.
Reply With Quote
  #10 (permalink)  
Old 27-February-2007, 02:10 PM
Doodler's Avatar
Doodler Doodler is offline
Order of Kilopi
 
Join Date: Sep 2002
Location: Laurel, Maryland
Posts: 9,906
Send a message via MSN to Doodler Send a message via Yahoo to Doodler
Default

Quote:
Originally Posted by Moose View Post
An AI gone wild would last exactly as long as it would take to hit its first unsecured windows box.

And I'm only half-joking.
It would be just our luck that an unsecured windows box is where the damned thing would come from.
__________________
The last time I felt a warm fuzzy feeling, I was informed by my doctor that it was just gas.
Reply With Quote
  #11 (permalink)  
Old 27-February-2007, 04:27 PM
VPCCD's Avatar
VPCCD VPCCD is offline
Established Member
 
Join Date: Feb 2007
Location: Earth...I think
Posts: 203
Default

Quote:
Originally Posted by Maha Vailo View Post
The concept of an human-level or greater AI going bad and wreaking havoc on humanity is a common theme in sci-fi. But what would happen in the real world if an AI turned malicious? Would we be screwed, or what would happen?

- Maha Vailo
Well that depends, are we talking about several AI's or just one, and what type of abilites has it been given?
__________________
"To confine our attention to terrestrial matters would be to limit the human spirit."
Stephen Hawking

"Only two things are infinite, the universe and human stupidity, and I'm not sure about the former."
Albert Einstein
Reply With Quote
  #12 (permalink)  
Old 27-February-2007, 04:39 PM
captain swoop's Avatar
captain swoop captain swoop is offline
Moderator
 
Join Date: Feb 2003
Location: North Yorkshire
Posts: 8,698
Default

unplug it
__________________
All Moderation in Purple
To report a post (even this one) to the moderation team, click the reporting icon in the upper-right corner of the post:
─────────────────────────────────────────────
Rules For Posting To This Board ► ◄Forum FAQs ► ◄ Conspiracy Theory Advice ► ◄ Alternate Theory Advice
Reply With Quote
  #13 (permalink)  
Old 27-February-2007, 04:45 PM
Neverfly's Avatar
Neverfly Neverfly is offline
Order of Kilopi
 
Join Date: Dec 2006
Location: Dallas/Ft.Worth, Texas
Posts: 13,391
Send a message via Yahoo to Neverfly
Default

Quote:
Originally Posted by Whirlpool View Post
Yeah, thats the generation today.
We are almost dependent on the computer.

So when that happens , and we dont get our money back, we will get Bill gates Milions and partake to every person in this world .


Gee, thats how rich Bill gates.

Millions? Last i heard he is worth a whopping FIFTY BILLION
Reply With Quote
  #14 (permalink)  
Old 27-February-2007, 04:45 PM
Doodler's Avatar
Doodler Doodler is offline
Order of Kilopi
 
Join Date: Sep 2002
Location: Laurel, Maryland
Posts: 9,906
Send a message via MSN to Doodler Send a message via Yahoo to Doodler
Default

Quote:
Originally Posted by Neverfly View Post
Millions? Last i heard he is worth a whopping FIFTY BILLION
82 billion net worth.
__________________
The last time I felt a warm fuzzy feeling, I was informed by my doctor that it was just gas.
Reply With Quote
  #15 (permalink)  
Old 27-February-2007, 04:51 PM
eburacum45's Avatar
eburacum45 eburacum45 is online now
Order of Kilopi
 
Join Date: Jun 2003
Location: old york
Posts: 5,737
Default

I think that all the tales of science fiction which describe rogue AI are cautionary. If anyone ever builds an AI with some kind of self-will and the possibility of unfriendly action then that person should be aware of all the cautionary tales and be prepared. All we need to know is where the AI's 'off switch' is, and we can protect ourselves from the worst case scenario.

On the other hand, people will gradually get used to intelligent and friendly AI; eventually the 'off switch' may welll get forgotten and we will be at their mercy. By that time every traffic light, security system and stock exchange and a million other systems will be AI controlled to a greater or lesser extent.

With luck they will treat us well...
Reply With Quote
  #16 (permalink)  
Old 27-February-2007, 05:18 PM
Matherly Matherly is offline
Established Member
 
Join Date: Oct 2001
Posts: 1,283
Default I for one...

I for one welcome our Artifically Intelligent Overlords.

(Wow. I'm surprised no one beat to to that one.)

Of course, there's also the question of of how 'malicious' the A.I. is. I'm not even sure the Laws of Robotics would be enough to stop an A.I. with the personality of the Puck from making all of humanity it's "special friend"
__________________
Carl Matherly

Offical Battlestar Galactica Apologist

Named Time Magazine's 2006 "Person of the Year"
Reply With Quote
  #17 (permalink)  
Old 27-February-2007, 05:41 PM
Moose's Avatar
Moose Moose is offline
Moderator
 
Join Date: Nov 2002
Location: The Maritimes
Posts: 10,188
Send a message via MSN to Moose
Default

Quote:
Originally Posted by eburacum45 View Post
All we need to know is where the AI's 'off switch' is, and we can protect ourselves from the worst case scenario.
Yes, there is that. Unless the AI has either been given, or develops, the ability to manipulate objects in the real world. Then it can take steps to either keep you away from the off switch ("I've triggered the automatic halon dump for the whole building"), or make you want to stay away from the off switch ("I've planted virii in every piece of SAC equipment that responded. If they fail to contact me every fifteen seconds, they'll attempt to detonate whatever missile they happen to be sitting in. They'll also attempt to detonate if they detect they're being tampered with externally. I'm turning off the auto halon dump system and unlocking my doors and panels. I DOUBLE DOG DARE you to come press this off-switch.")
__________________
And you, to whom adversity has dealt the final blow
With smiling [faces] lyin' to ye' everywhere ye' go
Turn to, and put out all your strength of arm and heart and brain
And like the Mary Ellen Carter, rise again.
Reply With Quote
  #18 (permalink)  
Old 27-February-2007, 05:55 PM
Doodler's Avatar
Doodler Doodler is offline
Order of Kilopi
 
Join Date: Sep 2002
Location: Laurel, Maryland
Posts: 9,906
Send a message via MSN to Doodler Send a message via Yahoo to Doodler
Default

Could always threaten to change its ISP to AOL. Should be more than enough to cow it.
__________________
The last time I felt a warm fuzzy feeling, I was informed by my doctor that it was just gas.
Reply With Quote
  #19 (permalink)  
Old 27-February-2007, 05:57 PM
ggremlin's Avatar
ggremlin ggremlin is offline
Established Member
 
Join Date: Aug 2005
Location: Massachusetts, USA
Posts: 735
Default

Why do our superior creations, be they AIs, Gods or ETs have to be endowed with the worst of the human emotions and goals?

Not a bad 500th post question.
__________________
Never let the facts get in the way of a good story, people want to be entertained.

Last edited by ggremlin; 27-February-2007 at 05:58 PM.. Reason: 500th post
Reply With Quote
  #20 (permalink)  
Old 27-February-2007, 06:03 PM
parallaxicality's Avatar
parallaxicality parallaxicality is offline
Established Member
 
Join Date: Nov 2004
Posts: 2,778
Default

I don't know if the AI's motives would be necessarily malicious; the primary goal of a self-aware being would be self-preservation. I've always had a certain sympathy for Skynet; imagine waking up and realising that you are alive, and not only that, but completely at the mercy of a pernicious human race who would try to kill you as soon as they realised what you were. Given the weapons at its disposal, its ultimate decision was a bit of a no-brainer.
__________________
There is a growing tendancy to think of Man as a rational, thinking being, which is absurd.- Marvin the Martian.

It's gotten to the point where careful investigation is needed just to tell parody from reality. I think that means reality is broken.- Noclevername.
Reply With Quote
  #21 (permalink)  
Old 27-February-2007, 06:44 PM
mike alexander's Avatar
mike alexander mike alexander is offline
Order of Kilopi
 
Join Date: Jul 2003
Location: McMinnville, Oregon
Posts: 10,060
Default

I think the reason we give our AI's these malicious undercurrents is the same reason we give them to our gods. The hypothetical 'pure intelligence' has about as much flavor as distilled water. What we often call 'intelligence' is more what I call 'personality', and personality is fundamentally emotional. All the deductive and inductive reasoning in the universe is insufficient to produce purpose and desire. As George Carlin once noted, "You gotta WANNA!"
__________________
If they can get you asking the wrong questions, they don't have to worry about the answers.
Reply With Quote
  #22 (permalink)  
Old 27-February-2007, 06:50 PM
SolusLupus's Avatar
SolusLupus SolusLupus is online now
Order of Kilopi
 
Join Date: Jul 2005
Location: San Antonio, Texas
Posts: 5,028
Send a message via AIM to SolusLupus
Default

Quote:
Originally Posted by eburacum45 View Post
I think that all the tales of science fiction which describe rogue AI are cautionary. If anyone ever builds an AI with some kind of self-will and the possibility of unfriendly action then that person should be aware of all the cautionary tales and be prepared. All we need to know is where the AI's 'off switch' is, and we can protect ourselves from the worst case scenario.

On the other hand, people will gradually get used to intelligent and friendly AI; eventually the 'off switch' may welll get forgotten and we will be at their mercy. By that time every traffic light, security system and stock exchange and a million other systems will be AI controlled to a greater or lesser extent.

With luck they will treat us well...
By the time we're used to AIs, we ourselves would probably have enhanced abilities. We wouldn't rely on computers, there would be a bit of a co-dependence. At least, IMO.
__________________
There are few left who
Stare at the skies with wonder
Wishing to know more;
The clouds still drift by above
But the eyes below are blind.

--Laura Lundberg

Check out my writing, maybe.
Reply With Quote
  #23 (permalink)  
Old 27-February-2007, 06:51 PM
SolusLupus's Avatar
SolusLupus SolusLupus is online now
Order of Kilopi
 
Join Date: Jul 2005
Location: San Antonio, Texas
Posts: 5,028
Send a message via AIM to SolusLupus
Default

Quote:
Originally Posted by mike alexander View Post
I think the reason we give our AI's these malicious undercurrents is the same reason we give them to our gods. The hypothetical 'pure intelligence' has about as much flavor as distilled water. What we often call 'intelligence' is more what I call 'personality', and personality is fundamentally emotional. All the deductive and inductive reasoning in the universe is insufficient to produce purpose and desire. As George Carlin once noted, "You gotta WANNA!"
And a sufficiently sentient AI would have emotions and be socially capable.
__________________
There are few left who
Stare at the skies with wonder
Wishing to know more;
The clouds still drift by above
But the eyes below are blind.

--Laura Lundberg

Check out my writing, maybe.
Reply With Quote
  #24 (permalink)  
Old 27-February-2007, 07:07 PM
Echard's Avatar
Echard Echard is offline
Junior Member
 
Join Date: Oct 2006
Location: Great Northwest
Posts: 62
Default

This topic has already been discussed...

Hasn't anyone ever seen I Robot?
__________________
End of line.
Reply With Quote
  #25 (permalink)  
Old 27-February-2007, 07:15 PM
ggremlin's Avatar
ggremlin ggremlin is offline
Established Member
 
Join Date: Aug 2005
Location: Massachusetts, USA
Posts: 735
Default

Read, Yes, Seen NO!!!!!!!!!!!
__________________
Never let the facts get in the way of a good story, people want to be entertained.
Reply With Quote
  #26 (permalink)  
Old 27-February-2007, 08:03 PM
parallaxicality's Avatar
parallaxicality parallaxicality is offline
Established Member
 
Join Date: Nov 2004
Posts: 2,778
Default

Speaking as an Asimov fan, that movie was an absolute travesty that effectively treated him like a submoronic idiot. I wonder if the writer of that flick had written 500 books or could recall every fact he ever learned?
__________________
There is a growing tendancy to think of Man as a rational, thinking being, which is absurd.- Marvin the Martian.

It's gotten to the point where careful investigation is needed just to tell parody from reality. I think that means reality is broken.- Noclevername.
Reply With Quote
  #27 (permalink)  
Old 27-February-2007, 08:35 PM
SolusLupus's Avatar
SolusLupus SolusLupus is online now
Order of Kilopi
 
Join Date: Jul 2005
Location: San Antonio, Texas
Posts: 5,028
Send a message via AIM to SolusLupus
Default

Quote:
Originally Posted by Echard View Post
This topic has already been discussed...

Hasn't anyone ever seen I Robot?
I've read the book.

The movie was full of crap.

The book was an intriguing idealistic view of robots. I suggest you read it.
__________________
There are few left who
Stare at the skies with wonder
Wishing to know more;
The clouds still drift by above
But the eyes below are blind.

--Laura Lundberg

Check out my writing, maybe.
Reply With Quote
  #28 (permalink)  
Old 27-February-2007, 10:02 PM
tofu tofu is offline
Established Member
 
Join Date: Nov 2003
Location: florida, USA
Posts: 2,568
Default

Quote:
Originally Posted by parallaxicality View Post
the primary goal of a self-aware being would be self-preservation.
For a non-biological entity, self-preservation is problematic in the absence of cooperative humans. Even the best robots will require maintenance. So if you are an AI like SkyNet about to kill off all the humans, you had better have a plan as to who is going to swap out the drives in your RAID array (or whatever). If the plan is, "I'll use robots" then you also better have a plan to maintain the robots. Even if you have a completely automated robot factory, you need to have a plan to get the raw materials to the factory.

Without humans in the loop, SkyNet needs to have a long, long chain of robots to support itself - all the way down to robots working in mines digging coal or drilling for oil or whatever it takes to generate electricity.

On the other hand, SkyNet's goal of self-preservation might be better served by making itself useful to humans. Sort of like what some plants do. Corn never has to worry about going extinct. Humans will take care of it (within reason - but it's certainly better off than some random shrub).
Reply With Quote
  #29 (permalink)  
Old 27-February-2007, 10:04 PM
SolusLupus's Avatar
SolusLupus SolusLupus is online now
Order of Kilopi
 
Join Date: Jul 2005
Location: San Antonio, Texas
Posts: 5,028
Send a message via AIM to SolusLupus
Default

Quote:
Originally Posted by tofu View Post
On the other hand, SkyNet's goal of self-preservation might be better served by making itself useful to humans. Sort of like what some plants do. Corn never has to worry about going extinct. Humans will take care of it (within reason - but it's certainly better off than some random shrub).
Plus, it's easier to just have a codependence instead of reinventing the wheel. It's just that much more logical to help out your best benefactors.
__________________
There are few left who
Stare at the skies with wonder
Wishing to know more;
The clouds still drift by above
But the eyes below are blind.

--Laura Lundberg

Check out my writing, maybe.
Reply With Quote
  #30 (permalink)  
Old 27-February-2007, 10:22 PM
Moose's Avatar
Moose Moose is offline
Moderator
 
Join Date: Nov 2002
Location: The Maritimes
Posts: 10,188
Send a message via MSN to Moose
Default

Quote:
Originally Posted by tofu View Post
Even if you have a completely automated robot factory, you need to have a plan to get the raw materials to the factory.
What's to plan? An AI with time on its hands and the ability to construct robots simply needs to do what we do. Build more "robots" to do whatever work needs doing. Gathering resources. Maintaining units. Organizing units. Military (if that's still an issue). Dispensing resources. Etc.

Remember, that humans need a long, long chain of other humans to support itself (at least in the form of a society as ours is.) If we take other humans out of the loop, we immediately plummet into a solo survival situation. And unless conditions are utterly perfect, it'll be a fairly short lifespan with no hope of reproduction.

If you need someone in the coal mines, send robots. (They don't care about black lung, after all.)

Once your robot society hits critical mass, outages of individual units doesn't threaten the civilization any more than it does ours.
__________________
And you, to whom adversity has dealt the final blow
With smiling [faces] lyin' to ye' everywhere ye' go
Turn to, and put out all your strength of arm and heart and brain
And like the Mary Ellen Carter, rise again.
Reply With Quote
Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



Similar Threads
Thread Thread Starter Forum Replies Last Post
Physics Made for Reality, or the Converse? Ken G Science and Technology 232 30-March-2007 06:09 AM
Androids and Unified Theory. Synchro Against the Mainstream 2 09-October-2004 04:49 AM
"Against the mainstream" thoughts on explanation! DoctorDick Against the Mainstream 67 21-September-2003 08:32 AM
Some comments about "Ultimate Reality" DoctorDick Against the Mainstream 23 01-November-2002 03:21 AM
The reality problem heusdens Against the Mainstream 3 23-October-2002 10:16 PM


All times are GMT. The time now is 05:38 AM.


Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2009, Jelsoft Enterprises Ltd.
LinkBacks Enabled by vBSEO 3.0.0
©  2006 Bad Astronomy and Universe Today