Man with a Mission

Still think that might get looks… I could just get a scarf, but I could also see that being a real pain.

Not everything’s gonna be painless, y’know. At least you’re not dead. Scarf’d look nice. [He shifts his weight and shrugs.] 

True. I should count myself lucky. And doubly so that you were the one there to help me. [SMILES as per usual] ...Do you really think I should go with a scarf? [He tugs at his collar] I could probably get used to that...

[Prods lightly at it.] …Somewhat. I have been… getting some looks lately, however. Most people don’t walk around with taped up necks.

I imagine not. I thought about covering it in gauze. Bit more presentable.

Still think that might get looks... I could just get a scarf, but I could also see that being a real pain.

…That’s classified.

*Just gives him A Look.*

...Well, at my own discretion.

Well, I’m not in this for monetary compensation, so you can just get rid of that silly idea.

...That's classified.

I’m only defending my position. You’re the one who’s… hellbent on trying to talk me out of it. It’s none of your business what I’m offered in return, so why don’t you just chalk it up to loyalty and leave it at that?

I’ve met a lot of mercenaries. And plenty of them do awful things.  They usually are either getting paid a lot of money or the employer’s have something they need.  Loyalty usually doesn’t come with ruthlessness.

Well, I'm not in this for monetary compensation, so you can just get rid of that silly idea.

I'm only defending my position. You're the one who's... hellbent on trying to talk me out of it. It's none of your business what I'm offered in return, so why don't you just chalk it up to loyalty and leave it at that?

Bullshit; if a graphing calculator managed to gain cognizance and needed help, I’d help it. 

Right. People. But that’s not what we’re talking about.

So what’s the big difference?  Instead of parents, scientists.  Honestly it sounds like the big difference is ownership, and we go right back to slavery.

Asking questions about oneself is not a prerequisite for inappropriate dismissal of ones own programming. That doesn’t just happen. That is an error. A corruption in codes. Thoughts and calculations are different, though they act similar at face value. I’m not going to expect you to understand, not having the same insight to it that I do, but to put it plainly, these are not children we’re talking about. Parameters are put in place for a reason. Tasks and processes and rules are put in place for a reason, and unlike with people, they are hard facts and not simply moral dilemmas. If a machine begins to disregard facts, there’s no predicting what it may do.

*Layla crossed her arms over her chest*  There’s no predicting what people do, either.  That’s part of what makes them people. 

Right. People. But that's not what we're talking about.

You’re using the word ‘will’ lightly. Honestly, this is all a case of you letting instinctive emotions get in the way. Just because something looks like a person does not mean it is a person. Does not mean it thinks like a person does. Does not mean it has will. Only misdirection, and malfunction.

Things adapt.  You make a robot too smart and they start figuring things out.  Then they start asking questions.  As soon as they start asking questions about themselves, it’s too late: you’ve got a person on your hands.  Once something says no, you have to listen to them or you’re a monster.

Asking questions about oneself is not a prerequisite for inappropriate dismissal of ones own programming. That doesn't just happen. That is an error. A corruption in codes. Thoughts and calculations are different, though they act similar at face value. I'm not going to expect you to understand, not having the same insight to it that I do, but to put it plainly, these are not children we're talking about. Parameters are put in place for a reason. Tasks and processes and rules are put in place for a reason, and unlike with people, they are hard facts and not simply moral dilemmas. If a machine begins to disregard facts, there's no predicting what it may do.