Consider first the more accurate form of the question.
In order that tones of voice may not help the interrogator the answers
should be written, or better still, typewritten. The ideal arrangement is
to have a teleprinter communicating between the two rooms. Alternatively
the question and answers can be repeated by an intermediary. The object of
the game for the third player (B) is to help the interrogator. The best
strategy for her is probably to give truthful answers. She can add such
things as "I am the woman, don't listen to him!" to her answers, but it
will avail nothing as the man can make similar remarks.
We now ask the question, "What will happen when a machine takes the part of A in this game?" Will the interrogator decide wrongly as often when the game is played like this as he does when the game is played between a man and a woman? These questions replace our original, "Can machines think?"
The original question, `Can machines think?' I believe to be too meaningless to deserve discussion.
Nevertheless I believe that at the end of the century the use of words and general educated opinion will have altered so much that one will be able to speak of machines thinking without expecting to be contradicted."
John W. Campbell, Jr., the founding editor of Astounding Stories, a classic in the field of
science fiction (subsequently called Analog) used to urge writers to describe something
that "thinks as well as a human, but not like a human"
(see this editorial by Campbell: What do
you mean... human?.
slide 14
("Intimacy," I once told Sian, after we'd made love, "is the only cure for solipsism." She laughed and said, "Don't get too ambitious, Michael. So far, it hasn't even cured me of masturbation.")
True solipsism, though, was never my problem. From the very first time I considered the question, I accepted that there could be no way of proving the reality of an external world, let alone the existence of other minds - but I also accepted that taking both on faith was the only practical way of dealing with everyday life.
The question which obsessed me was this: Assuming that other people existed, how did they apprehend that existence? How did they experience being? Could I ever truly understand what consciousness was like for another person - any more than I could for an ape, or a cat, or an insect?
When an image or metaphor rang true for me, it proved only that I shared with the author a set of definitions, a culturally sanctioned list of word associations.
[embodiment? Galatea 2.2?]
My organic brain was removed and discarded, and control of my body handed over to my "jewel" - the Ndoli Device, a neural-net computer implanted shortly after birth, which had since learnt to imitate my brain, down to the level of individual neurons.
And I could not, for one second, imagine what it was like inside her head.
For a start, I rarely had any idea what she was thinking - in the sense of knowing how she would have replied if asked, out of the blue, to describe her thoughts at the moment before they were interrupted by the question. On a longer time scale, I had no feeling for her motivation, her image of herself, her concept of who she was and what she did and why. Even in the laughably crude sense that a novelist pretends to "explain" a character, I could not have explained Sian.
First, we exchanged bodies. I discovered what it was like to have breasts and a vagina - what it was like for me, that is, not what it had been like for Sian. True, we stayed swapped long enough for the shock, and even the novelty, to wear off, but I never felt that I'd gained much insight into her experience of the body she'd been born with. My jewel was modified only as much as was necessary to allow me to control this unfamiliar machine, which was scarcely more than would have been required to work another male body.
slide 8
After three months, Sian had had enough. "I never realised how clumsy you were," she said. "Or that ejaculation was so dull."
I took a copy of the file home to Sian. She watched it thoughtfully, then said, "Slugs are hermaphrodites, aren't they? They hang in mid-air together on a thread of slime. I'm sure there's even something in Shakespeare, remarking on the glorious spectacle of copulating slugs. Imagine it: you and me, making slug love."
I fell on the floor, laughing.
I stopped, suddenly. "Where, in Shakespeare? I didn't think you'd even read Shakespeare."
[memory distinct from personality ???]
Did memories of being Michael, and memories of being Sian, contain so much more than the two of them could have put into words and exchanged verbally? Did I really know anything about the nature of their existence, or was my head just full of second-hand description intimate, and detailed, but ultimately as opaque as language?
If my mind were radically different, would that difference be something I could even perceive or would all my memories, in the act of remembering, simply be recast into terms that seemed familiar?
The past, after all, was no more knowable than the external world. Its very existence also had to be taken on faith and, granted existence, it too could be misleading.
We lasted a week.
Bentley had made - as the law required - snapshots of our jewels prior to the experiment. We could have gone back to them - and then had him explain to us why - but self-deception is only an easy choice if you make it in time.
We knew each other too well, that's all. Detail after tiny fucking microscopic detail. It wasn't that the truth hurt; it didn't, any longer. It numbed us. [...] Our surfaces had been stripped away, but not to reveal a glimpse of the soul. All we could see beneath the skin were the cogs, spinning.
I found that I now shared this view (a change whose precise origins I didn't much want to think about . . . but then, I'd always known she had the stronger personality, I should have guessed that something would rub off).
Together, we might as well have been alone, so we had no choice but to part.
Nobody wants to spend eternity alone.