☀︎

Ethical Computing Initiative

Fiction & Vocabulary

This is one page of a multi-part series on “ethical computing.”

While reading a series of posts examining history and current reality, one may be surprised to encounter a chapter describing what fiction authors thought might happen in times to come. Nevertheless, intelligent folks have done the hard work of analyzing past and present, extrapolating them towards the future, and then recording it for the benefit of others. These exercises in “critical thinking” give us much to contemplate.

Indeed, it’s hard to think of another subject where so many important works have been produced. More than insightful, these works provide us a useful vocabulary to communicate common historical and forward-looking concerns.

Books

1932, Brave New World

This classic describes a dystopian future of totalitarianism, where citizens are genetically engineered and conditioned to maintain social order. Venerable ideas:

Sound familiar? Author Aldous Huxley thought dystopia would be achieved through the catering-to of base desires combined with limitless distraction. Without need, without thought—there is no motivation to improve.

1949, Nineteen Eighty-Four / 1984

In contrast, 1984 describes a dystopian future of totalitarianism, surveillance, oppression, and endless war. One which author George Orwell thought would be achieved primarily through fear, torture, and the destruction of hope. Venerable ideas:

Indeed, these become more relevant every passing year—double-plus ungood. Many words have indeed come to be verboten.

The eponymously titled film, released during the target year was well done, appropriately dreary, and has a decent soundtrack.

1985, Amusing Ourselves to Death

(Non-fiction but so bound to the above works we’ll discuss it here.) Author Neil Postman contrasts the worlds of BNW with 1984:

What Orwell feared were those who would ban books. What Huxley feared was that there would be no reason to ban a book, as there would be no one who wanted to read one. Orwell feared those who would deprive us of information. Huxley feared those who would give us so much that we would be reduced to passivity and egoism. Orwell feared that the truth would be concealed from us. Huxley feared the truth would be drowned in a sea of irrelevance.

Recommended: Stuart McMillen’s webcomic on the subject.

Postman appears to believe Huxley hit closer to the mark in its predictions, and perhaps so. However with forty years further hindsight, Postman’s perspective—of living in a time of plenty in a liberal democracy in the late twentieth-century shows. It’s not clear a twenty-first century citizen of an authoritarian regime would feel the same way.

There is an important element in 1984 that is missing from BNW and very relevant to modern history: the never-ending fictitious war between several similar regimes to justify internal control.

In my opinion, the movie “Brazil” (inspired by 1984) made the same argument even more modern by replacing the war on an external “enemy” with a war on internal “terrorists”.

Unfortunately, 1984 and BNW are not exclusive, and certainly social psychology can implement elements of both. —rixed at HN

Agreed. Both authors had valuable insights, applicable in some places and times, less so in others. Each were more accurate in their predictions than we might prefer. The question of “who predicted better” is not terribly useful and could be argued endlessly, so let’s move on.

Films, TV

1968, 2001: A Space Odyssey

“I’m afraid I can’t do that Dave.”

Ahh yes, HAL 9000 takes the stage, reminiscent of Burroughs, UNIVAC, IBM, and their ilk. Younger folks are most likely not aware of the iconic, futuristic AI computer system programmed with higher priorities than human team-member survival.

It’s hard not to feel the same kind of dread (though of lesser magnitude), when your corporate handset tells you, “no.”  Let’s hope we never get to the point where these machines are making life-or-death decisions. Or, are we there already?

Written by Arthur C. Clarke and screenplay by Stanley Kubrick.


1976, SNL: We’re the Phone Company

Below is a favorite SNL commercial sketch from the late 70s. Created shortly before the breakup of the domineering AT&T on antitrust grounds, it illustrates the current age of corporate lock-in just… a little too well.

Starring Lily Tomlin of “Laugh-In” fame as Ernestine the telephone operator. The only copy we’ve found online recently is at Vimeo, transcript below. Apologies for the poor quality.

Alternatively, click to create an embedded player here:

Ernestine: A gracious hello. Here at the Phone Company, we handle eighty-four billion calls a year. Serving everyone from presidents and kings, to the scum of the earth! :-D  So, we realize that, every so often, you can’t get an operator, or for no apparent reason your phone goes out of order, or perhaps you get charged for a call you didn’t make. We don’t care!

Watch this… ((hits buttons randomly)) We just lost Peoria.

You see, this phone system consists of a multibillion-dollar matrix of space-age technology that is so… sophisticated ((hits buttons with her elbows)) even we can’t handle it. But that’s your problem, isn’t it?

So, the next time you complain about your phone service, why don’t you try using two Dixie cups with a string!

We don’t care.  We don’t have to.  We’re the Phone Company.

#DGAF.  Believe it or not, AT&T is back, in more ways than one.

1984, The Terminator and Skynet

“It decided our fate in a microsecond.”—Kyle Reese

It’s easy to forget all these years later, but the first Terminator film by James Cameron was quite the suspenseful thriller, expressing the dangers of technology implemented without safeguards. Granted, the back-story felt a bit outlandish at the time. That is, if one thought deeply about then current prospects of artificial intelligence and extrapolated them into the next century.

But recently the AI winter ended, and seemingly every large organization is now promoting it not merely as an option but a necessity. Ok, perhaps the idea of “Skynet” isn’t so outlandish after all. Say we subtract the combat androids and replace them with drones perhaps? No need for time-travel either, simply forward into the abyss is sufficient. :-/

1993, Demolition Man

“Now all restaurants are Taco Bell.”

Another semi-dystopian sci-fi flick commenting on corporate mergers run amok.

1997, Gattaca

Explores a dystopian world of discrimination driven by eugenics. That is, selective breeding to boost “superior” genetic qualities over those deemed inferior. Where even one’s career and opportunities are predetermined, limited, and enforced through biometric-based security.

The main character goes to incredibly painful lengths to achieve his dream of becoming an astronaut. Written by Andrew Niccol.

2005, V for Vendetta

“Remember, remember the fifth of November!”

The one with the Guy Fawkes masks exploring fascism, surveillance, and a general theme that the terms terrorist/freedom-fighter are interchangeable, depending on one’s perspective. Two sides of the same coin, in other words.

By Alan Moore, David Lloyd, and the Wachowskis.

2002, Minority Report

“Hello, Mr. Yakamoto.”

A science-fiction thriller, that explores the idea of crime-prediction technology, called “pre-crime.” (Also a Digital-Signage industry fantasy, iris-scan identification marketing.)

As mentioned, AI winter has ended for a time. So this one is also not-completely out of the question any longer. If “AI” hasn’t been let loose on a police database and told to “pre-crime the hell out of this” already it would be surprising.

Written by Philip K. Dick, screenplay by Scott Frank and Jon Cohen.

Edit: Spoke too soon, of course it has already happened in numerous instances. See the Machine Enforced Bias section under the recent history page for leads.

2006, The Lives of Others

A satisfying thriller set in East Germany during the Cold War illustrating the nightmare of living under unlimited government. In short, a true-believing officer of the revolution grows disillusioned with his greedy, power-hungry superiors and decides to assist a sympathetic couple targeted for their assumed subversion.

Great film and worth watching even if one is not interested in the related ethical issues. Though that’s quite unlikely if you’re still reading all the way down here!

Next: Doctorow Insights