From Typewriters to Decision-Makers

AAA

Aleksandra Przegalińska

Unlike the poignant story in Bladerunner, where a replicant longs to become a human, this one features a “replicant” teaching a human how to be human.

On November 25, 2008, “The New York Times” published an article by Cornelia Dean that went largely unnoticed around the world. “A Soldier, Taking Orders From Its Ethical Judgment Center” was based on an interview that Dean conducted with Dr. Ronald C. Arkin. In it, Dr. Arkin describes his work for the U.S. Army, which involves designing robot drones, mine detectors, and sensing devices. He also mentions that his greatest dream is to construct an autonomous robot that would be capable of acting on its own on the battlefield, making decisions without taking orders from humans. He claims that work on the technology has been going on for several years.

While the concept itself may sound mad, it is in fact neither new nor surprising to people who have participating in similar projects for many years. The idea of creating systems that would assist us in making strategic military decisions and help us solve problems on the battlefield, as well as send armies of robots to war, is deeply rooted in the post-World War II history of the West. The fifties and sixties were the era when the idea enjoyed its greatest popularity, at the height of the of Cold War arms race between NATO, led by the United States, and the Soviet Union and Warsaw Pact countries. It was then that cybernetics was born in the laboratories of American universities. This field of science, which takes its name from the Greek word kybernán (to steer or to control), studies methods of controlling complex systems based on the analysis and feedback of information, in the belief that more advanced parts of the globe demand effective models for strategic planning and risk management in order to protect themselves from enemy invasions. As Phil Mirowski notices in Cyborg Agonists, game theory and operations research (OR), which lay the groundwork for cybernetics, were greatly popular in the 1950s because they offered the tantalizing hope of creating a unifying theory for organizing the post-war world: synergy between dynamically developing scientific fields, a stable economy, and the rational management of mankind’s growing resources.

It seemed natural that man, faced with significant advances in technology in a world threatened by the unknown, would be forced to work with allies that he himself had created ― machines. The debate was about the nature of that relationship.

The first major project was a concept created by Alan Turing. In it, a human was to be paired with a computing machine. The human was responsible for management, while the machine, as the “more intelligent” partner, was to analyze data and present potential solutions.

Other solutions were proposed as well, ones completely different from Turing’s imposed division of roles. One of them was formulated by the neuroscientist and information theorist Donald MacKay, who was the first to introduce Darwinism into cybernetics. Aside from the standard OR instrumentarium, his descriptions of machines includes such words as “adaptation” and “purpose.” MacKay rejected the idea that humans are composed of subsystems that could be replicated outside the body, nor did he accept the notion that human action and thought (and thus the actions and thoughts of a machine) were imaginable outside man’s natural environment. He proposed that scientists focus on the purpose of actions and on analyzing behavior that would enable us survive. In the context of the Cold War, MacKay’s concept singlehandedly revolutionized the notion of the enemy ― the other. He wanted to teach the machine something that humans, for obvious reasons, could never comprehend: he wanted them to think that “the other is me.” Unfortunately, the concept was never fully realized in practice.

A decade later, the lack of quantifiable results led to a reevaluation of the concept of creating a perfect fighting machine that would replicate many human functions while remaining intellectually superior. Subsequent anthropomorphic robot projects would grind to a halt as soon as the machine was expected to learn, instead of just performing calculations or tasks. The U.S. Army responded by gradually reducing funding for universities contracted to conduct research on “the terminator.” But just as the source of government funding was drying up, the burgeoning field caught the interest of American businesses, known for their investments in effective solutions rather than ambitious ones. But the business world did not demand that the machine become a “better human.” The 1970s thus became an booming era for a particular component found in lethal autonomous robots, namely decision support systems (DSS).

Simply put, these systems rely on “if–then” logic. Most consist of three basic parts: a database, which stores the system’s knowledge, an inference engine, which serves as the brain of the system, and a user interface. The decision-making process in a DSS assumes that a good decision can only result from a proper decision process. In other words, if the mechanism functions correctly, then the decision must be correct. This transparent logic suggested that DSSs could be useful in business sectors that saw great development after the war: finance and health care, as well as administration and taxes. But the more successfully these DSSs handled simple, routine tasks, the more was expected of them. As opposed to their technological ancestor, the typewriter, these machines were expected to run the office, not just help out.

Among the decision-making systems in use today, there is a group known as “expert systems” that enjoy the significant trust of society. This group is unique in that, according to many specialists, it has come to resemble humans.

Expert systems, which are more or less similar to a DSS, differ from them in that they are capable of “sparking their imaginations,” just like humans. What this means is that they are able to function in complex systems about which they do not have complete knowledge. Instead of analyzing an enormous number of parameters, they take small steps in testing various solutions previously acquired in similar situations. In order to achieve the main goal, these systems set intermediate goals based on tests, and complete these checkpoints before running subsequent procedures. But because of their elasticity, expert system are sometimes incapable of identifying obviously incorrect scenarios ― or at least scenarios that humans would consider incorrect.

Despite these shortcomings, expert systems have been flooding the service market for the past two decades. Their quiet, barely noticeable presence can be detected in health care, online commerce, and banking. Over the past five years (more or less since Dr. Arkin began building his “mechanical soldier”) some have begun proposing expert system applications in the field of business consulting and even ethics and psychology. As early as the late 90s, some scientists predicted that expert systems capable of learning could not only lead executives in making business decisions, but even someday serve an important educational role by training future generations of employees. But as opponents of DSSs are quick to point out, employees and resources aren’t quite the same thing.

How could a machine possibly assist in making the decision to pollute a pond with toxic waste, or to fire an employee with a bad performance record?

Such proposals have provoked understandable opposition. Omar E.M. Khalil noted in his 1993 book Artificial Decision-Making and Artificial Ethics: A Management Concern that expert systems cannot make independent decisions involving ethics, or even assist humans in making such decisions, because such systems lack emotions and values, which makes them completely inadequate in assessing a situation. Daniel Dennet, a one-time friend and advocate of cyborgs, also spoke out against expert systems, arguing that they cannot manage like humans because they do not live like humans. The warnings of these opponents appear to be falling on deaf ears. It remains a fact that many people already working with such systems and making decisions with their help prefer the collective responsibility it offers to putting their own name on the line. They are convinced that “the system’s decision” is more rational than any they could make themselves.

It’s interesting that a sector as young as the IT industry has managed to develop, almost independently and in such a short time, a new, ethical professional role (along the lines of a doctor, manager, soldier, and perhaps someday even a lawyer), the competencies of which are defined by how closely they work with the system. Unlike the poignant story in Bladerunner, where a replicant longs to become a human, this one features a “replicant” teaching a human how to be human, subjecting him to the Voight-Kampff test à rebours. But perhaps the irony is unfounded. After all, self-improvement techniques are growing increasingly popular, and the role of the therapist is being replaced by that of the coach. On the other hand, a “sensitive programmer” from Stanford University has been teaching his pet robot to pick up on mechanisms of repression identified by psychoanalysts, which can be detected and visualized through MRI technology. In situations such as these, it is in fact difficult to decide who should be teaching whom.

 

Aleksandra Przegalińska, born 1982, is a Ph.D candidate at the Department of Philosophy of Culture at the University of Warsaw’s Institute of Philosophy. She also studies at the New School for Social Research in New York, where she is researching identity in virtual reality, with special focus on Second Life. Her main fields of interest include cognitive science and phenomenology, as well as AI theories that result from the combination of the two fields. She likes to talk to bots and avatars.

Originally published in #27 of biweekly.com
 

listen to the content print version

  1. fwkILzYcrlSr2011-09-15 17:06:18

    I'll try to put this to good use immedatiley.

  2. WIcWcPPJrRhZK2011-10-09 22:34:17

    And I was just wodrneing about that too!

  3. 2012-05-16 03:51:22

  4. 2012-07-25 20:02:25

  5. kBoDGFIEdbow2012-09-11 21:14:50

    you asked 2 questions Question oneWhat do you think about glabol warming?.I think Global warming is trueThis week, one of NASA's top scientists concluded that the Arctic Ocean could be nearly ice-free within five years, much faster than all previous predictions.when the north pole is gone , you may have polar bears soon in America ,looking for a home ,Calculations do not include the accumulative ,speeding up ,factor with time. the increase in water temperature will get faster all the time as well as the melting,when the ice is all gone the deeper cold Ocean currents will stop ,and the drag has gone with it ,also changing the higher warm currents,And only the moon will keep things movingThis will affect coastal climates ,world wide ,almost instantly. All aquatic flora and fauna will be affected,many dying off and others becoming invasive,Right now In Chiapas ,and Tabasco in Mexico .more then a million people became homeless overnight with water coming up to their roofs ,because of rains from super evaporation from the forests,this had never happened before. Millions of animals died.In India 3000 people died because of super storms ..A few years ago in Europe 3500 people,died during a heat wave ,many of them in France .Right now the average death toll annually is 150.000 due to Global warming. these figures are already out of date and are expected to double soon.In Northern China millions of people are running for their lives because regular dust storms so far have buried 900 villages under the sand and the whole of northern China is turning into a dessert.The Sahara is growing by 7 kilometers a year all around the edges ,like a slow burning fire shriveling up their neighbors In the Kalahari huge rivers have dried up and thousand of species are gone due to their habitats disappearing .The biggest changes are invisible at micro biotic levels species are becoming extinct ,others are multiplying ,This affects the insect populations that follow ,and changes in that ,affect all that follows in the food chains ,All life is interrelated of both flora and fauna, And since we are on the top of the food chain ,we are always the last to know.So Global warming has its toll there are incidents all over the world , -Question two5 reasons why Humans are contributing to the natural cycle and speeding it up1) POLLUTIONAIR pollution and the green house effectSoil pollution,which causes us to exploit more (un contaminated ) land Water pollution which cause us to use more (un contaminated) water2) OVER POPULATION 70 million more people each year ,drink ,destroy and eatputting pressure on natural resources ,such as water and soil,and expanding settlement which diminishes the Natural world.3) DESERTIFICATION because of Deforestation, for agriculture4)Overgrazing.5)Over pumping Carbon Aquifers and wasteful irrigation,which deplete ground water supplies ,and the trees die ,and when the irrigation stops ,everything dies

  6. 2012-09-11 21:14:53

  7. 2012-09-12 02:53:30

  8. 2012-09-13 06:36:03

  9. 2012-09-13 20:01:21

  10. 2012-09-14 01:25:47

  11. ZwlnjxijLi2012-10-14 05:48:44

    Of the panlopy of website I've pored over this has the most veracity.

  12. 2012-10-14 05:48:47

  13. 2012-10-14 16:05:29

  14. 2012-10-15 14:07:01

  15. 2012-10-16 16:03:18

  16. 2012-10-19 09:35:44

  17. 2013-02-25 03:07:15

  18. 2013-03-30 03:48:30

  19. 2013-04-27 14:16:47

  20. 2013-05-24 01:59:35

  21. 2013-06-05 21:47:50

  22. 2013-07-07 18:09:49

  23. 2013-08-07 10:39:42

  24. link building2013-09-08 08:30:47

    GPgW9Z Appreciate you sharing, great blog post.Really looking forward to read more.

  25. 2013-09-08 08:30:50

  26. top seo guys2013-10-23 19:00:17

    KKiZuy Thanks for the article post.Thanks Again. Much obliged.

  27. 2013-10-23 19:00:19

  28. top seo guys2013-10-26 11:29:20

    sr3bgR Im thankful for the post. Keep writing.

  29. 2013-10-26 11:29:22

  30. link building2013-10-27 00:10:51

    dCzAtm Very neat blog article.Thanks Again. Much obliged.

  31. 2013-10-27 00:10:54

  32. great things to know2013-11-18 20:21:32

    vgrTQj I appreciate you sharing this article. Really Great.

  33. 2013-11-18 20:21:35

  34. check this out2013-12-15 08:42:34

    hblBlt I loved your post.Thanks Again. Really Cool.

  35. 2013-12-15 08:42:36

  36. check it out2014-01-09 03:14:35

    zL4OKP Thank you ever so for you blog article.Much thanks again. Awesome.

  37. 2014-01-09 03:14:41

  38. look at this2014-01-16 22:27:46

    FGS0SF Thanks for the article.Really looking forward to read more. Great.

  39. 2014-01-16 22:27:48

  40. stunning seo guys2014-02-28 14:21:04

    9BCrX6 Thank you ever so for you blog article.Much thanks again. Keep writing.

  41. 2014-02-28 14:21:06

  42. seo for cheap2014-03-22 16:49:29

    FOzgDJ Really informative article post.Much thanks again. Fantastic.

  43. 2014-03-22 16:49:31

  44. best prices2014-04-01 12:35:55

    IfR0d4 Im grateful for the blog article.

  45. 2014-04-01 12:35:57

  46. best seo company2014-06-04 14:01:58

    CctWIA This is one awesome article post.Much thanks again.

  47. 2014-06-04 14:02:00

  48. good backlinks2014-06-19 23:14:26

    fG94Ah Appreciate you sharing, great blog.Much thanks again. Will read on...

  49. 2014-06-19 23:14:28

  50. good backlinks2014-07-04 00:22:55

    R8X5RN I am so grateful for your blog post. Want more.

  51. 2014-07-04 00:22:57

  52. crorkz matz2014-08-01 23:59:19

    jrk9db Im obliged for the blog post. Will read on...

  53. 2014-08-01 23:59:29

  54. crorkz matz2014-08-03 20:40:09

    KM6rfE Really enjoyed this blog post.Really thank you! Awesome.

  55. 2014-08-03 20:40:11

  56. crorkz matz2014-08-04 22:05:06

    LsTzic Very good blog.Really looking forward to read more. Really Great.

  57. 2014-08-04 22:05:08

  58. matzcrorkz2014-08-04 23:33:35

    edGHHw Thanks again for the blog post.Really thank you! Fantastic.

  59. 2014-08-04 23:33:38

  60. crorkz jremy2014-11-23 22:38:51

    Or30Vd It's really a nice and helpful piece of info. I am glad that you shared this helpful information with us. Please keep us informed like this. Thank you for sharing.

  61. 2014-11-23 22:38:53

  62. 2015-07-14 02:27:00

  63. 2015-07-15 18:46:54

  64. 2015-08-02 04:41:08

  65. 2015-08-02 18:59:01

  66. 2015-10-02 11:39:20

  67. 2015-10-26 08:31:29

  68. 2015-12-26 15:19:35

  69. 2016-01-09 09:11:47

  70. 2016-02-05 06:00:51

  71. 2016-04-12 17:26:02

  72. 2016-05-09 06:14:40

  73. 2016-05-13 06:23:08

  74. 2016-05-24 13:38:28

  75. 2016-05-28 16:41:34

  76. 2016-05-31 01:02:06

  77. 2016-06-09 14:33:53

  78. 2016-06-10 18:02:24

  79. 2016-06-13 13:01:59

  80. 2016-06-23 01:50:32

  81. 2016-07-05 22:26:27

  82. 2016-07-18 20:16:06

  83. 2016-07-22 00:01:27

  84. 2016-07-27 15:41:33

  85. 2016-08-13 10:30:26

  86. 2016-09-12 07:21:53

  87. 2016-10-12 02:27:33

  88. 2016-10-29 04:55:25

  89. 2016-11-10 01:59:49

  90. 2016-12-06 03:47:48

  91. 2016-12-27 05:57:29

  92. 2017-01-15 15:47:06

  93. 2017-02-03 21:18:04

  94. 2017-02-25 20:45:34

  95. 2017-07-05 20:27:04

  96. 2017-07-22 14:59:05

  97. 2017-08-06 08:16:56

  98. 2017-08-20 21:47:42

  99. 2017-09-04 06:03:02

  100. 2018-10-22 02:38:09

  101. 2018-10-27 07:54:17

  102. 2018-10-28 09:18:55

  103. 2018-12-17 21:10:49

  104. 2019-03-20 15:49:00

  105. 2019-04-12 08:23:32

  106. i love pron2019-04-22 22:45:51

    kww1xg Thanks so much for the blog post.Thanks Again. Awesome.

  107. 2019-04-22 22:45:53