Search This Blog

Monday, July 29, 2019

B. F. Skinner

From Wikipedia, the free encyclopedia
 
B. F. Skinner
B.F. Skinner at Harvard circa 1950.jpg
Skinner at the Harvard Psychology Department, c. 1950
Born
Burrhus Frederic Skinner

March 20, 1904
DiedAugust 18, 1990 (aged 86)
NationalityAmerican
Alma materHamilton College
Harvard University
Known forOperant conditioning
Radical behaviorism
Behavior analysis
Verbal behavior
Spouse(s)Yvonne (Eve) Blue (1936–1990)
AwardsNational Medal of Science (1968)
Scientific career
FieldsPsychology, linguistics, philosophy
InstitutionsUniversity of Minnesota
Indiana University
Harvard University
InfluencesCharles Darwin
Ivan Pavlov
Ernst Mach
Jacques Loeb
Edward Thorndike
William James
Jean-Jacques Rousseau
Henry David Thoreau
InfluencedMaxie Clarence Maultsby Jr.
Signature
BF Skinner signature.svg

Burrhus Frederic Skinner (March 20, 1904 – August 18, 1990), commonly known as B. F. Skinner, was an American psychologist, behaviorist, author, inventor, and social philosopher. He was the Edgar Pierce Professor of Psychology at Harvard University from 1958 until his retirement in 1974.

Skinner considered free will an illusion and human action dependent on consequences of previous actions. If the consequences are bad, there is a high chance the action will not be repeated; if the consequences are good, the probability of the action being repeated becomes stronger. Skinner called this the principle of reinforcement.

To strengthen behavior, Skinner used operant conditioning, and he considered the rate of response to be the most effective measure of response strength. To study operant conditioning, he invented the operant conditioning chamber, also known as the Skinner Box, and to measure rate he invented the cumulative recorder. Using these tools, he and C. B. Ferster produced his most influential experimental work, which appeared in their book Schedules of Reinforcement (1957).

Skinner developed behavior analysis, the philosophy of that science he called radical behaviorism, and founded a school of experimental research psychology—the experimental analysis of behavior. He imagined the application of his ideas to the design of a human community in his utopian novel, Walden Two, and his analysis of human behavior culminated in his work, Verbal Behavior. Skinner was a prolific author who published 21 books and 180 articles. Contemporary academia considers Skinner a pioneer of modern behaviorism, along with John B. Watson and Ivan Pavlov. A June 2002 survey listed Skinner as the most influential psychologist of the 20th century.

Biography

The gravestone of B.F. Skinner and his wife Eve at Mount Auburn Cemetery
 
Skinner was born in Susquehanna, Pennsylvania, to Grace and William Skinner. His father was a lawyer. He became an atheist after a Christian teacher tried to assuage his fear of the hell that his grandmother described. His brother Edward, two and a half years younger, died at age sixteen of a cerebral hemorrhage

Skinner's closest friend as a young boy was Raphael Miller, whom he called Doc because his father was a doctor. Doc and Skinner became friends due to their parents’ religiousness and both had an interest in contraptions and gadgets. They had set up a telegraph line between their houses to send messages to each other, although they had to call each other on the telephone due to the confusing messages sent back and forth. During one summer, Doc and Skinner started an elderberry business to gather berries and sell them door to door. They had found out that when they picked the ripe berries, the unripe ones came off the branches too, so they built a device that was able to separate them. The device was a bent piece of metal to form a trough. They would pour water down the trough into a bucket, and the ripe berries would sink into the bucket and the unripe ones would be pushed over the edge to be thrown away.

He attended Hamilton College in New York with the intention of becoming a writer. He found himself at a social disadvantage at Hamilton College because of his intellectual attitude. While attending, he joined Lambda Chi Alpha fraternity. Hamilton was known for being a strong fraternity college. Skinner had thought that his fraternity brothers were respectful and did not haze or mistreat the newcomers, instead, they helped out the other boys with courses or other activities. Freshmen were called “‘slimers’” who had to wear small green knit hats and greet everyone that they passed for punishment. The year before Skinner entered Hamilton, there was a hazing accident that caused the death of a student. The freshman was asleep in his bed when he was pushed onto the floor, where he smashed his head, resulting in his death. Skinner had a similar incident where two freshmen captured him and tied him to a pole, where he should have stayed all night, but he had a razor blade in his shoe for emergency and managed to cut himself free. He wrote for the school paper, but, as an atheist, he was critical of the traditional mores of his college. After receiving his Bachelor of Arts in English literature in 1926, he attended Harvard University, where he would later research, teach, and eventually become a prestigious board member. While he was at Harvard, a fellow student, Fred Keller, convinced Skinner that he could make an experimental science from the study of behavior. This led Skinner to invent his prototype for the Skinner Box and to join Keller in the creation of other tools for small experiments. After graduation, he unsuccessfully tried to write a great novel while he lived with his parents, a period that he later called the Dark Years. He became disillusioned with his literary skills despite encouragement from the renowned poet Robert Frost, concluding that he had little world experience and no strong personal perspective from which to write. His encounter with John B. Watson's Behaviorism led him into graduate study in psychology and to the development of his own version of behaviorism.

Skinner received a PhD from Harvard in 1931, and remained there as a researcher until 1936. He then taught at the University of Minnesota at Minneapolis and later at Indiana University, where he was chair of the psychology department from 1946–1947, before returning to Harvard as a tenured professor in 1948. He remained at Harvard for the rest of his life. In 1973, Skinner was one of the signers of the Humanist Manifesto II.

In 1936, Skinner married Yvonne (Eve) Blue. The couple had two daughters, Julie (m. Vargas) and Deborah (m. Buzan). Yvonne Skinner died in 1997, and is buried in Mount Auburn Cemetery, Cambridge, Massachusetts.

Skinner's public exposure had increased in the 1970s, he remained active even after his retirement in 1974, until his death. In 1989, Skinner was diagnosed with leukemia and died on August 18, 1990, in Cambridge, Massachusetts. Ten days before his death, he was given the lifetime achievement award by the American Psychological Association and gave a talk in an auditorium concerning his work.

A controversial figure, Skinner has been depicted in many different ways. He has been widely revered for bringing a much-needed scientific approach to the study of human behavior; he has also been vilified for attempting to apply findings based largely on animal experiments to human behavior in real-life settings.

Contributions to psychological theory

Behaviorism

Skinner called his approach to the study of behavior radical behaviorism. This philosophy of behavioral science assumes that behavior is a consequence of environmental histories of reinforcement. In his words:
The position can be stated as follows: what is felt or introspectively observed is not some nonphysical world of consciousness, mind, or mental life but the observer's own body. This does not mean, as I shall show later, that introspection is a kind of psychological research, nor does it mean (and this is the heart of the argument) that what are felt or introspectively observed are the causes of the behavior. An organism behaves as it does because of its current structure, but most of this is out of reach of introspection. At the moment we must content ourselves, as the methodological behaviorist insists, with a person's genetic and environment histories. What are introspectively observed are certain collateral products of those histories.
...

In this way we repair the major damage wrought by mentalism. When what a person does [is] attributed to what is going on inside him, investigation is brought to an end. Why explain the explanation? For twenty five hundred years people have been preoccupied with feelings and mental life, but only recently has any interest been shown in a more precise analysis of the role of the environment. Ignorance of that role led in the first place to mental fictions, and it has been perpetuated by the explanatory practices to which they gave rise.

Theoretical structure

Skinner's behavioral theory was largely set forth in his first book, Behavior of Organisms. Here he gave a systematic description of the manner in which environmental variables control behavior. He distinguished two sorts of behavior—respondent and operant—which are controlled in different ways. Respondent behaviors are elicited by stimuli, and may be modified through respondent conditioning, which is often called "Pavlovian conditioning" or "classical conditioning", in which a neutral stimulus is paired with an eliciting stimulus. Operant behaviors, in contrast, are "emitted", meaning that initially they are not induced by any particular stimulus. They are strengthened through operant conditioning, sometimes called "instrumental conditioning", in which the occurrence of a response yields a reinforcer. Respondent behaviors might be measured by their latency or strength, operant behaviors by their rate. Both of these sorts of behavior had already been studied experimentally, for example, respondents by Pavlov, and operants by Thorndike. Skinner's account differed in some ways from earlier ones, and was one of the first accounts to bring them under one roof. 

The idea that behavior is strengthened or weakened by its consequences raises several questions. Among the most important are these: (1) Operant responses are strengthened by reinforcement, but where do they come from in the first place? (2) Once it is in the organism's repertoire, how is a response directed or controlled? (3) How can very complex and seemingly novel behaviors be explained?

Origin of operant behavior

Skinner's answer to the first question was very much like Darwin's answer to the question of the origin of a "new" bodily structure, namely, variation and selection. Similarly, the behavior of an individual varies from moment to moment; a variation that is followed by reinforcement is strengthened and becomes prominent in that individual's behavioral repertoire. "Shaping" was Skinner's term for the gradual modification of behavior by the reinforcement of desired variations. As discussed later in this article, Skinner believed that "superstitious" behavior can arise when a response happens to be followed by reinforcement to which it is actually unrelated.

Control of operant behavior

The second question, "how is operant behavior controlled?" arises because, to begin with, the behavior is "emitted" without reference to any particular stimulus. Skinner answered this question by saying that a stimulus comes to control an operant if it is present when the response is reinforced and absent when it is not. For example, if lever-pressing only brings food when a light is on, a rat, or a child, will learn to press the lever only when the light is on. Skinner summarized this relationship by saying that a discriminative stimulus (e.g. light) sets the occasion for the reinforcement (food) of the operant (lever-press). This three-term contingency (stimulus-response-reinforcer) is one of Skinner's most important concepts, and sets his theory apart from theories that use only pair-wise associations.

Explaining complex behavior

Most behavior of humans cannot easily be described in terms of individual responses reinforced one by one, and Skinner devoted a great deal of effort to the problem of behavioral complexity. Some complex behavior can be seen as a sequence of relatively simple responses, and here Skinner invoked the idea of "chaining". Chaining is based on the fact, experimentally demonstrated, that a discriminative stimulus not only sets the occasion for subsequent behavior, but it can also reinforce a behavior that precedes it. That is, a discriminative stimulus is also a "conditioned reinforcer". For example, the light that sets the occasion for lever pressing may also be used to reinforce "turning around" in the presence of a noise. This results in the sequence "noise - turn-around - light - press lever - food". Much longer chains can be built by adding more stimuli and responses.

However, Skinner recognized that a great deal of behavior, especially human behavior, cannot be accounted for by gradual shaping or the construction of response sequences. Complex behavior often appears suddenly in its final form, as when a person first finds his way to the elevator by following instructions given at the front desk. To account for such behavior, Skinner introduced the concept of rule-governed behavior. First, relatively simple behaviors come under the control of verbal stimuli: the child learns to "jump", "open the book", and so on. After a large number of responses come under such verbal control, a sequence of verbal stimuli can evoke an almost unlimited variety of complex responses.

Reinforcement

Reinforcement, a key concept of behaviorism, is the primary process that shapes and controls behavior, and occurs in two ways, "positive" and "negative". In The Behavior of Organisms (1938), Skinner defined "negative reinforcement" to be synonymous with punishment, that is, the presentation of an aversive stimulus. Subsequently, in Science and Human Behavior (1953), Skinner redefined negative reinforcement. In what has now become the standard set of definitions, positive reinforcement is the strengthening of behavior by the occurrence of some event (e.g., praise after some behavior is performed), whereas negative reinforcement is the strengthening of behavior by the removal or avoidance of some aversive event (e.g., opening and raising an umbrella over your head on a rainy day is reinforced by the cessation of rain falling on you).

Both types of reinforcement strengthen behavior, or increase the probability of a behavior reoccurring; the difference is in whether the reinforcing event is something applied (positive reinforcement) or something removed or avoided (negative reinforcement). Punishment is the application of an aversive stimulus/event (positive punishment or punishment by contingent stimulation) or the removal of a desirable stimulus (negative punishment or punishment by contingent withdrawal). Though punishment is often used to suppress behavior, Skinner argued that this suppression is temporary and has a number of other, often unwanted, consequences. Extinction is the absence of a rewarding stimulus, which weakens behavior. 

Writing in 1981, Skinner pointed out that Darwinian natural selection is, like reinforced behavior, "selection by consequences". Though, as he said, natural selection has now "made its case", he regretted that essentially the same process, "reinforcement", was less widely accepted as underlying human behavior.

Schedules of reinforcement

Skinner recognized that behavior is typically reinforced more than once, and, together with C. B. Ferster, he did an extensive analysis of the various ways in which reinforcements could be arranged over time, which he called "schedules of reinforcement".

The most notable schedules of reinforcement studied by Skinner were continuous, interval (fixed or variable), and ratio (fixed or variable). All are methods used in operant conditioning.
  • Continuous reinforcement (CRF) — each time a specific action is performed the subject receives a reinforcement. This method is effective when teaching a new behavior because it quickly establishes an association between the target behavior and the reinforcer.
  • Interval Schedules — based on the time intervals between reinforcements
    • Fixed Interval Schedule (FI): A procedure in which reinforcements are presented at fixed time periods, provided that the appropriate response is made. This schedule yields a response rate that is low just after reinforcement and becomes rapid just before the next reinforcement is scheduled.
    • Variable Interval Schedule (VI): A procedure in which behavior is reinforced after random time durations following the last reinforcement. This schedule yields steady responding at a rate that varies with the average frequency of reinforcement.
  • Ratio Schedules — based on the ratio of responses to reinforcements
    • Fixed Ratio Schedule (FR): A procedure in which reinforcement is delivered after a specific number of responses have been made.
    • Variable Ratio Schedule (VR): A procedure in which reinforcement comes after a number of responses that is randomized from one reinforcement to the next (ex. slot machines). The lower the number of responses required, the higher the response rate tends to be. Ratio schedules tend to produce very rapid responding, often with breaks of no responding just after reinforcement if a large number of responses is required for reinforcement.

Scientific inventions

Operant conditioning chamber

An operant conditioning chamber (also known as a Skinner Box) is a laboratory apparatus used in the experimental analysis of animal behavior. It was invented by Skinner while he was a graduate student at Harvard University. As used by Skinner, the box had a lever (for rats), or a disk in one wall (for pigeons). A press on this "manipulandum" could deliver food to the animal through an opening in the wall, and responses reinforced in this way increased in frequency. By controlling this reinforcement together with discriminative stimuli such as lights and tones, or punishments such as electric shocks, experimenters have used the operant box to study a wide variety of topics, including schedules of reinforcement, discriminative control, delayed response ("memory"), punishment, and so on. By channeling research in these directions, the operant conditioning chamber has had a huge influence on course of research in animal learning and its applications. It enabled great progress on problems that could be studied by measuring the rate, probability, or force of a simple, repeatable response. However, it discouraged the study of behavioral processes not easily conceptualized in such terms—spatial learning, in particular, which is now studied in quite different ways, for example, by the use of the water maze.

Cumulative recorder

The cumulative recorder makes a pen-and-ink record of simple repeated responses. Skinner designed it for use with the Operant chamber as a convenient way to record and view the rate of responses such as a lever press or a key peck. In this device, a sheet of paper gradually unrolls over a cylinder. Each response steps a small pen across the paper, starting at one edge; when the pen reaches the other edge, it quickly resets to the initial side. The slope of the resulting ink line graphically displays the rate of the response; for example, rapid responses yield a steeply sloping line on the paper, slow responding yields a line of low slope. The cumulative recorder was a key tool used by Skinner in his analysis of behavior, and it was very widely adopted by other experimenters, gradually falling out of use with the advent of the laboratory computer. Skinner's major experimental exploration of response rates, presented in his book with C. B. Ferster, Schedules of Reinforcement, is full of cumulative records produced by this device.

Air crib

The air crib is an easily cleaned, temperature- and humidity-controlled enclosure intended to replace the standard infant crib. Skinner invented the device to help his wife cope with the day-to-day tasks of child rearing. It was designed to make early childcare simpler (by reducing laundry, diaper rash, cradle cap, etc.), while allowing the baby to be more mobile and comfortable, and less prone to cry. Reportedly it had some success in these goals.

The air crib was a controversial invention. It was popularly mischaracterized as a cruel pen, and it was often compared to Skinner's operant conditioning chamber, commonly called the "Skinner Box". This association with laboratory animal experimentation discouraged its commercial success, though several companies attempted production.

A 2004 book by Lauren Slater, entitled Opening Skinner's Box: Great Psychology Experiments of the Twentieth Century caused a stir by mentioning the rumors that Skinner had used his baby daughter, Deborah, in some of his experiments, and that she had subsequently committed suicide. Although Slater's book stated that the rumors were false, a reviewer in The Observer in March 2004 misquoted Slater's book as supporting the rumors. This review was read by Deborah Skinner (now Deborah Buzan, an artist and writer living in London) who wrote a vehement riposte in The Guardian.

Teaching machine

The teaching machine, a mechanical invention to automate the task of programmed learning
 
The teaching machine was a mechanical device whose purpose was to administer a curriculum of programmed learning. The machine embodies key elements of Skinner's theory of learning and had important implications for education in general and classroom instruction in particular.

In one incarnation, the machine was a box that housed a list of questions that could be viewed one at a time through a small window. (See picture). There was also a mechanism through which the learner could respond to each question. Upon delivering a correct answer, the learner would be rewarded.

Skinner advocated the use of teaching machines for a broad range of students (e.g., preschool aged to adult) and instructional purposes (e.g., reading and music). For example, one machine that he envisioned could teach rhythm. He wrote:
A relatively simple device supplies the necessary contingencies. The student taps a rhythmic pattern in unison with the device. "Unison" is specified very loosely at first (the student can be a little early or late at each tap) but the specifications are slowly sharpened. The process is repeated for various speeds and patterns. In another arrangement, the student echoes rhythmic patterns sounded by the machine, though not in unison, and again the specifications for an accurate reproduction are progressively sharpened. Rhythmic patterns can also be brought under the control of a printed score.
The instructional potential of the teaching machine stemmed from several factors: it provided automatic, immediate and regular reinforcement without the use of aversive control; the material presented was coherent, yet varied and novel; the pace of learning could be adjusted to suit the individual. As a result, students were interested, attentive, and learned efficiently by producing the desired behavior, "learning by doing".

Teaching machines, though perhaps rudimentary, were not rigid instruments of instruction. They could be adjusted and improved based upon the students' performance. For example, if a student made many incorrect responses, the machine could be reprogrammed to provide less advanced prompts or questions—the idea being that students acquire behaviors most efficiently if they make few errors. Multiple-choice formats were not well-suited for teaching machines because they tended to increase student mistakes, and the contingencies of reinforcement were relatively uncontrolled.

Not only useful in teaching explicit skills, machines could also promote the development of a repertoire of behaviors that Skinner called self-management. Effective self-management means attending to stimuli appropriate to a task, avoiding distractions, reducing the opportunity of reward for competing behaviors, and so on. For example, machines encourage students to pay attention before receiving a reward. Skinner contrasted this with the common classroom practice of initially capturing students’ attention (e.g., with a lively video) and delivering a reward (e.g., entertainment) before the students have actually performed any relevant behavior. This practice fails to reinforce correct behavior and actually counters the development of self-management. 

Skinner pioneered the use of teaching machines in the classroom, especially at the primary level. Today computers run software that performs similar teaching tasks, and there has been a resurgence of interest in the topic related to the development of adaptive learning systems.

Pigeon-guided missile

During World War II, the US Navy required a weapon effective against surface ships, such as the German Bismarck class battleships. Although missile and TV technology existed, the size of the primitive guidance systems available rendered automatic guidance impractical. To solve this problem, Skinner initiated Project Pigeon, which was intended to provide a simple and effective guidance system. This system divided the nose cone of a missile into three compartments, with a pigeon placed in each. Lenses projected an image of distant objects onto a screen in front of each bird. Thus, when the missile was launched from an aircraft within sight of an enemy ship, an image of the ship would appear on the screen. The screen was hinged, such that pecks at the image of the ship would guide the missile toward the ship.

Despite an effective demonstration, the project was abandoned, and eventually more conventional solutions, such as those based on radar, became available. Skinner complained that "our problem was no one would take us seriously." It seemed that few people would trust pigeons to guide a missile, no matter how reliable the system appeared to be.

Verbal summator

Early in his career Skinner became interested in "latent speech" and experimented with a device he called the "verbal summator". This device can be thought of as an auditory version of the Rorschach inkblots. When using the device, human participants listened to incomprehensible auditory "garbage" but often read meaning into what they heard. Thus, as with the Rorschach blots, the device was intended to yield overt behavior that projected subconscious thoughts. Skinner's interest in projective testing was brief, but he later used observations with the summator in creating his theory of verbal behavior. The device also led other researchers to invent new tests such as the tautophone test, the auditory apperception test, and the Azzageddi test.

Verbal Behavior

Challenged by Alfred North Whitehead during a casual discussion while at Harvard to provide an account of a randomly provided piece of verbal behavior, Skinner set about attempting to extend his then-new functional, inductive approach to the complexity of human verbal behavior. Developed over two decades, his work appeared in the book Verbal Behavior. Although Noam Chomsky was highly critical of Verbal Behavior, he conceded that Skinner's "S-R psychology" was worth a review. (Behavior analysts reject the "S-R" characterization: operant conditioning involves the emission of a response which then becomes more or less likely depending upon its consequence–see above.).

Verbal Behavior had an uncharacteristically cool reception, partly as a result of Chomsky's review, partly because of Skinner's failure to address or rebut any of Chomsky's criticisms. Skinner's peers may have been slow to adopt the ideas presented in Verbal Behavior because of the absence of experimental evidence—unlike the empirical density that marked Skinner's experimental work. However, in applied settings there has been a resurgence of interest in Skinner's functional analysis of verbal behavior.

Influence on education

Skinner's views influenced education as well as psychology. Skinner argued that education has two major purposes: (1) to teach repertoires of both verbal and nonverbal behavior; and (2) to interest students in learning. He recommended bringing students’ behavior under appropriate control by providing reinforcement only in the presence of stimuli relevant to the learning task. Because he believed that human behavior can be affected by small consequences, something as simple as "the opportunity to move forward after completing one stage of an activity" can be an effective reinforcer . Skinner was convinced that, to learn, a student must engage in behavior, and not just passively receive information. (Skinner, 1961, p. 389). 

Skinner believed that effective teaching must be based on positive reinforcement which is, he argued, more effective at changing and establishing behavior than punishment. He suggested that the main thing people learn from being punished is how to avoid punishment. For example, if a child is forced to practice playing an instrument, the child comes to associate practicing with punishment and thus learns to hate and avoid practicing the instrument. This view had obvious implications for the then widespread practice of rote learning and punitive discipline in education. The use of educational activities as punishment may induce rebellious behavior such as vandalism or absence.

Because teachers are primarily responsible for modifying student behavior, Skinner argued that teachers must learn effective ways of teaching. In The Technology of Teaching, Skinner has a chapter on why teachers fail (pages 93–113): He says that teachers have not been given an in-depth understanding of teaching and learning. Without knowing the science underpinning teaching, teachers fall back on procedures that work poorly or not at all, such as:
  • using aversive techniques (which produce escape and avoidance and undesirable emotional effects);
  • relying on telling and explaining ("Unfortunately, a student does not learn simply when he is shown or told." p. 103);
  • failing to adapt learning tasks to the student's current level;
  • failing to provide positive reinforcement frequently enough.
Skinner suggests that any age-appropriate skill can be taught. The steps are
  1. Clearly specify the action or performance the student is to learn.
  2. Break down the task into small achievable steps, going from simple to complex.
  3. Let the student perform each step, reinforcing correct actions.
  4. Adjust so that the student is always successful until finally the goal is reached.
  5. Shift to intermittent reinforcement to maintain the student's performance.
Skinner's views on education are extensively presented in his book The Technology of Teaching. They are also reflected in Fred S. Keller's Personalized System of Instruction and Ogden R. Lindsley's Precision Teaching.

Walden Two and Beyond Freedom and Dignity

Skinner is popularly known mainly for his books Walden Two and Beyond Freedom and Dignity, (for which he made the cover of TIME Magazine). The former describes a fictional "experimental community" in 1940s United States. The productivity and happiness of citizens in this community is far greater than in the outside world because the residents practice scientific social planning and use operant conditioning in raising their children. 

Walden Two, like Thoreau's Walden, champions a lifestyle that does not support war, or foster competition and social strife. It encourages a lifestyle of minimal consumption, rich social relationships, personal happiness, satisfying work, and leisure. In 1967, Kat Kinkade and others founded the Twin Oaks Community, using Walden Two as a blueprint. The community still exists and continues to use the Planner-Manager system and other aspects of the community described in Skinner's book, though behavior modification is not a community practice.

In Beyond Freedom and Dignity, Skinner suggests that a technology of behavior could help to make a better society. We would, however, have to accept that an autonomous agent is not the driving force of our actions. Skinner offers alternatives to punishment, and challenges his readers to use science and modern technology to construct a better society.

Political views

Skinner's political writings emphasized his hopes that an effective and human science of behavioral control – a technology of human behavior – could help with problems as yet unsolved and often aggravated by advances in technology such as the atomic bomb. Indeed, one of Skinner's goals was to prevent humanity from destroying itself. He saw political activity as the use of aversive or non-aversive means to control a population. Skinner favored the use of positive reinforcement as a means of control, citing Jean-Jacques Rousseau's novel Emile: or, On Education as an example of literature that "did not fear the power of positive reinforcement".

Skinner's book, Walden Two, presents a vision of a decentralized, localized society, which applies a practical, scientific approach and behavioral expertise to deal peacefully with social problems. (For example, his views led him to oppose corporal punishment in schools, and he wrote a letter to the California Senate that helped lead it to a ban on spanking.) Skinner's utopia is both a thought experiment and a rhetorical piece. In Walden Two, Skinner answers the problem that exists in many utopian novels – "What is the Good Life?" The book's answer is a life of friendship, health, art, a healthy balance between work and leisure, a minimum of unpleasantness, and a feeling that one has made worthwhile contributions to a society in which resources are ensured, in part, by minimizing consumption.
If the world is to save any part of its resources for the future, it must reduce not only consumption but the number of consumers.
— B. F. Skinner, Walden Two, p. xi.
Skinner described his novel as "my New Atlantis", in reference to Bacon's utopia.
When Milton's Satan falls from heaven, he ends in hell. And what does he say to reassure himself? 'Here, at least, we shall be free.' And that, I think, is the fate of the old-fashioned liberal. He's going to be free, but he's going to find himself in hell.
— B. F. Skinner, from William F. Buckley Jr, On the Firing Line, p. 87.

Superstition in the pigeon

One of Skinner's experiments examined the formation of superstition in one of his favorite experimental animals, the pigeon. Skinner placed a series of hungry pigeons in a cage attached to an automatic mechanism that delivered food to the pigeon "at regular intervals with no reference whatsoever to the bird's behavior". He discovered that the pigeons associated the delivery of the food with whatever chance actions they had been performing as it was delivered, and that they subsequently continued to perform these same actions.
One bird was conditioned to turn counter-clockwise about the cage, making two or three turns between reinforcements. Another repeatedly thrust its head into one of the upper corners of the cage. A third developed a 'tossing' response, as if placing its head beneath an invisible bar and lifting it repeatedly. Two birds developed a pendulum motion of the head and body, in which the head was extended forward and swung from right to left with a sharp movement followed by a somewhat slower return.
Skinner suggested that the pigeons behaved as if they were influencing the automatic mechanism with their "rituals", and that this experiment shed light on human behavior:
The experiment might be said to demonstrate a sort of superstition. The bird behaves as if there were a causal relation between its behavior and the presentation of food, although such a relation is lacking. There are many analogies in human behavior. Rituals for changing one's fortune at cards are good examples. A few accidental connections between a ritual and favorable consequences suffice to set up and maintain the behavior in spite of many unreinforced instances. The bowler who has released a ball down the alley but continues to behave as if she were controlling it by twisting and turning her arm and shoulder is another case in point. These behaviors have, of course, no real effect upon one's luck or upon a ball half way down an alley, just as in the present case the food would appear as often if the pigeon did nothing—or, more strictly speaking, did something else.
Modern behavioral psychologists have disputed Skinner's "superstition" explanation for the behaviors he recorded. Subsequent research (e.g. Staddon and Simmelhag, 1971), while finding similar behavior, failed to find support for Skinner's "adventitious reinforcement" explanation for it. By looking at the timing of different behaviors within the interval, Staddon and Simmelhag were able to distinguish two classes of behavior: the terminal response, which occurred in anticipation of food, and interim responses, that occurred earlier in the interfood interval and were rarely contiguous with food. Terminal responses seem to reflect classical (as opposed to operant) conditioning, rather than adventitious reinforcement, guided by a process like that observed in 1968 by Brown and Jenkins in their "autoshaping" procedures. The causation of interim activities (such as the schedule-induced polydipsia seen in a similar situation with rats) also cannot be traced to adventitious reinforcement and its details are still obscure (Staddon, 1977).

Criticism

Noam Chomsky

Noam Chomsky, a prominent critic of Skinner, published a review of Skinner's Verbal Behavior two years after it was published. Chomsky argued that Skinner's attempt to use behaviorism to explain human language amounted to little more than word games. Conditioned responses could not account for a child's ability to create or understand an infinite variety of novel sentences. Chomsky's review has been credited with launching the cognitive revolution in psychology and other disciplines. Skinner, who rarely responded directly to critics, never formally replied to Chomsky's critique. Many years later, Kenneth MacCorquodale's reply was endorsed by Skinner.

Chomsky also reviewed Skinner's Beyond Freedom and Dignity, using the same basic motives as his Verbal Behavior review. Among Chomsky's criticisms were that Skinner's laboratory work could not be extended to humans, that when it was extended to humans it represented 'scientistic' behavior attempting to emulate science but which was not scientific, that Skinner was not a scientist because he rejected the hypothetico-deductive model of theory testing, and that Skinner had no science of behavior.

Psychodynamic psychology

Skinner has been repeatedly criticized for his supposed animosity towards Sigmund Freud, psychoanalysis, and psychodynamic psychology. Some have argued, however, that Skinner shared several of Freud's assumptions, and that he was influenced by Freudian points of view in more than one field, among them the analysis of defense mechanisms, such as repression. To study such phenomena, Skinner even designed his own projective test, the "verbal summator" described above.

J. E. R. Staddon

As understood by Skinner, ascribing dignity to individuals involves giving them credit for their actions. To say "Skinner is brilliant" means that Skinner is an originating force. If Skinner's determinist theory is right, he is merely the focus of his environment. He is not an originating force and he had no choice in saying the things he said or doing the things he did. Skinner's environment and genetics both allowed and compelled him to write his book. Similarly, the environment and genetic potentials of the advocates of freedom and dignity cause them to resist the reality that their own activities are deterministically grounded. J. E. R. Staddon (The New Behaviorism, 2nd Edition, 2014) has argued the compatibilist position; Skinner's determinism is not in any way contradictory to traditional notions of reward and punishment, as he believed.

List of awards and positions

  • 1926 AB, Hamilton College
  • 1930 MA, Harvard University
  • 1930−1931 Thayer Fellowship
  • 1931 PhD, Harvard University
  • 1931−1932 Walker Fellowship
  • 1931−1933 National Research Council Fellowship
  • 1933−1936 Junior Fellowship, Harvard Society of Fellows
  • 1936-1937 Instructor, University of Minnesota
  • 1937−1939 Assistant Professor, University of Minnesota
  • 1939−1945 Associate Professor, University of Minnesota
  • 1942 Guggenheim Fellowship (postponed until 1944–1945)
  • 1942 Howard Crosby Warren Medal, Society of Experimental Psychologists
  • 1945−1948 Professor and Chair, Indiana University
  • 1947−1948 William James Lecturer, Harvard University
  • 1948−1958 Professor, Harvard University
  • 1949−1950 President of the Midwestern Psychological Association
  • 1954−1955 President of the Eastern Psychological Association
  • 1958 Distinguished Scientific Contribution Award, American Psychological Association
  • 1958−1974 Edgar Pierce Professor of Psychology, Harvard University
  • 1964−1974 Career Award, National Institute of Mental Health
  • 1966 Edward Lee Thorndike Award, American Psychological Association
  • 1966−1967 President of the Pavlovian Society of North America
  • 1968 National Medal of Science, National Science Foundation
  • 1969 Overseas Fellow in Churchill College, Cambridge
  • 1971 Gold Medal Award, American Psychological Foundation
  • 1971 Joseph P. Kennedy, Jr., Foundation for Mental Retardation International award
  • 1972 Humanist of the Year, American Humanist Association
  • 1972 Creative Leadership in Education Award, New York University
  • 1972 Career Contribution Award, Massachusetts Psychological Association
  • 1974−1990 Professor of Psychology and Social Relations Emeritus, Harvard University
  • 1978 Distinguished Contributions to Educational Research Award and Development, American Educational Research Association
  • 1978 National Association for Retarded Citizens Award
  • 1985 Award for Excellence in Psychiatry, Albert Einstein School of Medicine
  • 1985 President's Award, New York Academy of Science
  • 1990 William James Fellow Award, American Psychological Society
  • 1990 Lifetime Achievement Award, American Psychology Association
  • 1991 Outstanding Member and Distinguished Professional Achievement Award, Society for Performance Improvement
  • 1997 Scholar Hall of Fame Award, Academy of Resource and Development
  • 2011 Committee for Skeptical Inquiry Pantheon of Skeptics—Inducted

Honorary degrees

Skinner received honorary degrees from:

In popular culture

Writer of The Simpsons Jon Vitti named the Principal Skinner character after behavioral psychologist B. F. Skinner.

Bibliography

Relational frame theory

From Wikipedia, the free encyclopedia
Relational frame theory (RFT) is a psychological theory of human language. It was developed originally by Steven C. Hayes of University of Nevada, Reno and has been extended in research notably by Dermot Barnes-Holmes of Ghent University beginning in 2015.

Relational frame theory argues that the building block of human language and higher cognition is relating, i.e. the human ability to create bidirectional links between things. It can be contrasted with associative learning, which discusses how animals form links between stimuli in the form of the strength of associations in memory. However, relational frame theory argues that natural human language typically specifies not just the strength of a link between stimuli but also the type of relation as well as the dimension along which they are to be related. For example, a tennis ball is not just associated with an orange, but can be said to be the same shape, but a different colour and not edible. In the preceding sentence, 'same', 'different' and 'not' are cues in the environment that specify the type of relation between the stimuli, and 'shape', 'colour' and 'edible' specify the dimension along which each relation is to be made. Relational frame theory argues that while there are an arbitrary number of types of relations and number of dimensions along which stimuli can be related, the core unit of relating is an essential building block for much of what is commonly referred to as human language or higher cognition.

Several hundred studies have explored many testable aspects and implications of the theory such as the emergence of specific frames in childhood, how individual frames can be combined to create verbally complex phenomena such as metaphors and analogies, and how the rigidity or automaticity of relating within certain domains is related to psychopathology. In attempting to describe a fundamental building block of human language and higher cognition, RFT explicitly states that its goal is to provide a general theory of psychology that can provide a bedrock for multiple domains and levels of analysis.

Relational frame theory focuses on how humans learn language (i.e., communication) through interactions with the environment and is based on a philosophical approach referred to as functional contextualism.

Overview

Introduction

Relational frame theory (RFT) is a behavioral theory of human language. It is rooted in functional contextualism and focused on predicting and influencing verbal behavior with precision, scope and depth.

Relational framing is relational responding based on arbitrarily applicable relations and arbitrary stimulus functions. The relational responding is subject to mutual entailment, combinatorial mutual entailment and transformation of stimulus functions. The relations and stimulus functions are controlled by contextual cues.

Contextual cues and stimulus functions

In human language a word, sentence or a symbol (e.g. stimulus) can have a different meaning (e.g. functions), depending on context. 

In terms of RFT, it is said that in human language a stimulus can have different stimulus functions depending on contextual cues.

Take these two sentences for example:
  1. This task is piece of cake.
  2. Yes, I would like a piece of that delicious cake you've made.
In the sentences above the stimulus "cake" has two different functions. The stimulus "cake" has a figurative function in the presence of the contextual cues "this task; is; piece of". Whereas in the presence of the contextual cues "I; would like; delicious; you've made" the stimulus "cake" has a more literal function. The functions of stimuli are called stimulus functions, Cfunc for short.

When stimulus function refer to physical properties of the stimulus, such as quantity, colour, shape, etc., they are called nonarbitrary stimulus functions. When a stimulus function refers to non-physical properties of the stimulus, such as value, they are called arbitrary stimulus functions. For example, a one dollar bill. The value of the one dollar bill is an arbitrary stimulus function, but the colour green is a nonarbitrary stimulus function of the one dollar bill.

Arbitrarily applicable relational responding

Arbitrarily applicable relational responding (AARRing) is a form of relational responding.

Relational responding

Relational responding is a response to one stimulus in relation to other available stimuli. For example, a lion who picks the largest piece of meat. The deer who picks the strongest male of the pack. In contrast if an animal would always pick the same drinking spot, it's not relational responding (it's not related to other stimuli in the sense of best/worst/larger/smaller, etc.). These examples of relational responding are based on the physical properties of the stimuli. When relational responding is based on the physical properties of the stimuli,such as shape, size, quantity, etc., it's called nonarbitrarily relational responding (NARR).

Arbitrarily applicable relational responding

Arbitrarily applicable relational responding refers to responding based on relations that are arbitrarily applied between the stimuli. That is to say the relations applied between the stimuli are not supported by the physical properties of said stimuli, but for example based on social convention or social whim. For example, the sound "cow" refers to the animal in the English language. But in another language the same animal is referred by a totally different sound. For example, in Dutch is called "koe" (pronounced as coo). The word "cow" or "koe" has nothing to do with the physical properties of the animal itself. It's by social convention that the animal is named this way. In terms of RFT it's said that the relation between the word cow and the actual animal is arbitrarily applied. We can even change these arbitrarily applied relations: Just look at the history of any language, where meanings of words, symbols and complete sentence can change over time and place. 

AARRing is responding based on arbitrarily applied relations.

Mutual entailment

Mutual entailment refers to deriving a relation between two stimuli based on a given relation between those same two stimuli: Given the relation A to B, the relation B to A can be derived.

For example, Joyce is standing in front of Peter. The relation trained is stimulus A in front of stimulus B. One can derive that Peter is behind Joyce. The derived relation is stimulus B is behind stimulus A.
Another example: Fluodiwe (a made up name) is more valuable then Carviwing (another made up name). One could derive that Carviwing is less valuable then Fluodiwe. Relation trained: stimulus A is more valuable then stimulus B. Relation derived: stimulus B is less valuable then stimulus A.

Combinatorial mutual entailment

Combinatorial mutual entailment refers to deriving relations between two stimuli, given the relations of those two stimuli with a third stimulus: Given the relation A to B and B to C, the relations A to C and C to A can be derived.

To go on with the examples above: 

Joyce is standing in front of Peter and Peter is standing in front of Lucy. The relations trained in this example are: stimulus A in front of B and stimulus B in front of C. With this it can be derived that Joyce is standing in front of Lucy and Lucy is standing behind Joyce. The derived relations are A is in front of C and C is behind A.

Fluodiwe is more valuable then Carviwing and Carviwing is more valuable then Sioklad. Stimulus A is more valuable then stimulus B and stimulus B is more valuable then stimulus C. It can be derived that Fluodiwe is more valuable then Sioklad and Sioklad is less valuable then Fluowide. The derived relations become: stimulus A is more valuable then stimulus C en stimulus C is less valuable then stimulus A.

Notice that the relations between A and C where never given. They can be derived by the other relations.

Transfer and transformation of stimulus function

As said earlier a stimulus can have different functions depending on contextual cues. However a stimulus function can change based on the arbitrary relations with that stimulus.

For example, this relational frame: A is more than B and B is more than C. 

For now the stimulus functions of these letters are rather neutral. But as soon as C would be labeled 'as very valuable' and 'nice to have', then A would become more attractive then C, based on the relations. Before there was stated anything about C being valuable, A had a rather neutral stimulus function. After giving C a attractive stimulus function, A has become attractive. The attractive stimulus function has been transferred from C to A through the relations between A, B and C. And A has had a transformation of stimulus function from neutral to attractive.

The same can be done with aversive stimulus function as danger instead of valuable, in saying that C is dangerous, A becomes more dangerous than C based on the relations.

Development

RFT is a behavioral account of language and higher cognition. In his 1957 book Verbal Behavior, B.F. Skinner presented an interpretation of language. However, this account was intended to be an interpretation as opposed to an experimental research program, and researchers commonly acknowledge that the research products are somewhat limited in scope. For example, Skinner's behavioral interpretation of language has been useful in some aspects of language training in developmentally disabled children, but it has not led to a robust research program in the range of areas relevant to language and cognition, such as problem-solving, reasoning, metaphor, logic, and so on. RFT advocates are fairly bold in stating that their goal is an experimental behavioral research program in all such areas, and RFT research has indeed emerged in a large number of these areas, including grammar.

In a review of Skinner's book, linguist Noam Chomsky argued that the generativity of language shows that it cannot simply be learned, that there must be some innate "language acquisition device". Many have seen this review as a turning point, when cognitivism took the place of behaviorism as the mainstream in psychology. Behavior analysts generally viewed the criticism as somewhat off point, but it is undeniable that psychology turned its attention elsewhere and the review was very influential in helping to produce the rise of cognitive psychology. 

Despite the lack of attention from the mainstream, behavior analysis is alive and growing. Its application has been extended to areas such as language and cognitive training. Behavior analysis has long been extended as well to animal training, business and school settings, as well as hospitals and areas of research. 

RFT distinguishes itself from Skinner's work by identifying and defining a particular type of operant conditioning known as arbitrarily applicable derived relational responding (AADRR). In essence the theory argues that language is not associative but is learned and relational. For example, young children learn relations of coordination between names and objects; followed by relations of difference, opposition, before and after, so on. These are "frames" in the sense that once relating of that kind is learned, any event can be related in that way mutually and in combination with other relations, given a cue to do so. This is a learning process that to date appears to occur only in humans possessing a capacity for language: to date relational framing has not yet been shown unambiguously in non-human animals despite many attempts to do so. AADRR is theorized to be a pervasive influence on almost all aspects of human behavior. The theory represents an attempt to provide a more empirically progressive account of complex human behavior while preserving the naturalistic approach of behavior analysis.

Evidence

Approximately 300 studies have tested RFT ideas. Supportive data exists in the areas needed to show that an action is "operant" such as the importance of multiple examples in training derived relational responding, the role of context, and the importance of consequences. Derived relational responding has also been shown to alter other behavioral processes such as classical conditioning, an empirical result that RFT theorists point to in explaining why relational operants modify existing behavioristic interpretations of complex human behavior. Empirical advances have also been made by RFT researchers in the analysis and understanding of such topics as metaphor, perspective taking, and reasoning.

Proponents of RFT often indicate the failure to establish a vigorous experimental program in language and cognition as the key reason why behavior analysis fell out of the mainstream of psychology despite its many contributions, and argue that RFT might provide a way forward. The theory is still somewhat controversial within behavioral psychology, however. At the current time the controversy is not primarily empirical since RFT studies publish regularly in mainstream behavioral journals and few empirical studies have yet claimed to contradict RFT findings. Rather the controversy seems to revolve around whether RFT is a positive step forward, especially given that its implications seem to go beyond many existing interpretations and extensions from within this intellectual tradition.

Applications

Acceptance and commitment therapy

RFT has been argued to be central to the development of the psychotherapeutic tradition known as acceptance and commitment therapy and clinical behavior analysis more generally. Indeed, the psychologist Steven C Hayes was involved with the creation of both acceptance and commitment therapy and RFT, and has credited them as inspirations for one another. However, the extent and exact nature of the interaction between RFT as basic behavioral science and applications such as ACT has been an ongoing point of discussion within the field.

Autism spectrum disorder

RFT provides conceptual and procedural guidance for enhancing the cognitive and language development capability (through its detailed treatment and analysis of derived relational responding and the transformation of function) of early intensive behavior intervention (EIBI) programs for young children with autism and related disorders. The Promoting the Emergence of Advanced Knowledge (PEAK) Relational Training System is heavily influenced by RFT.

Evolution science

More recently, RFT has also been proposed as a way to guide discussion of language processes within evolution science, whether within evolutionary biology or evolutionary psychology, toward a more informed understanding of the role of language in shaping human social behavior. The effort at integrating RFT into evolution science has been led by, among others, Steven C. Hayes, a co-developer of RFT, and David Sloan Wilson, an evolutionary biologist at Binghamton University. For example, in 2011, Hayes presented at a seminar at Binghamton, on the topic of "Symbolic Behavior, Behavioral Psychology, and the Clinical Importance of Evolution Science", while Wilson likewise presented at a symposium at the annual conference in Parma, Italy, of the Association for Contextual Behavioral Science, the parent organization sponsoring RFT research, on the topic of "Evolution for Everyone, Including Contextual Psychology". Hayes, Wilson, and colleagues have recently linked RFT to the concept of a symbotype and an evolutionarily sensible way that relational framing could have developed has been described.

Operator (computer programming)

From Wikipedia, the free encyclopedia https://en.wikipedia.org/wiki/Operator_(computer_programmin...