At the Beginning of Learning Studies There Was the Maze

A generally forgotten means of observing the developmental stages of scientific psychology is the study of maze devices. Considered in ancient times as a symbol of the process of moving in the direction of knowledge, the labyrinth, or maze, was at the centre of psychologists’ attention from the end of the 19 th century. The current paper aims to reconstruct the history of the early years of maze learning, starting from the original interests of the experimenters in brain physiology or in mental evolution, and to examine how the experiments they designed continued to be important in the general theory of learning throughout the 20 th century: maze studies helped uncover general principles about learning that can be applied to many species, including humans. At the beginning of the 21 st century the question has become: what parts of the brain are used for spatial learning and memory, as shown by the Morris water maze, which is very popular in studies of behavioural neuroscience.


Introduction
Francesco Segala, an architect of the 16 th century, produced a human image made up of labyrinths: the labyrinth-man symbolised the ongoing pursuit of knowledge of the inner life and the outer world. The labyrinth offered various apparent ways out, all of which had to be explored in order for it to emerge that only one was real. Four centuries later, Kerényi recalled how the labyrinth as a symbol had already been used in Mesopotamia to denote the process of moving in the direction of knowledge [1].
In the sense of a space from which it is impossible to get out without "guiding reason", the labyrinth was therefore called maze, from maes, which meant grass in Welsh, or field in Celtic. This definition would later denote the hedge game so loved by the aristocracy of the 16 th and 17 th centuries, and the more modern games for children involving boxes in which one or more little balls have to be guided along tortuous routes.
From this same matrix, starting from the end of the 19 th century, various psychological maze tests for evaluating animal and human learning were devised. These methodological strategies shaped by Darwinian and Spencerian evolutionism were soon taken up by other naturalists, like George Romanes, a friend of Darwin's, Douglas Spalding, and Conwy Lloyd Morgan, whose research concentrated on psychological functions such as animals' ability to learn, to memorize, to orient in the environment, to solve problems, etc. Darwin [2] himself opened the way with a series of studies on the "habits of earthworms" and their ability to represent objects. In his 1882 catalog of animal behaviour, Animal Intelligence, Romanes used the term "comparative psychology" for the first time [3] to provide empirical evidence for Darwin's hypothesis of mental continuity; Spalding investigated instincts and made observations of what would later be called "imprinting", "behavioral maturation", and "behavioral critical periods" [4] [5] [6], and Morgan, with his "canon" of parsimony, corrected what he considered excessive anthropomorphism in Romanes' work and espoused the importance of empirical investigations when reasoning with animal cognition [7].
Coincidentally with these suggestions, consciousness and mentalism were de-emphasised in favour of an orientation towards behaviour as the primary object of psychological research and towards the study of animals not essentially different from man, except in the degree of development. However, studying animal behaviour in the laboratory required techniques that were necessarily different from those applied in the study of humans: i.e., they had to be more observational and no longer based on the use of mental tests. These techniques required the ideation of new devices, such as puzzle boxes and mazes, which became "one of psychology's cornerstone methods", as they have been called [8], thanks also to the fact that the maze was "the first piece of apparatus created by psychologists themselves, and not borrowed from other disciplines such as physiology" [9]. In spite of all that, apart from a small number of studies, it has attracted little historiographic attention [10] [11].

Puzzle Boxes vs. Mazes
The question raised by Edward L. Thorndike, who in 1898 [12] became the first researcher to obtain an American doctorate in animal psychology, concerned the identification of the senses used by animals in finding a way to escape from a puzzle box. In actual fact, the device he built for experimentation was not in the shape of a labyrinth but the "situation" was similar: a maze presents more alternative paths, some of which lead into blind alleys while one leads to a goal box where there is some food or other reward. The learning process thus appears to be one of trial and error, with the correct choices reinforced by reward, and er- concepts that were to become common in human psychology" [15].
For his experiments Thorndike devised a number of boxes, which he called pens, with doors to be opened by turning a handle, pressing a lever, or pulling a string attached to the outside bolt: that is, using a response the various animals-mostly young cats, but also dogs, fish, chickens and monkeys-could perform as well ( Figure 1) [12]. The animals responded in a number of ways, some of them ineffective: at first they clawed and scratched more or less indiscriminately but in doing so, they eventually-though unintentionally-gave the required push or pull, and so obtained their freedom or food. After some repetitions, the animal very quickly acquired the ability to do what was needed, until the trick was properly learned. The "pleasing" action was "stamped in" by success, while the indiscriminate pawing was stamped out. Thus, learning, explained with the law of effect, was due to the creation of associations between stimuli (the box) and responses (e.g., stepping on the switch), and no speculation about the mind was necessary or useful. Thorndike wrote: "The possibility is that animals may have no images or memories at all, no ideas to associate. Perhaps the entire fact of association in animal is the presence of sense-impressions with which are associated, by resultant pleasure, certain impulses, and that therefore, and therefore only, a certain situation brings forth a certain act" [12]. In Thorndike's terms, the memory that formed when a hungry animal escaped from confinement (satisfier) tended to be "stamped in", whereas unsuccessful movements (annoyers) were forgotten.
The result of the numerous experiments was the production of a graph called a time curve, shaped as an S and showing the times taken by the animals in successive trials [12]: different species varied in how fast they learned and where their performances levelled off, with each animal producing an S curve. This seemed consistent with Romanes' idea that different species learned the same way at different speeds [16].
The animal's gradual mastery of the puzzle led Thorndike  noticed a sudden improvement in the learning curve, which he ascribed to the animal's ability to employ perceptual relations in problem solution. The difficulty, he often found, was to get the animal to attend to the important object. He Hobhouse's boxes [20]. b, bolt, drawn; c, catch, raised; l, lever.   [20]. l, lever; c, chain; s, spike. Open Journal of Medical Psychology called these discontinuities "practical judgment" [20], a shift away from the interpretation of learning as forms of association, because "it is a strange coincidence that the right associations are chosen.
[…] In short, we find signs on the one hand of the application of ideas, on the other of selection. Both of these features indicate a higher stage than that of sheer association" [20]. Practical judgment enabled purposive action in the strict sense, that is, action in which an impulse dealt with the varying circumstances in the manner best suited to give it satisfaction. Therefore, it was distinguished from association because it was not dominated by mental habit but could select the most appropriate way for its purposes.
In contiguous associations originated and were integrated, the persistence of such processes, the factors entering into them, recognition and discernment, imitation, and individual differences [24]. He also tested blind rats and found that their performance was similar to sighted animals. This outcome led him to infer that neither sight nor smell were important for learning, but most probably touch and kinesthesis were the keys to a rat's ability to run through a maze.
For the experimental tests, the maze was constructed following the sugges- Small's device [26], the shape of which was designed to simulate, as far as possible, the rat's normal underground tunnelling environment [25], measured 6 ft × 8 ft and was adjusted to a rectangular pattern ( Figure 5) [27]. It was constructed Open Journal of Medical Psychology of wire mesh and placed on a sawdust-covered wooden floor. Three mazes were made. The other two mazes were identical to the first one except for the fact that they were made entirely-the bottom as well as the top and sides-of wire netting [27]. The food was placed inside the box, and two white rats were placed together at the entrance. Working independently, they explored backwards and forwards throughout the maze, pausing to dig in the sawdust or bite the wires.
The first rat reached the food in 13 minutes. They were left in the maze all night, and when tested the next day, they covered the distance from entrance to food in 3 minutes. In subsequent trials the time required was further reduced and the errors (entering a blind alley or retracing the main path) decreased to one or two per trial. In an intermediate stage of learning, they would hesitate near the entrance and then "flash" through to the goal. They would enter a previously explored blind alley slowly and then run out quickly. When not very hungry, they would "play by the way, strolling nonchalantly into the blind alleys" [27] but then making a quick dash to the goal box. Even when their run from start to finish was error-free, it was not a stereotyped motor routine. This maze offered two alternative paths, both leading to the goal but one was shorter than the other; in time the rats came to take the shorter route almost exclusively. After the maze had been well learned, the experimenter opened up a short cut, which the rats quickly adopted.
Small's observations led him to the theory that the associative process consisted of the persistence of the feeling of hunger and the location of the food inside of the box, i.e., as a memory of getting the food inside the box [24]. In other words, the rats learned the place rather than a sequence of movements. He con-Open Journal of Medical Psychology cluded that "The central fact in the process seems to be the recognition by the rats of particular parts of the maze" [27]. In addition, there was a difference between the rats, because of the quick learning of the "leading" rat. While Small's interest was in studying learning, Kline's attention was at first attracted by the "food-box-finding" capacity of rats which, being gnawers, had to be studied "under the hunger impulse, free from fear, and, as far as possible, under natural conditions" [25]. In fact, in the conviction that the natural method and the experimental one "are necessary to a more abundant ingathering of facts" [28], he adopted an epistemological approach to the research on animals' learning that ranged from careful and continuous observations of naturally occurring behaviours to laboratory experimental observations involving mazes which, however, would inhibit the animals' ability to act freely. The idea for the second approach came from his 1897 research on chicks' "sickness for home", which involved reading Association in Animals, a chapter of Morgan's Introduction to Comparative Psychology, where the author explained the use of little boxes similar to traps to study the ways in which rats searched for food in out-of-the-way places, and observing an investigation conducted in 1897 in the Department of Biology at Clark by Colin C. Stewart, whose "methods, apparatus, and techniques were both interesting and instructive and made a decided impression" upon Kline. The importance lay inter alia in the use of rats and mice for the experiments, because "they are small, cheap, easily fed and cared for" [25]. Finally, Small's first Hampton maze, which he was able to observe in the hallway in front of the entrance to the laboratory machine shop of Clark University, gave him an idea for the construction of a similar device [25].
Kline's box was 8 inches long, 7 inches wide, 6 inches deep, with sides of wire, a glass top and a wooden bottom [28]. The box was raised above the level of the floor by two supporting strips 1 1/2 inches thick ( Figure 6). Figure 6(a) shows the side view and Figure 6(b) the entrance and front view [25]. This experimental box was then put into the animals' home box, which also served as an observation box. It was 18 inches long, 14 inches wide and 14 inches deep; one side was made of wire, one end of glass and the rest of wood. The rats were placed in the home box several days before the experiments to become familiar with their surroundings [28]. After a series of 13 observations, Kline expressed his doubts about the possibility of establishing the associative chain in a very stable and clear form, since the rats "seldom begin digging at the proper place, sometimes will begin holes in several different places, and they will not dig at all until they have made several examinations of the box" [28]. Consequently, it could be said in pre-Piagetian terms, he established the "dividing lines between instinct, intelligence, and habit", because "it was instinct that prompted my chicks to perch, or my rats to scratch up the sawdust; it was intelligence gained through experience, that enabled the chicks to escape from the yard, and the rats to get food from the box; it was habit that made the chicks go in a particular roosting box, unsolicited, at the approach of night while they were wholly indifferent to another box and would escape from it if put in it" [28]. Open Journal of Medical Psychology

Kinesthesis in Maze Performance
The fact that animals could quickly learn a complex maze opened up various theoretical problems. In trying to reach conclusive solutions, psychologists varied the maze pattern, standardized the experimental procedure and quantified the scoring of the animal's performance. Among them was John B. Watson, whose research was focused on the identification of sensory cues [29]. The starting point of his reflections was the observation that researchers had not demonstrated that rats could form associations except in relation to the sense of smell [30]. In contrast to the prevailing beliefs of the time, Watson was convinced that the animals were "capable of forming and retaining associations comparable […] to associations formed by dogs, cats, and monkeys" [30], as Small had in part demonstrated. Moreover, following Morgan's suggestions, he decided to adopt a descriptive, inductive method that would allow him to look at the formation of associations, rather than taking them already formed, i.e., learning had to be considered as "a gradual selection of certain acts and movements in the given situation by reason of the satisfaction they bring" [30]. That is why he preferred to use the term "pattern of behaviour" or "habit" instead of "association". Following Thorndike and Small's method and procedure, the rats were left hungry, and food was then placed inside the problem box to ascertain whether animals that had already learned the maze could still traverse it without error, and whether previously untrained animals could learn the maze as quickly as the trained ones.
As for their psychical development, which was carefully observed by controlling both the laboratory conditions (eliminating, for example, loud noise) and the conditions of his rats before and during the trials, Watson found that 23-day-old rats were able to solve any simpler problem like the adult rats, whereas the latter could also quickly solve problems requiring more complex discernment, probably thanks to their greater exposure to a variety of problems.
Younger rats showed "superabundant physical activity and lack of muscular control" [30] with movements that served no purpose in solving the problems, whereas adult rats abandoned superfluous activity quickly.
To answer the second and third question, then, i.e., the correlation between the growth of the central nervous system and the activities of the white rat and the role of the medullated fibers in the cortex, Watson dissected the brains of 23 rats aged between 2 hours and 42 days and one rat recorded as an "adult" [30].
His conclusion was that when the rats reached their full psychical development at about 23 days of age, the medullation process was still far from complete. In any case, "1) Medullated fibers in the cortex of the rat are not a condition sine qua non of the rat's forming and retaining definite associations; 2) the complexity of the psychical life increases much more rapidly than does the medullation process in the cortex, psychical maturity being reached when approximately only one-fifth of the total number of fibers in the cortex are medullated" [30].
During the 1904 Congress of Art and Sciences in St. Louis, Watson explained his next project, which aimed to determine the "relative importance of the several sensations of any given animal in its adjustment to its environment" [31], thus adopting the opposite direction to contemporary research into the function of the sense organs, which involved performing preparatory surgery on untrained animals and then studying the immediate and local effects of the operation, with scarce "attention to the effect of the operations upon the instinctively Open Journal of Medical Psychology and habitually organized reactions of the animal as a whole" [31].
To identify the specific sensory cues used to learn a maze,   After 18 months of investigation, the two researchers concluded that well-trained rats, even though deprived of their major sensory abilities, after full recovery from each operation were able to traverse the maze very fast and "with confidence", and this with different views of the device's orientation (compass sense), different air currents, and different path length. In one experiment, for example, after training, the rats were released into a path reduced in length by half; food was placed in front of the new end. The animals ignored the food and ran nose-first into the end of the maze, making a "kerplunk" sound (hence the nickname: the "kerplunk experiment"). If the path was longer, the rats ran until they reached their usual distance, i.e., the distance at which the food was normally located. After that, they paused to sniff the area, even though they had not reached the end of the path, often ignoring food that was located further along.
Armed with these results, Watson and Carr performed the same operations on a new group of rats, and found that these rats too learned the maze as well as the rats with full sensory apparatus. Hypothesizing that the rats were making use of their whiskers, Watson eliminated their whiskers and destroyed their sense of taste. This made no difference whatsoever to the results. Watson and Carr finally inferred that the essential cues in maze learning and running were provided by a series of associated movements, or kinaesthesia, instead of stimuli from the outside world. Other internal senses, such as the organic, might play some part; but the external senses were not essential in guiding the rats, as Watson had already shown [31].
This conclusion was not entirely accepted. In a review, Margaret Floy Washburn [33] [34] took issue both with the over-emphasis on the role of kinesthetic sensations and muscular movements in maze performances and with the comparison between the behaviours of rats and human beings, which Carr and Open Journal of Medical Psychology Watson made in the last part of their work [32]. Although admitting the impossibility that animal consciousness could be measured directly, she stated her intention to explore animal mental phenomena, such as learning and attention, which were-according to her-similar to those of humans. The criticism levelled by Washburn, the first woman to receive a PhD in psychology, in 1894, was partly due to her different approach to the study of animal learning. In the same year as her review of Carr and Watson's work [32], she published The Animal Mind: A Text-Book of Comparative Psychology [33] [34], which was reprinted in 1917, 1926, and 1936. The main thesis was that, by taking care to avoid the temptation of anthropomorphism, which could interfere as a source of error, the workings of animals' minds could be inferred from their behaviour, which was an analogon of human conscious experience. As she stated, "Our acquaintance with the mind of animals rests upon the same basis as our acquaintance with the mind of our fellow man; both are derived by inference from observed behavior.
[…] We know not where consciousness begins in the animal world. We know where it surely exists-in ourselves; we know where it exists beyond a reasonable doubt-in those animals of structure resembling ours which readily adapt themselves to the lessons of experience. Beyond this point, for all we know, it may exist in simpler and simpler forms until we reach the very lowest of living beings" [33] [34]. Consequently, her investigations were not limited to rats or cats and dogs and to their muscular movements, but they concerned the ability to use various sensory modalities of "not fewer than 100 species, including ants, bees, caterpillars, cats, chicken, chubs, clams, cockroaches, cows, crabs, crayfish", etc., as well as the amoeba [35].
The devices Washburn used took different forms, ranging from simple mazes to complex ones as well as T-mazes, etc., and they provide a clear illustration of Open Journal of Medical Psychology the rapid proliferation of maze designs. In 1927, proposing a standardized maze, Warner and Warden noted the use of more than 100 different maze patterns [36]. It was an era in which mazes of all kinds-open or elevated [37], walled and unwalled [38] [39], U, T, Y and linear-were constructed for animals, blindfolded human adults and human children [40]. For example, in 1914 Perrin made an approximately circular maze for blindfolded subjects in an amusement park ( Figure 8); he also used a small model of the Hampton Court maze, the paths through which were traced by the subject with a pencil or a stylus ( Figure   9) [41], thus paving the way for procedures such as the high-relief finger mazes, the Porteus Maze Test [42] [43], etc., which drew psychologists' attention to motivation or previous memory. The history of the maze, however, was still not over: in 1984, in a period dominated by interest in neurosciences, Richard G.
Morris created a water maze to measure spatial ability [44]. In short the maze has always been "present" in the history of psychology right from the birth of the discipline.

Conflicts of Interest
The author declares no conflicts of interest regarding the publication of this paper.