Argument

Connectionism

Overview

Connectionism is an approach to the study of human mental processes and cognition that utilizes mathematical models known as connectionist networks or artificial neural networks.

Connectionism has had many "waves" since its beginnings. The first wave appeared 1943 with Warren Sturgis McCulloch and Walter Pitts both focusing on comprehending neural circuitry through a formal and mathematical approach, and Frank Rosenblatt who published the 1958 paper "The Perceptron: A Probabilistic Model For Information Storage and Organization in the Brain" in Psychological Review, while working at the Cornell Aeronautical Laboratory. The first wave ended with the 1969 book Perceptrons about limitations of the original perceptron idea, written by Marvin Minsky and Seymour Papert, which contributed to discouraging major funding agencies in the US from investing in connectionist research. With a few noteworthy deviations, most connectionist research entered a period of inactivity until the mid-1980s. The term connectionist model was reintroduced in a 1982 paper in the journal Cognitive Science by Jerome Feldman and Dana Ballard.

The second wave blossomed in the late 1980s, following a 1987 book Parallel Distributed Processing by James L. McClelland, David E. Rumelhart, et al., which introduced a couple of improvements to the simple perceptron idea, such as intermediate processors (now known as "hidden layers") alongside input and output units, and used a sigmoid activation function instead of the old "all-or-nothing" function. Their work built upon that of John Hopfield, who was a key figure investigating the mathematical characteristics of sigmoid activation functions. From the late 1980s to the mid-1990s, connectionism took on an almost revolutionary tone when Schneider, Terence Horgan and Tienson posed the question of whether connectionism represented a fundamental shift in psychology and so-called "good old-fashioned AI", or GOFAI. Some advantages of the second wave connectionist approach included its applicability to a broad array of functions, structural approximation to biological neurons, low requirements for innate structure, and capacity for graceful degradation. Its disadvantages included the difficulty in deciphering how ANNs process information or account for the compositionality of mental representations, and a resultant difficulty explaining phenomena at a higher level.

The current (third) wave has been marked by advances in deep learning, which have made possible the creation of large language models. The success of deep-learning networks in the past decade has greatly increased the popularity of this approach, but the complexity and scale of such networks has brought with them increased interpretability problems.

Overview adapted from Wikipedia (CC BY-SA 4.0; see the article history for authors).

Possible passages

Found by search and not yet checked by a person; they may only mention the idea in passing.

On the other hand, the relations which science presents are causal relations; and, when properly taught, are understood as such. While language familiarises with non-rational relations, science familiarises with rational relations. While the one exercises memory only, the other exercises both memory and understanding.
Herbert Spencer, Essays on education and kindred subjects
States what Connectionism is; the author is tied to Connectionism in the knowledge graph.
Read the chapter · Open in the reader
The best possible sort of system into which to weave an object, mentally, is a _rational_ system, or what is called a 'science.' Place the thing in its pigeon-hole in a classificatory series; explain it logically by its causes, and deduce from it its necessary effects; find out of what natural law it is an instance,--and you then know it in the…
William James, Talks To Teachers On Psychology
States what Connectionism is; the author is tied to Connectionism in the knowledge graph.
Read the chapter · Open in the reader
The pair of thoughts will form an instance of what is called '_Association by Similarity_.'[484]
William James, The Principles of Psychology, Volume 1
States what Connectionism is; the author is tied to Connectionism in the knowledge graph.
Read the chapter · Open in the reader

Connectionism

Overview

Possible passages

Philosophers who discussed Connectionism

Related ideas

Place in the tradition