Product Design, Manufacturing & Innovation Resources
Home » Connectionist Models in Cognition

Connectionist Models in Cognition

1990
  • David Rumelhart
  • James McClelland
  • Geoffrey Hinton
Research laboratory focused on connectionist models in cognitive psychology.

(generated image for illustration only)

Connectionist models, also known as parallel distributed processing (PDP) or artificial neural networks, represent cognitive processes as interactions among many simple, interconnected processing units called nodes. Knowledge is not stored in an explicit location but is distributed in the connection weights between these units. Learning occurs by adjusting these weights, often via algorithms like backpropagation, enabling pattern recognition and function approximation.

Connectionist models were proposed as a brain-inspired alternative to symbolic models. A typical network consists of layers of nodes: an input layer, one or more hidden layers, and an output layer. Each connection between nodes has a numerical weight, which can be excitatory or inhibitory. When a pattern is presented to the input layer, activation spreads through the network, modified by the weights and an activation function at each node, to produce a pattern at the output layer.

The key novelty is the learning process. In supervised learning, the network’s output is compared to a target output, and the difference (error) is used to modify the connection weights throughout the network. The backpropagation algorithm is a common method for efficiently calculating these weight adjustments. This process allows the network to gradually ‘learn’ complex mappings from inputs to outputs without being programmed with explicit rules. This approach excels at tasks involving noisy data and pattern recognition, such as object recognition or learning the past tense of English verbs, which are challenging for purely symbolic systems.

UNESCO Nomenclature: 6105
– Experimental psychology

Type

Abstract System

Disruption

Revolutionary

Usage

Widespread Use

Precursors

  • the Perceptron model by Frank Rosenblatt
  • Hebbian learning theory (‘cells that fire together, wire together’)
  • early cybernetics research by Norbert Wiener
  • the McCulloch-Pitts neuron model

Applications

  • natural language processing (e.g., translation, sentiment analysis)
  • computer vision and image recognition
  • speech recognition systems
  • deep learning architectures
  • modeling of neurological disorders

Patents:

NA

Potential Innovations Ideas

Due to scrapping bot traffic, currently more than 40k per day, this content is reserved to community members.
> Login < or > Register < (100% free) to access this, so as all other restricted content and tools.

Related to: connectionism, neural networks, parallel distributed processing, PDP, backpropagation, machine learning, cognitive modeling, artificial intelligence, nodes, weights.

Historical Context

1950
1990
1990
1941
1986
1990
2000

(if date is unknown or not relevant, e.g. "fluid mechanics", a rounded estimation of its notable emergence is provided)

Related Invention, Innovation & Technical Principles

Full size images and downloads are only available, 100% free, for registered members.

> Login <