Product Design, Manufacturing & Innovation Resources
Home » Connectionist Models in Cognition

Connectionist Models in Cognition

1990
  • David Rumelhart
  • James McClelland
  • Geoffrey Hinton
Research laboratory focused on connectionist models in cognitive psychology.

(generated image for illustration only)

Connectionist models, also known as parallel distributed processing (PDP) or artificial neural networks, represent cognitive processes as interactions among many simple, interconnected processing units called nodes. Knowledge is not stored in an explicit location but is distributed in the connection weights between these units. Learning occurs by adjusting these weights, often via algorithms like backpropagation, enabling pattern recognition and function approximation.

Connectionist models were proposed as a brain-inspired alternative to symbolic models. A typical network consists of layers of nodes: an input layer, one or more hidden layers, and an output layer. Each connection between nodes has a numerical weight, which can be excitatory or inhibitory. When a pattern is presented to the input layer, activation spreads through the network, modified by the weights and an activation function at each node, to produce a pattern at the output layer.

The key novelty is the learning process. In supervised learning, the network’s output is compared to a target output, and the difference (error) is used to modify the connection weights throughout the network. The backpropagation algorithm is a common method for efficiently calculating these weight adjustments. This process allows the network to gradually ‘learn’ complex mappings from inputs to outputs without being programmed with explicit rules. This approach excels at tasks involving noisy data and pattern recognition, such as object recognition or learning the past tense of English verbs, which are challenging for purely symbolic systems.

UNESCO Nomenclature: 6105
– Experimental psychology

Type

Abstract System

Disruption

Revolutionary

Usage

Widespread Use

Precursors

  • the Perceptron model by Frank Rosenblatt
  • Hebbian learning theory (‘cells that fire together, wire together’)
  • early cybernetics research by Norbert Wiener
  • the McCulloch-Pitts neuron model

Applications

Patents:

NA

Potential Innovations Ideas

  • neuromorphic computing chips that mimic brain-like processing for energy efficiency
  • ai-powered diagnostic tools that learn to identify diseases from medical scans
  • generative art and music systems that learn artistic styles
  • real-time emotional analysis from facial expressions for interactive systems
  • adaptive cybersecurity systems that detect novel threats by learning network patterns
  • personalized drug discovery platforms that predict molecular interactions
  • ai for climate modeling that learns complex environmental interactions
  • autonomous robotic systems that learn motor skills through trial and error
  • hyper-personalized content recommendation engines
  • brain-computer interfaces that learn to interpret neural signals for prosthetic control
Related to: connectionism, neural networks, parallel distributed processing, PDP, backpropagation, machine learning, cognitive modeling, artificial intelligence, nodes, weights.

Historical Context

1950
1990
1990
1941
1986
1990
2000

(if date is unknown or not relevant, e.g. "fluid mechanics", a rounded estimation of its notable emergence is provided)

10th year anniversary

Full size images and downloads are only available, 100% free, for registered members.

> Login <