Product Design, Manufacturing & Innovation Resources
Home » Bayes Factor

Bayes Factor

1939
  • Harold Jeffreys
Office workspace with statistical software showing Bayes factor calculations and hypothesis testing notes.

(generated image for illustration only)

The Bayes factor is a ratio of the marginal likelihoods of two competing hypotheses, often a null hypothesis (\(M_1\)) and an alternative hypothesis (\(M_2\)). It quantifies the support for one hypothesis over the other, given the observed data \(D\). The formula is \(K = \frac{P(D|M_1)}{P(D|M_2)}\). A value of K > 1 indicates that the data favors \(M_1\) over \(M_2\).

The Bayes factor is the Bayesian alternative to the frequentist p-value for hypothesis testing. Unlike a p-value, which only provides evidence against the null hypothesis, the Bayes factor can quantify evidence for the null, for the alternative, or indicate that the data is uninformative. The magnitude of the Bayes factor provides a continuous scale of evidence. For instance, a Bayes factor of 10 is often considered ‘strong’ evidence for one model over another, while a value between 1 and 3 is considered ‘anecdotal’ or ‘weak’ evidence.

The core component of the Bayes factor is the marginal likelihood, \(P(D|M) = \int P(D|\theta, M)P(\theta|M) d\theta\). This is the probability of the observed data averaged over the prior distribution of the parameters \(\theta\) for a given model \(M\). This integral makes the Bayes factor sensitive to the choice of prior distributions, which is a point of contention and active research. It also makes it computationally challenging to calculate, often requiring numerical methods like MCMC or approximate methods like the Bayesian Information Criterion (BIC). Despite these challenges, its ability to weigh evidence for competing hypotheses makes it a powerful tool for scientific inference and model selection.

UNESCO Nomenclature: 1208
– Statistics

Type

Abstract System

Disruption

Substantial

Usage

Widespread Use

Precursors

  • Bayesian inference
  • Likelihood principle
  • Philosophical work on the nature of scientific evidence
  • Neyman-Pearson lemma for hypothesis testing

Applications

  • Hypothesis testing in psychology, biology, and social sciences
  • Model selection in machine learning and statistics
  • A/B testing to determine if a change has a real effect
  • Forensic science to weigh evidence
  • Genomics for identifying significant gene associations

Patents:

NA

Potential Innovations Ideas

  • Automated scientific research platforms that use Bayes factors to decide which of several competing theories is best supported by new data
  • A legal evidence evaluation system that calculates Bayes factors to determine how strongly a piece of evidence supports the prosecution vs. the defense
  • A ‘model selection as a service’ cloud platform for data scientists
  • Clinical trial software that uses Bayes factors for continuous monitoring and early stopping if strong evidence for or against a treatment emerges
  • AI-driven peer review systems that use Bayes factors to assess the strength of evidence in submitted manuscripts
  • Personalized marketing engines that use Bayes factors to select the best advertising model for a specific user segment
  • Robotic explorers (e.g., Mars rovers) that use Bayes factors to autonomously decide which geological hypothesis to investigate next
  • Financial regulation software that uses Bayes factors to detect which model of market manipulation best explains anomalous trading patterns
  • Smart city planning tools that use Bayes factors to select the most effective urban intervention (e.g., new bus line vs. bike lanes)
  • Cybersecurity systems that use Bayes factors to decide if network traffic better fits a ‘benign’ or ‘attack’ model
Related to: Bayes factor, hypothesis testing, model selection, marginal likelihood, evidence, Bayesian statistics, Harold Jeffreys, p-value, statistical evidence, prior distribution.

Historical Context

Bayes Factor

1925
1930
1931
1939
1940
1950
1950
1925
1928
1930
1936
1940
1943
1950
1950

(if date is unknown or not relevant, e.g. "fluid mechanics", a rounded estimation of its notable emergence is provided)

10th year anniversary

Full size images and downloads are only available, 100% free, for registered members.

> Login <