Product Design, Manufacturing & Innovation Resources
Home » Bayes Factor

Bayes Factor

1939
  • Harold Jeffreys
Office workspace with statistical software showing Bayes factor calculations and hypothesis testing notes.

(generated image for illustration only)

The Bayes factor is a ratio of the marginal likelihoods of two competing hypotheses, often a null hypothesis (\(M_1\)) and an alternative hypothesis (\(M_2\)). It quantifies the support for one hypothesis over the other, given the observed data \(D\). The formula is \(K = \frac{P(D|M_1)}{P(D|M_2)}\). A value of K > 1 indicates that the data favors \(M_1\) over \(M_2\).

The Bayes factor is the Bayesian alternative to the frequentist p-value for hypothesis testing. Unlike a p-value, which only provides evidence against the null hypothesis, the Bayes factor can quantify evidence for the null, for the alternative, or indicate that the data is uninformative. The magnitude of the Bayes factor provides a continuous scale of evidence. For instance, a Bayes factor of 10 is often considered ‘strong’ evidence for one model over another, while a value between 1 and 3 is considered ‘anecdotal’ or ‘weak’ evidence.

The core component of the Bayes factor is the marginal likelihood, \(P(D|M) = \int P(D|\theta, M)P(\theta|M) d\theta\). This is the probability of the observed data averaged over the prior distribution of the parameters \(\theta\) for a given model \(M\). This integral makes the Bayes factor sensitive to the choice of prior distributions, which is a point of contention and active research. It also makes it computationally challenging to calculate, often requiring numerical methods like MCMC or approximate methods like the Bayesian Information Criterion (BIC). Despite these challenges, its ability to weigh evidence for competing hypotheses makes it a powerful tool for scientific inference and model selection.

UNESCO Nomenclature: 1208
– Statistics

Type

Abstract System

Disruption

Substantial

Usage

Widespread Use

Precursors

  • Bayesian inference
  • Likelihood principle
  • Philosophical work on the nature of scientific evidence
  • Neyman-Pearson lemma for hypothesis testing

Applications

  • Hypothesis testing in psychology, biology, and social sciences
  • Model selection in machine learning and statistics
  • A/B testing to determine if a change has a real effect
  • Forensic science to weigh evidence
  • Genomics for identifying significant gene associations

Patents:

NA

Potential Innovations Ideas

Due to scrapping bot traffic, currently more than 40k per day, this content is reserved to community members.
> Login < or > Register < (100% free) to access this, so as all other restricted content and tools.

Related to: Bayes factor, hypothesis testing, model selection, marginal likelihood, evidence, Bayesian statistics, Harold Jeffreys, p-value, statistical evidence, prior distribution.

Historical Context

Bayes Factor

1925
1930
1931
1939
1940
1950
1950
1925
1928
1930
1936
1940
1943
1950
1950

(if date is unknown or not relevant, e.g. "fluid mechanics", a rounded estimation of its notable emergence is provided)

Related Invention, Innovation & Technical Principles

Full size images and downloads are only available, 100% free, for registered members.

> Login <