Rudolf Kalman published 'A New Approach to Linear Filtering and Prediction Problems' in 1960. The result was immediate and far-reaching: given a linear state-space model with Gaussian disturbances, the Kalman filter computes the exact conditional mean and covariance of the latent state at each point in time, using only the previous state estimate and the current observation. No other linear estimator achieves lower mean-squared error. The filter was adopted first by aerospace engineers (Apollo navigation systems), then by electrical engineers, and by the late 1980s it had become central to macroeconometrics through the work of Harvey (1989) and Hamilton (1994).
The state-space representation splits the world into what you observe (measurement equation) and what you model (transition equation). The transition equation describes how the latent state evolves over time - trend growth, cyclical dynamics, time-varying parameters, factor loadings. The measurement equation links the latent state to observable data, with measurement noise. The Kalman filter takes this two-equation system and produces the prediction step (project the state forward using the transition equation) and the update step (revise the projection when new data arrive). The update step is the key: it weights the model's prediction against the data observation using the Kalman gain, which is optimal in the MSE sense.
In macroeconomics, the Kalman filter serves three roles. First, it estimates unobservable states: the output gap, the natural rate of interest, underlying inflation trends. Second, it evaluates the likelihood function of any model that can be written in state-space form, enabling maximum likelihood estimation of structural parameters. Third, it handles missing data and mixed-frequency observations naturally - if an observation is missing at time t, the update step is skipped and the prediction step carries the state forward under increased uncertainty.
The filter's optimality is conditional on linearity and Gaussianity. When the state-space model is nonlinear (e.g., DSGE models with occasionally binding constraints), the extended Kalman filter (EKF) or unscented Kalman filter (UKF) provides approximations. When disturbances are non-Gaussian, the particle filter replaces the Kalman filter with sequential Monte Carlo. But for the large class of linear Gaussian models that dominate applied macroeconometrics - UCMs, dynamic factor models, TVP-VARs, nowcasting systems - the Kalman filter is exact and optimal.