概率與統計:不確定性的科學
一門全面的入門級大學程度課程,介紹概率與統計的數學基礎。課程要求具備一年的微積分知識,內容涵蓋概率模型、隨機變量、期望值、抽樣分佈、似然與貝葉斯推論,以及變量之間的關係。
課程總覽
📚 內容概要
一門全面性的大學程度入門課程,涵蓋機率與統計的數學基礎。本課程需具備一年微積分知識,內容包括機率模型、隨機變數、期望值、抽樣分配、似然與貝氏推論,以及變數之間的關係。
透過基於微積分的機率與統計推論,掌握不確定性這門嚴謹的數學科學。
作者: Michael J. Evans 與 Jeffrey S. Rosenthal
致謝: 作者感謝多所機構(如多倫多大學、麥馬斯特大學、普渡大學)的審稿人與同事們的貢獻。同時也提及多倫多大學提供的資金與基建支援。
🎯 學習目標
- 利用樣本空間、事件與機率度量,定義正式的機率模型。
- 運用組合原理(排列、子集、二項係數)解決均勻機率問題。
- 使用全機率法則與貝氏定理分析多階段系統,並根據新資訊更新信念。
- 定義並區分離散型與絕對連續型隨機變數,及其對應的機率/密度函數。
- 認識並應用關鍵機率分配(伯努利、二項、泊松、常態等),以建模現實現象。
- 計算聯合分配的邊際密度、條件分配,並評估獨立性。
- 計算離散、連續與混合型隨機變數的期望值、變異數與共變異數。
- 應用無知統計師定律(LOTUS)與線性性質,計算變換後變數的期望值。
- 利用機率生成函數(PGF)與動差生成函數(MGF)推導各階動差。
- 定義並推導獨立同分布序列函數的抽樣分配。
課程 共 11 课时 · 预计 33.0h
課程
Lesson
This lesson introduces formal probability models as a rigorous framework to replace subjective intuition, highlighting the relative frequency interpretation and the Law of Large Numbers. Students learn to apply these mathematical structures to quantify uncertainty and manage risk in complex, real-world scenarios where human cognitive biases often fail.
This lesson introduces random variables as deterministic functions that map sample space outcomes to real numbers, providing a quantitative framework for probability. Students learn to utilize indicator functions, understand probability distributions, and apply the continuity of probability to analyze complex events.
This lesson introduces mathematical expectation as the long-run average of a random variable and explores its core properties, including linearity, monotonicity, and independence. Students learn to apply the Law of the Unconscious Statistician (LOTUS) to efficiently calculate the expected values of transformed variables without needing to derive their specific probability distributions.
This lesson introduces sampling distributions as the probability laws governing statistics, which are functions of independent and identically distributed (i.i.d.) random variables. Students learn to derive exact distributions for small sample sizes and explore how these concepts bridge the gap between raw data and statistical inference.
This lesson introduces statistical inference as the formal process of using sample data to estimate the underlying probability distributions and mechanics of a system. It emphasizes that inference is necessary to distinguish between inherent random variation and structural uncertainty, allowing researchers to make robust predictions beyond simple descriptive summaries.
This lesson explores likelihood-based inference, focusing on how the likelihood function quantifies the support for different parameter values given observed data. Students learn to use log-likelihoods for computational efficiency, apply the Central Limit Theorem for asymptotic inference, and utilize Fisher Information to measure the precision of statistical estimates.
This lesson introduces the Bayesian paradigm, which treats unknown parameters as random variables rather than fixed constants to allow for direct probability statements about them. Students learn to construct a complete Bayesian model by combining a sampling model with a prior distribution to update beliefs through the joint distribution.
This lesson explores the mathematical foundations of optimal statistical inference by defining the Mean Squared Error (MSE) as the sum of an estimator's variance and squared bias. Students learn how to minimize this error to identify the best estimators and understand the role of sufficiency and posterior means in decision theory.
This lesson introduces model checking as a critical validation step that ensures statistical inferences are grounded in reality rather than mathematical fiction. Students will learn to distinguish between parameter estimation and model validation, emphasizing that even the most precise calculations are meaningless if the underlying model assumptions do not accurately reflect the data-generating process.
This lesson defines a statistical relationship as any change in the conditional distribution of a response variable $Y$ when a predictor $X$ varies, moving beyond simple correlation to include shifts in mean, variance, or shape. It also emphasizes that establishing causality requires rigorous experimental design, such as blinding and blocking, to account for confounding variables and eliminate bias.
This lesson introduces stochastic processes as systems that evolve over time through probabilistic rather than deterministic rules, with a primary focus on the Simple Random Walk. Students learn to calculate path probabilities and expected values while exploring key concepts like the parity rule, Martingale fairness, and the foundational mechanics of the Gambler’s Ruin model.