统计机器学习导论(英文版)

统计机器学习导论(英文版)
作 者: 杉山将
出版社: 机械工业出版社
丛编项: 经典原版书库
版权说明: 本书为出版图书,暂不支持在线阅读,请支持正版图书
标 签: 暂缺
ISBN 出版时间 包装 开本 页数 字数
未知 暂无 暂无 未知 0 暂无

作者简介

  【加照片】Masashi Sugiyama,东京大学教授,拥有东京工业大学计算机科学博士学位,研究兴趣包括机器学习与数据挖掘的理论、算法和应用,涉及信号处理、图像处理、机器人控制等。2007年获得IBM学者奖,以表彰其在机器学习领域非平稳性方面做出的贡献。2011年获得日本信息处理协会颁发的Nagao特别研究奖,以及日本文部科学省颁发的青年科学家奖,以表彰其对机器学习密度比范型的贡献。

内容简介

统计技术与机器学习的结合使其成为一种强大的工具,能够对众多计算机和工程领域的数据进行分析,包括图像处理、语音处理、自然语言处理、机器人控制以及生物、医学、天文学、物理、材料等基础科学范畴。本书介绍机器学习的基础知识,注重理论与实践的结合。第壹部分讨论机器学习算法中统计与概率的基本概念,第二部分和第三部分讲解机器学习的两种主要方法,即生成学习方法和判别分类方法,其中,第三部分对实际应用中重要的机器学习算法进行了深入讨论。本书配有MATLAB/Octave代码,可帮助读者培养实践技能,完成数据分析任务。

图书目录

Contents

Biography . .iv

Preface. v

PART 1INTRODUCTION

CHAPTER 1Statistical Machine Learning

1.1Types of Learning 3

1.2Examples of Machine Learning Tasks . 4

1.2.1Supervised Learning 4

1.2.2Unsupervised Learning . 5

1.2.3Further Topics 6

1.3Structure of This Textbook . 8

PART 2STATISTICS AND PROBABILITY

CHAPTER 2Random Variables and Probability Distributions

2.1Mathematical Preliminaries . 11

2.2Probability . 13

2.3Random Variable and Probability Distribution 14

2.4Properties of Probability Distributions 16

2.4.1Expectation, Median, and Mode . 16

2.4.2Variance and Standard Deviation 18

2.4.3Skewness, Kurtosis, and Moments 19

2.5Transformation of Random Variables 22

CHAPTER 3Examples of Discrete Probability Distributions

3.1Discrete Uniform Distribution . 25

3.2Binomial Distribution . 26

3.3Hypergeometric Distribution. 27

3.4Poisson Distribution . 31

3.5Negative Binomial Distribution . 33

3.6Geometric Distribution 35

CHAPTER 4Examples of Continuous Probability Distributions

4.1Continuous Uniform Distribution . 37

4.2Normal Distribution 37

4.3Gamma Distribution, Exponential Distribution, and Chi-Squared Distribution . 41

4.4Beta Distribution . 44

4.5Cauchy Distribution and Laplace Distribution 47

4.6t-Distribution and F-Distribution . 49

CHAPTER 5Multidimensional Probability Distributions

5.1Joint Probability Distribution 51

5.2Conditional Probability Distribution . 52

5.3Contingency Table 53

5.4Bayes’ Theorem. 53

5.5Covariance and Correlation 55

5.6Independence . 56

CHAPTER 6Examples of Multidimensional Probability Distributions61

6.1Multinomial Distribution . 61

6.2Multivariate Normal Distribution . 62

6.3Dirichlet Distribution 63

6.4Wishart Distribution . 70

CHAPTER 7Sum of Independent Random Variables

7.1Convolution 73

7.2Reproductive Property 74

7.3Law of Large Numbers 74

7.4Central Limit Theorem 77

CHAPTER 8Probability Inequalities

8.1Union Bound 81

8.2Inequalities for Probabilities 82

8.2.1Markov’s Inequality and Chernoff’s Inequality 82

8.2.2Cantelli’s Inequality and Chebyshev’s Inequality 83

8.3Inequalities for Expectation . 84

8.3.1Jensen’s Inequality 84

8.3.2H?lder’s Inequality and Schwarz’s Inequality . 85

8.3.3Minkowski’s Inequality . 86

8.3.4Kantorovich’s Inequality . 87

8.4Inequalities for the Sum of Independent Random Vari-ables 87

8.4.1Chebyshev’s Inequality and Chernoff’s Inequality 88

8.4.2Hoeffding’s Inequality and Bernstein’s Inequality 88

8.4.3Bennett’s Inequality. 89

CHAPTER 9Statistical Estimation

9.1Fundamentals of Statistical Estimation 91

9.2Point Estimation 92

9.2.1Parametric Density Estimation . 92

9.2.2Nonparametric Density Estimation 93

9.2.3Regression and Classification. 93

9.2.4Model Selection 94

9.3Interval Estimation. 95

9.3.1Interval Estimation for Expectation of Normal Samples. 95

9.3.2Bootstrap Confidence Interval 96

9.3.3Bayesian Credible Interval. 97

CHAPTER 10Hypothesis Testing

10.1Fundamentals of Hypothesis Testing 99

10.2Test for Expectation of Normal Samples 100

10.3Neyman-Pearson Lemma . 101

10.4Test for Contingency Tables 102

10.5Test for Difference in Expectations of Normal Samples 104

10.5.1 Two Samples without Correspondence . 104

10.5.2 Two Samples with Correspondence 105

10.6Nonparametric Test for Ranks. 107

10.6.1 Two Samples without Correspondence . 107

10.6.2 Two Samples with Correspondence 108

10.7Monte Carlo Test . 108

PART 3GENERATIVE APPROACH TO STATISTICAL PATTERN RECOGNITION

CHAPTER 11Pattern Recognition via Generative Model Estimation113

11.1Formulation of Pattern Recognition . 113

11.2Statistical Pattern Recognition . 115

11.3Criteria for Classifier Training . 117

11.3.1 MAP Rule 117

11.3.2 Minimum Misclassification Rate Rule 118

11.3.3 Bayes Decision Rule 119

11.3.4 Discussion . 121

11.4Generative and Discriminative Approaches 121

CHAPTER 12Maximum Likelihood Estimation

12.1Definition. 123

12.2Gaussian Model. 125

12.3Computing the Class-Posterior Probability . 127

12.4Fisher’s Linear Discriminant Analysis (FDA