+ All Categories
Home > Documents > MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf ·...

MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf ·...

Date post: 23-Jun-2020
Category:
Upload: others
View: 9 times
Download: 0 times
Share this document with a friend
33
MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences University of Delaware February 11st, 2019 Vu Dinh MATH 450: Mathematical statistics
Transcript
Page 1: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

MATH 450: Mathematical statistics

Vu Dinh

Departments of Mathematical SciencesUniversity of Delaware

February 11st, 2019

Vu Dinh MATH 450: Mathematical statistics

Page 2: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

General information

Classes: MWF 2:30pm-3:20pm, Ewing Hall 101

Office hours: Ewing Hall 312

Tuesday 2pm-3pmWednesday 3:30pm-4:30pmBy appointment

Website: http://vucdinh.github.io/m450s19

Textbook: Modern mathematical statistics with applications(Second Edition). Devore and Berk. Springer, 2012.

Vu Dinh MATH 450: Mathematical statistics

Page 3: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Evaluation

Overall scores will be computed as follows:25% homework, 10% quizzes, 25% midterm, 40% final

No letter grades will be given for homework, midterm, or final.Your letter grade for the course will be based on your overallscore.

The lowest homework scores and the lowest quiz score will bedropped.

Here are the letter grades you can achieve according to youroverall score.

≥ 90%: At least A≥ 75%: At least B≥ 60%: At least C≥ 50%: At least D

Vu Dinh MATH 450: Mathematical statistics

Page 4: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Homework

Vu Dinh MATH 450: Mathematical statistics

Page 5: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Homework

Assignments will be posted on the website every otherWednesday (starting from the first week) and will be due onFriday of the following week, at the beginning of lecture.

No late homework will be accepted.

The lowest homework scores will be dropped in the calculationof your overall homework grade.

Vu Dinh MATH 450: Mathematical statistics

Page 6: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Quizzes and exams

At the end of some chapter, there will be a short quiz duringclass.

The quiz dates will be announced at least one class inadvance.

The lowest quiz score will be dropped.

There will be a (tentative) midterm on 04/12 and a finalexam during exams week.

Vu Dinh MATH 450: Mathematical statistics

Page 7: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Data analysis

Open source statistical system R

http://cran.r-project.org/

Vu Dinh MATH 450: Mathematical statistics

Page 8: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Tentative schedule

Vu Dinh MATH 450: Mathematical statistics

Page 9: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Topics

Textbook: Modern mathematical statistics with applications(Second Edition).Devore and Berk. Springer, 2012.

Week 2 · · · · · ·• Chapter 6: Statistics and SamplingDistributions

Week 4 · · · · · ·• Chapter 7: Point Estimation

Week 6 · · · · · ·• Chapter 8: Confidence Intervals

Week 9 · · · · · ·• Chapter 9: Test of Hypothesis

Week 11 · · · · · ·• Chapter 10: Two-sample inference

Week 12 · · · · · ·• Regression

Vu Dinh MATH 450: Mathematical statistics

Page 10: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Mathematical statistics

Vu Dinh MATH 450: Mathematical statistics

Page 11: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Mathematical statistics

Statistics is a branch of mathematics that deals with thecollection, organization, analysis, interpretation andpresentation of data

“...analysis, interpretation and presentation of data”→ mathematical statistics

descriptive statistics: the part of statistics that describes datainferential statistics: the part of statistics that drawsconclusions from data

Vu Dinh MATH 450: Mathematical statistics

Page 12: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Modelling uncertainties

— Modern statistics is about making prediction in the presence ofuncertainties

Vu Dinh MATH 450: Mathematical statistics

Page 13: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

— It is difficult to make predictions, especially about the future.

Vu Dinh MATH 450: Mathematical statistics

Page 14: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Inferential statistics

population: a well-defined collection of objects of interest

when desired information is available for all objects in thepopulation, we have what is called a census→ very expensive

a sample, a subset of the population, is selected

Vu Dinh MATH 450: Mathematical statistics

Page 15: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Random sample

Definition

The random variables X1,X2, ...,Xn are said to form a (simple)random sample of size n if

1 the Xi ’s are independent random variables

2 every Xi has the same probability distribution

Vu Dinh MATH 450: Mathematical statistics

Page 16: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Review: Probability

Vu Dinh MATH 450: Mathematical statistics

Page 17: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Overview

Axioms of probability

Conditional probability and independence

Random variables

Special distributions

Bivariate and multivariate distributions

Vu Dinh MATH 450: Mathematical statistics

Page 18: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Most important parts

Expectation and variance of random variables (discrete andcontinuous)

Computations with normal distributions

Bivariate and multivariate distributions

Vu Dinh MATH 450: Mathematical statistics

Page 19: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Random variables

random variables are used to model uncertainties

Notations:

random variables are denoted by uppercase letters (e.g., X );the calculated/observed values of the random variables aredenoted by lowercase letters (e.g., x)

Vu Dinh MATH 450: Mathematical statistics

Page 20: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Random variable

Definition

Let S be the sample space of an experiment. A real-valuedfunction X : S → R is called a random variable of the experiment.

Vu Dinh MATH 450: Mathematical statistics

Page 21: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Discrete random variable

Definition

A random variables X is discrete if the set of all possible values ofX

is finite

is countably infinite

Note: A set A is countably infinite if its elements can be put inone-to-one correspondence with the set of natural numbers, i.e, wecan index the element of A as a sequence

A = {x1, x2, . . . , xn, . . .}

Vu Dinh MATH 450: Mathematical statistics

Page 22: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Discrete random variable

A random variable X is described by its probability mass function

Vu Dinh MATH 450: Mathematical statistics

Page 23: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Represent the probability mass function

As a table

As a function:

p(x) =

{12

(23

)xif x = 1, 2, 3, . . . ,

0 elsewhere

Vu Dinh MATH 450: Mathematical statistics

Page 24: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Expectation

The expected value of a random variable X is also called the mean,or the mathematical expectation, or simply the expectation ofX. It is also occasionally denoted by E [X ], E (X ), EX , µX , or µ.

Vu Dinh MATH 450: Mathematical statistics

Page 25: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Exercise

Problem

A random variable X has the following pmf table

X 0 1 2

probability 0.25 0.5 0.25

What is the expected value of X?

Vu Dinh MATH 450: Mathematical statistics

Page 26: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Law of the unconscious statistician (LOTUS)

Vu Dinh MATH 450: Mathematical statistics

Page 27: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Exercise

Problem

A random variable X has the following pmf table

X 0 1 2

probability 0.25 0.5 0.25

What is E [X 2 − X ]?

Compute Var [X ]

Var [X ] = E [(X − E [X ])2] = E [X 2]− (E [X ])2

Vu Dinh MATH 450: Mathematical statistics

Page 28: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Continuous random variable

Definition

Let X be a random variable. Suppose that there exists anonnegative real-valued function f : R→ [0,∞) such that for anysubset of real numbers A, we have

P(X ∈ A) =

∫Af (x)dx

Then X is called absolutely continuous or, for simplicity,continuous. The function f is called the probability densityfunction, or simply the density function of X.

Whenever we say that X is continuous, we mean that it isabsolutely continuous and hence satisfies the equation above.

Vu Dinh MATH 450: Mathematical statistics

Page 29: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Properties

Let X be a continuous r.v. with density function f , then∫∞−∞ f (x) dx = 1

For any fixed constant a, b,

P(a ≤ X ≤ b) =

∫ b

af (x) dx

P(X = a) = 0

P(a < X < b) = P(a ≤ X < b) = P(a < X ≤ b) = P(a ≤ X ≤ b)

Vu Dinh MATH 450: Mathematical statistics

Page 30: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Probability density function

Vu Dinh MATH 450: Mathematical statistics

Page 31: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Expectation

Vu Dinh MATH 450: Mathematical statistics

Page 32: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Lotus

Vu Dinh MATH 450: Mathematical statistics

Page 33: MATH 450: Mathematical statistics - GitHub Pagesvucdinh.github.io/S19/450/lecture01.pdf · 2020-05-21 · MATH 450: Mathematical statistics Vu Dinh Departments of Mathematical Sciences

Example

Problem

Let X be a continuous r.v. with density function

f (x) =

{ce−2x if x ≥ 0

0 otherwise

where c is some unknown constant.

Compute c

Compite P(X ∈ [1, 2])

Compute E [X ] and Var(X ).

Vu Dinh MATH 450: Mathematical statistics


Recommended