Obtain the maximum likelihood estimator of the mean vector and variance-covariance matrix of the multivariate normal distribution.
Let $\mathbf{X}_1, \mathbf{X}_2, \ldots, \mathbf{X}_n$ be a random sample from a multivariate normal distribution with mean vector $\boldsymbol{\mu} \in \mathbb{R}^p$ and variance-covariance matrix $\boldsymbol{\Sigma} \in \mathbb{R}^{p \times p}$, where $\boldsymbol{\Sigma}$ is symmetric and positive definite. The probability density function of the multivariate normal distribution is given by:
$$
f(\mathbf{x}) = \frac{1}{(2\pi)^{p/2} |\boldsymbol{\Sigma}|^{1/2}} \exp\left( -\frac{1}{2} (\mathbf{x} - \boldsymbol{\mu})^\top \boldsymbol{\Sigma}^{-1} (\mathbf{x} - \boldsymbol{\mu}) \right)
$$
The likelihood function $L(\boldsymbol{\mu}, \boldsymbol{\Sigma})$ based on the independent observations $\mathbf{X}_1, \ldots, \mathbf{X}_n$ is the product of individual densities:
$$
L(\boldsymbol{\mu}, \boldsymbol{\Sigma}) = \prod_{i=1}^n f(\mathbf{X}_i)
= \left( \frac{1}{(2\pi)^{p/2} |\boldsymbol{\Sigma}|^{1/2}} \right)^n \exp\left( -\frac{1}{2} \sum_{i=1}^n (\mathbf{X}_i - \boldsymbol{\mu})^\top \boldsymbol{\Sigma}^{-1} (\mathbf{X}_i - \boldsymbol{\mu}) \right)
$$
Taking the natural logarithm of the likelihood function, we obtain the log-likelihood function:
_______ _____ ______ __________ _________ ____ __________ _____ _____ ____ ____ _____.
________ ____ __________ __________ ____ __________ ___ ___ ____.
__________ _____ _________ _________ _________ __________ _______ _______ ____ ______ _____.
___ ____ ___ ___ _____ _________ ______ ______.
_________ ________ __________ ________ ____ ________ ___ _____.
_______ _____ _____ _____ _________ _______.
_______ _________ ______ ____ _______.
________ _________ ________ _________ ____ _________.
__________ ________ ___ _________ ____.
_________ _________ _______ _________ _____ __________ _____ _______ ___ _____ _______.
_______ ___ __________ __________ ___ __________ ______ _____ __________ ______ __________ ____.
___ _____ ____ _______ __________ _____ ___ ____.
_________ ___ ___ ____ ____ ___ ______ ______ __________ ______ ________.
_________ __________ _______ _________ _____ __________.
_______ ________ _______ ______ ___ ________ ________ ______ ______ ______ __________ _______.
____ __________ _________ _______ _________ ____ ___ _____ ________ _____ _________ ________.
___ _____ _________ _____ _________ ________ _____ __________ ______ ____ _____.
__________ ________ _______ ____ ______ _____ _______ ____ ___.
____ ____ ____ ________ _____ _____ _________.
___ _______ ___ ____ ____ _____ _________ ______ _______ _______.
____ _____ ________ ________ __________ ____ ____.
________ _________ ______ ____ ______ ___ _____.
________ ____ _____ _____ _________ ____ _______ ______ _______ __________.
_________ ________ _____ _______ ____ ____ _______ _______.
____ _____ _____ _____ ______ _______ ____ _____ ________ ________.
_______ _____ ___ _____ ____ ___ __________ ____ ___ ____ _____.
____ ______ _________ _________ _________ ____ _______ _____ __________ ______ _________.
____ ________ _______ _______ __________ _________.
_____ ______ ______ ________ ___ _________ __________ _________ __________ ____.
_________ _______ __________ _____ ___ ________ ___.
- Solved Assignments
- Study Notes
- Guess Papers
- Question Papers
✓ Unlock up to 60% of the answer
✓ No payment required