Maximum Likelihood Estimation

cho.sh

researchmini

3,252 notes

260729260729 260727260727 Claude Code Live Renaming30747B 260726260726 260722260722 I prefer TUIBB9A08 MarkRight8B0501 에이전트 런타임 서버 셋업1983DC Bun을 Rust로 재작성하다2BDED3 260721260721 Agent Runtime Server SetupC38C2C 260719260719 AutoBuilder63849A 260718260718 Slack Bots are the new CLIs3E662F 260717260717 WristcomputerD98BDF 260716260716 SalpakanA2940F AGENTS.mdDFE522 260714260714 260713260713 260712260712 260711260711

cho.sh

research mini

3,252 notes

Maximum Likelihood Estimation · cho.sh

Maximum Likelihood Estimation

Warning

This post is more than a year old. Information may be outdated.

$f(\mathbb{D} | \theta)$

$\hat{\theta}_\text{ML} = \text{argmax}_{\theta} g(x|\theta) = \text{argmax}_{\theta} \ln g(x | \theta)$

Backlinks2

230327 Maximum A Posteriori

Comments0

No comments yet. Be the first to share your thoughts.

Comments

argmaxθg(x∣θ)=

argmaxθlng(x∣θ)

$\hat{\theta}_\text{ML} = \text{argmax}_{\theta} g(x_1,~x_2,~\cdots,~x_n | \theta)$ $= \text{argmax}_{\theta} \prod\limits_{k=1}^{n} g(x_k|\theta)$ -- i.i.d. / r.s. $= \text{argmax}_{\theta} \sum\limits_{k=1}^{n} \ln g(x_k|\theta)$

${\partial L \over \partial \theta} |_{\theta = \hat\theta_\text{ML}} = 0$

$\therefore$ Check ${\partial L \over \partial \theta} |_{\theta = \hat\theta_\text{ML}} < 0$

$\hat {h(\theta)}^\text{ML} = h(\hat\theta^\text{ML})$

$x_1, \cdots, x_n \sim \text{Geometric} (P)$ $\hat{\sigma^2}^\text{ML}$

$\hat{1 \over p} = \overline{X_n} \Rightarrow \hat{p} = {1 \over \overline{x}}$

${\hat{\sigma^2}}^\text{ML} = {q \over p^2} = {\hat{{1-p} \over p^2}}^\text{ML} = 1 - {{1 \over \overline{x_n}} \over {{1 \over \overline{x_n}}^2}}$

Max-likelihood: Tries to give the best PDF.

Max-likelihood parameter as $\hat \theta$

\hat \theta ^\text{ML} = \text{argmax}_{\theta} f(x_1, x_2, \cdots x^n | \theta) = \text{argmax}_{\theta} \ln f(x_1, x_2, \cdots x^n | \theta) = \text{argmax}_{\theta} L

Assuming IID

= \ln \prod_{k=1}^{n} f(x_k | \theta) = \text{argmax}_{\theta} \sum_{k=1}^{n} \ln f(x_k | \theta)