7.2: Central moments of probability density function
- Page ID
- 122622
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\( \newcommand{\dsum}{\displaystyle\sum\limits} \)
\( \newcommand{\dint}{\displaystyle\int\limits} \)
\( \newcommand{\dlim}{\displaystyle\lim\limits} \)
\( \newcommand{\id}{\mathrm{id}}\) \( \newcommand{\Span}{\mathrm{span}}\)
( \newcommand{\kernel}{\mathrm{null}\,}\) \( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\) \( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\) \( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\id}{\mathrm{id}}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\kernel}{\mathrm{null}\,}\)
\( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\)
\( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\)
\( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\) \( \newcommand{\AA}{\unicode[.8,0]{x212B}}\)
\( \newcommand{\vectorA}[1]{\vec{#1}} % arrow\)
\( \newcommand{\vectorAt}[1]{\vec{\text{#1}}} % arrow\)
\( \newcommand{\vectorB}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vectorC}[1]{\textbf{#1}} \)
\( \newcommand{\vectorD}[1]{\overrightarrow{#1}} \)
\( \newcommand{\vectorDt}[1]{\overrightarrow{\text{#1}}} \)
\( \newcommand{\vectE}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash{\mathbf {#1}}}} \)
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\(\newcommand{\longvect}{\overrightarrow}\)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\(\newcommand{\avec}{\mathbf a}\) \(\newcommand{\bvec}{\mathbf b}\) \(\newcommand{\cvec}{\mathbf c}\) \(\newcommand{\dvec}{\mathbf d}\) \(\newcommand{\dtil}{\widetilde{\mathbf d}}\) \(\newcommand{\evec}{\mathbf e}\) \(\newcommand{\fvec}{\mathbf f}\) \(\newcommand{\nvec}{\mathbf n}\) \(\newcommand{\pvec}{\mathbf p}\) \(\newcommand{\qvec}{\mathbf q}\) \(\newcommand{\svec}{\mathbf s}\) \(\newcommand{\tvec}{\mathbf t}\) \(\newcommand{\uvec}{\mathbf u}\) \(\newcommand{\vvec}{\mathbf v}\) \(\newcommand{\wvec}{\mathbf w}\) \(\newcommand{\xvec}{\mathbf x}\) \(\newcommand{\yvec}{\mathbf y}\) \(\newcommand{\zvec}{\mathbf z}\) \(\newcommand{\rvec}{\mathbf r}\) \(\newcommand{\mvec}{\mathbf m}\) \(\newcommand{\zerovec}{\mathbf 0}\) \(\newcommand{\onevec}{\mathbf 1}\) \(\newcommand{\real}{\mathbb R}\) \(\newcommand{\twovec}[2]{\left[\begin{array}{r}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\ctwovec}[2]{\left[\begin{array}{c}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\threevec}[3]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\cthreevec}[3]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\fourvec}[4]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\cfourvec}[4]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\fivevec}[5]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\cfivevec}[5]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\mattwo}[4]{\left[\begin{array}{rr}#1 \amp #2 \\ #3 \amp #4 \\ \end{array}\right]}\) \(\newcommand{\laspan}[1]{\text{Span}\{#1\}}\) \(\newcommand{\bcal}{\cal B}\) \(\newcommand{\ccal}{\cal C}\) \(\newcommand{\scal}{\cal S}\) \(\newcommand{\wcal}{\cal W}\) \(\newcommand{\ecal}{\cal E}\) \(\newcommand{\coords}[2]{\left\{#1\right\}_{#2}}\) \(\newcommand{\gray}[1]{\color{gray}{#1}}\) \(\newcommand{\lgray}[1]{\color{lightgray}{#1}}\) \(\newcommand{\rank}{\operatorname{rank}}\) \(\newcommand{\row}{\text{Row}}\) \(\newcommand{\col}{\text{Col}}\) \(\renewcommand{\row}{\text{Row}}\) \(\newcommand{\nul}{\text{Nul}}\) \(\newcommand{\var}{\text{Var}}\) \(\newcommand{\corr}{\text{corr}}\) \(\newcommand{\len}[1]{\left|#1\right|}\) \(\newcommand{\bbar}{\overline{\bvec}}\) \(\newcommand{\bhat}{\widehat{\bvec}}\) \(\newcommand{\bperp}{\bvec^\perp}\) \(\newcommand{\xhat}{\widehat{\xvec}}\) \(\newcommand{\vhat}{\widehat{\vvec}}\) \(\newcommand{\uhat}{\widehat{\uvec}}\) \(\newcommand{\what}{\widehat{\wvec}}\) \(\newcommand{\Sighat}{\widehat{\Sigma}}\) \(\newcommand{\lt}{<}\) \(\newcommand{\gt}{>}\) \(\newcommand{\amp}{&}\) \(\definecolor{fillinmathshade}{gray}{0.9}\)- Calculating the Central Moment of pdf
- Expected value function \(E[x]\)
- Similar feature to indicate mean value for the variable
- What is the expected value of 3? \(E[3] = 3\)
- How would you do that for a random variable \(x\)?
- \(E[x]\) best guess would be the mean value
- Allows the argument to be multiplied by the pdf \[ E[f(x)] = \int_{-\infty}^{+\infty}f(x) p(x) dx \]
- \(f(x)\) is the value person is adding up
- \(p(x)\) is fraction of cases when \(f(x)\) occurs
- Expectation function is a linear operator:
- Distribution law applies: \(E[a + b]=E[a]+E[b]\)
- Multiply by a constant: \(E[7c] = 7E[c]\) when \(c\) is random variable
- Used to find the central moments of pdf \(\mu_{m}\) through \[ \mu_{m} = E[(x-x')^{m}] = \int_{-\infty}^{+\infty}(x-x')^{m} p(x) dx \] where \(f(x) = (x-x')^{m}\) as the argument of the expected value function
- Similar feature to indicate mean value for the variable
- Zero\(^{\mathrm{th}}\) moment (\(m=0\)) \[ \mu_{0} = E[(x-x')^{0}] =\int_{-\infty}^{+\infty}(x-x')^{0} p(x) dx \] \[ \mu_{0} = E[1] = \int_{-\infty}^{+\infty}1 p(x) dx = 1 \]
- Implies that area under pdf must have value of 1
- First moment (\(m=1\))
- Using expectation function first \[ \mu_{1} = E[(x-x')^{1}] = E[x] - E[x'] \] Which of those is constant? If expectation is like mean of random variable \[ \mu_{1} = E[x] -x' = \mathbf{0} \]
- Using in pdf form instead \[ \mu_{1} = \int_{-\infty}^{+\infty}(x-x')^{1} p(x) dx \] \[ \mu_{1} = \int_{-\infty}^{+\infty}x p(x) dx - x'\int_{-\infty}^{+\infty} p(x) dx = 0 \]
- In order for pdf version to work, must define true mean as \[ x' \equiv \int_{-\infty}^{+\infty}x p(x) dx \]
- If \(m=0\) defined area as 1, then \(x'\) acts as horizontal centroid of the area
- Second central moment (\(m=2\))
- Using the linearity of expectation function again \[ \mu_{2} = E[(x-x')^{2}] = E[x^{2}-2xx'+x'^{2}] \] \[\mu_{2} = E[x^{2}]-2x'E[x]+x'^{2} \] \[ \mu_{2} = E[x^{2}] - x'^{2} \equiv \sigma^{2} \] where \(\sigma^{2}\) is the variance of the random data
- Same expansion could be applied to pdf \[ \mu_{2} = \int_{-\infty}^{+\infty}(x-x')^{2} p(x) dx = \sigma^{2} \]
- Note the different terms:
- variance \(\sigma^{2}\) is square of units relative to the mean
- standard deviation \(\sigma\) is in the same units of random variable
- mean square is the non-centered square of the random variable \[ \psi^{2} = \int_{-\infty}^{+\infty}x^{2} p(x) dx = \sigma^{2} + x'^{2} \]
- Third central moment (\(m=3\)) \[ \mu_{3} = E[(x-x')^{3}] =\int_{-\infty}^{+\infty}(x-x')^{3} p(x) dx \]
- Defines the skewness or asymmetry of the pdf
- \(Sk = \frac{\mu_{3}}{\sigma^{3}}\) making it dimensionless and signed value
- Right shifted (tail stretches to the right) \(Sk>0\)
- Left shifted when \(Sk<0\)
- Balanced when \(Sk = 0\)
- Fourth central moment (\(m=4\)) \[ \mu_{4} = E[(x-x')^{4}] =\int_{-\infty}^{+\infty}(x-x')^{4} p(x) dx \]
- Defines the kurtosis or flatness versus peakedness of the pdf
- \(Ku = \frac{\mu_{4}}{\sigma^{4}}\) since scaled is again dimensionless
- \(Ku = 3\) for bell curve (normal distribution; next section)
- \(Ku > 3\) when sharp top peak (high derivative over the top)
- \(0 < Ku < 3\) when more flat on top
- Drawn graphically as part of lecture
- All moments are independent of one another except for the true mean \(x'\) since that is embedded within \(m=\{2,3,4\}\)
Consider a sailboat-like probability density function for acceleration: \[ p(a) = \left\{\begin{array}{cr} 0 & a < 0 \\ & \\
ma & 0\leq a < 4 \\ & \\ 0 & 4\leq a < 6
\\ & \\ -0.14a+1.26 & 6 \leq a < 9
\\ & \\ 0 & a \geq 9
\end{array} \right. \]
shown in the figure:
- What value of \(m\) is necessary for the slope to have a valid probability density?
- Determine the true mean value \(a'\)
- Calculate the probability acceleration falls between the range of \(2.5< a < 6.5\) m/s\(^{2}).
- Determine the numerical values of variance, skewness, and kurtosis of the probability density function; justify the magnitude and scale of calculated results.
- Answer
-
- Area under curve has to add to unity: \[\int_{-\infty}^{+\infty} p(a)da =1\] setting up integration or area calculation of triangles \[\int_{0}^{4} ma\ da + \int_{6}^{9} \left(-0.14a + 1.26\right)\ da=1\] completing integration yields the result \(m = 0.04625\)
- The distance of variable \(a\) now multiplied by probability \[a'= \int a p(a)da= \int_{0}^{4} 0.04625a^{2}\ da + \int_{6}^{9} \left(-0.14a^{2} + 1.26a\right)\ da\] which is equivalent to the centroid calculation of right triangles. The integration results in \(a' = 5.397\) m/s\(^{2}\)
- Calculate area under limited range of the function \[$P(2.5< a < 6.5) =\int_{2.5}^{4} 0.04625a\ da + \int_{6}^{6.5} \left(-0.14a + 1.26\right)\ da\] produces probability \(P = 42\)%
- First, the variance will need to be determined: \[\sigma^{2} = \int_{0}^{4} ma^{3}\ da + \int_{6}^{9}\left( -0.14a^{3} + 1.26a^{2}\right)\ da - a'^{2} \] making \(\sigma^{2} = 5.021\) m\(^{2}\)/s\(^{4}\)
- The value of skewness is \[Sk = \left[\int_{0}^{4} (a-a')^{3} ma\ da + \int_{6}^{9} (a-a')^{3}(-0.14a+1.26)\ da\right]/\sigma^{3} = -0.547 \] indicating a left shift due to \(Sk<0\) (longer stretch to the left relative to 5.397)
- The value of kurtosis is \[Ku = \left[\int_{0}^{4} (a-a')^{4} ma\ da + \int_{6}^{9} (a-a')^{4}(-0.14a+1.26)\ da\right]/\sigma^{4}= 1.91\] indicating somewhat "flat" form near the mean region of the pdf.
- Expected value function \(E[x]\)

