Advertisement
s243a

SHARE TWEET Draft5: Notes on the Pareto_distribution.tex

Jul 20th, 2020
1,503
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Latex 34.61 KB | None | 0 0
  1. \documentclass[11pt]{article}
  2. %Gummi|065|=)
  3. \title{\textbf{Draft: Notes on the Pareto distribution}}
  4. \author{John Creighton\\
  5.         Nobody else}
  6. \date{}
  7. \usepackage{amsmath}
  8. \usepackage[pdftex]{graphicx}
  9. \usepackage[utf8]{inputenc}
  10. \usepackage{hyperref}
  11. \begin{document}
  12.  
  13. \maketitle
  14.  
  15. \section{Introduction}
  16.  
  17. The Pareto distribution is a well known model for wealth and income distribution and sometimes used as a model for variations in productivity. However, for this to be an accurate model of productivity in the tail of the distribution (AKA survival function) for income must be proportional to productivity. This is a highly contentious claim given that the differences in incomes vastly exceed what could reasonably attributed to individual productivity.
  18.  
  19. \section{The Survival Function and The Deffinition of The Pareto Distribution}
  20.  
  21. The principle characteristic of a Pareto distribution is that it has a survival function
  22.  
  23. \begin{equation}
  24. S(t)=P(\{T>t\})=\int _{t}^{\infty }f(u)\,du=1-F(t).
  25. \end{equation}
  26.  
  27. which is asymptotically a power law distribution.
  28.  
  29. \begin{equation}
  30. {\displaystyle {\overline {F}}(x)=\Pr(X>x)={\begin{cases}\left({\frac {x_{\mathrm {m} }}{x}}\right)^{\alpha }&x\geq x_{\mathrm {m} },\\1&x<x_{\mathrm {m} },\end{cases}}}
  31. \end{equation}
  32.  
  33. where $X_m$ is the minimum value of x and acts as a scale parmater and $\alpha$ is known as the "Pareto Index". $\alpha$ is a "shape paramater
  34. \footnote{From \href{https://en.wikipedia.org/w/index.php?title=Shape_parameter&oldid=952709345}{Wikipedia} \cite{WikipediaShapeParameter}: "Specifically, a shape parameter is any parameter of a probability distribution that is neither a location parameter nor a scale parameter (nor a function of either or both of these only, such as a rate parameter). Such a parameter must affect the shape of a distribution rather than simply shifting it (as a location parameter does) or stretching/shrinking it (as a scale parameter does)."}"
  35. [\cite{WikipediaParetoDistribution}].
  36.  
  37.  
  38.  
  39. \includegraphics[width=0.9\textwidth]{Probability_density_function_of_Pareto_distribution.png}
  40.  
  41. \subsection{Applications of Power Law Distributions,the 80:20 rule and Mathew's Law}
  42.  
  43. Power Law distributions have applications in many fields such as epidemiology (e.g. super spreaders
  44. \footnote{\href{https://en.wikipedia.org/w/index.php?title=Pareto_principle&oldid=967358099\#Other_applications}{Wikipedia(Pareto Principle)\#Other\_Applications} \cite{WikipediaParetoPrinciple} Superspreader: approximately 20\% of infected individuals are responsible for 80\% of transmissions \cite{Galvani2005}}
  45. and networking.
  46. \footnote{ \href{https://en.wikipedia.org/w/index.php?title=Pareto_distribution&oldid=967068451\#Occurrence_and_applications}{Wikipedia(Pareto\_Distribution)\#Occurence\_and\_applications} File Size Distribution in TCP traffic \cite{Reed2004}}
  47. (e.g. scale free networks \footnote{preferential attachment: "\href{https://arxiv.org/abs/cond-mat/9910332}{Emergence\ of\ scaling\ in\ random networks}" ((Barabasi1999)\cite{Barabasi1999})
  48. Square Root of Time Growth: \cite{Perc2014} } \cite{Crovella1997} \cite{Guadamuz2011}).
  49.  
  50. Such distributions are often charcterized by the \href{https://en.wikipedia.org/w/index.php?title=Pareto_principle&oldid=964003639}{80:20} rule (AKA Pareto Principle \cite{WikipediaParetoPrinciple}) and forces which lead to these types of distributions might be descibed as a "\href{https://en.wikipedia.org/w/index.php?title=Matthew_effect&oldid=962195433}{Mathew Effect}", which is analoges to the principle "The rich get richer and the poor get poorer".
  51.  
  52. Examples of the "Mathew Effect can be found in fields such as
  53. sociology (e.g. science funding
  54. \footnote{\href{https://en.wikipedia.org/w/index.php?title=Matthew_effect&oldid=962195433\#Examples}{Wikipedia(MathewEffect\#Examples} \cite{WikipediaMathewEffect} "\href{http://www.pnas.org/content/pnas/115/19/4887.full.pdf}{The Matthew Effect in Science Funding}" (Bol2018 \cite{Bol2018})})
  55.  and education (e.g. reading development \footnote{\href{https://en.wikipedia.org/w/index.php?title=Matthew_effect&oldid=962195433\#Examples}{Wikipedia(MathewEffect\#Examples} \cite{WikipediaMathewEffect} "Are There any Matthew Effects in Literacy and Cognitive Development?" \cite{Kempe2011}, "Beginning to Read: Thinking and Learning about Print" \cite{Adams1990}}).
  56.  
  57. \subsection{The CDF of the Pareto Distribution}
  58.  
  59. The survival function is a way to represent the non constant part of the CDF (cumulative distribution function). From this we can directly obtain the CDF of the Pareto distribution.  (\href{https://en.wikipedia.org/w/index.php?title=Survival_function&oldid=920310453#Definition}{wikipedia} \cite{wikipediaSurvivalFunction} \href{https://www.facebook.com/groups/280538506628903/permalink/281646936518060/}{fb}).
  60.  
  61. \begin{equation}
  62. F_X(x) = \begin{cases}
  63. 1-\left(\frac{x_\mathrm{m}}{x}\right)^\alpha & x \ge x_\mathrm{m}, \\
  64. 0 & x < x_\mathrm{m}.\label{eq:CDF_pareto}
  65. \end{cases}
  66. \end{equation}
  67.  
  68. However, the survival function is  more suitable for curve fitting than the CDF due to it's linearlity in log space and that the constantpart of the CDF is exact. In-fact the original law was originally developed by linear regression of the wealth distribution in log space. \cite{JulietteFournierSep2015} \cite{Persky1992}  (verify)
  69.  
  70. \subsection{Emperical Derivation of the Pareto Principle}
  71.  
  72. In logspace the Pareto distribution can be written in the following emperical form:
  73.  
  74. \begin{equation}
  75. log \, N = A - a \, log \, x \label{eg:LogSpaceParetoDistribution}
  76. \end{equation}
  77. where $N$ is the number of households which income is greater than $x$. If we are using the natural logarithm than for rotational convenience:
  78.  
  79. \begin{equation}
  80. C=e^A
  81. \end{equation}
  82.  
  83. $C$ is related to the scale parameter by normalizing
  84. \footnote{To normalize a distribugion we divide by the total quanity (e.g. $N(X_m)$) in order to obtain either a probability distribution or an estimate of the probability distribution}
  85. equation \eqref{eg:LogSpaceParetoDistribution} and solving for $X_m$. This yields:
  86.  
  87. \begin{equation}
  88. {A \over N(X_m)}=\left(X_m\right)^{\alpha}
  89. \end{equation}
  90.  
  91. where $Xm$ is the minimum value of $X$ and is typically called "The Scale Paramater" \cite{wikipediaSurvivalFunction}.
  92.  
  93. \subsection{Interpretation of the Scale Parameter ($X_m$) }
  94.  
  95. In the case where the Pareto distribution is used to model income then Xm might be thought of as the minimum income required to sustain a worker, and should include indirect income such as gifts, charity, subsidies.
  96.  
  97. Such indirect income could take monetary form, of some physical good or service (e.g. parental labour). For wealth one would need to convert the above effective income into a present value based on the time value of money. $Xm$ is known as the scale parameter. This is somewhat problematic because we don't know what a worker will earn in the future and the time value of money is variable based on context (e.g. credit score and earning potential.)
  98.  
  99. \section{Is the Pareto Distribution "Tail Heavy"?}
  100.  
  101. \subsection{The Moments of the Parato Distribution}
  102.  
  103. The Parato Distribution is defined for $\alpha>2$. This can be scene from it's probability density function:
  104.  
  105. \begin{equation}
  106. f_X(x)= \begin{cases} \frac{\alpha x_\mathrm{m}^\alpha}{x^{\alpha+1}} & x \ge x_\mathrm{m}, \\ 0 & x < x_\mathrm{m}. \end{cases}
  107. \end{equation}
  108.  
  109. which is a power law distribution . If we try to integrate this pdf (probability density function) at infinity convergence requires $\alpha>0$ and the origin it requires $\alpha<-1$
  110.  
  111. These two conditions can not be simultaneously true and this is why the Pareto distribution is defined in terms of the lower limit $Xm$.
  112.  
  113. Moreover, for the moments to be well defined $m < \alpha$, \cite{WikipediaPowerLaw} which means that that for the mean to be well defined $\alpha>1$
  114.  
  115. In general the moments of the Pareto distribution are expressed as:
  116.  
  117. \begin{equation}
  118. \langle x^{m} \rangle = \int_{xm}^{\infty} x^{m} p(x) dx = { \alpha \over \alpha - m } \left(x_m\right)^m, \; where \;\; m>\alpha
  119. \end{equation}
  120.  
  121. From which one can derive:
  122.  
  123. \begin{equation}
  124. {\displaystyle \operatorname {E} (X)={\begin{cases}\infty &\alpha \leq 1,\\{\frac {\alpha x_{\mathrm {m} }}{\alpha -1}}&\alpha >1.\end{cases}}}
  125. \end{equation}
  126.  
  127. and
  128. \begin{equation}
  129. {\displaystyle \operatorname {Var} (X)={\begin{cases}\infty &\alpha \in (1,2],\\\left({\frac {x_{\mathrm {m} }}{\alpha -1}}\right)^{2}{\frac {\alpha }{\alpha -2}}&\alpha >2.\end{cases}}}
  130. \end{equation}
  131.  
  132. \subsection{Typical values of $\alpha$ and the 80-20 rule}
  133.  
  134. Recall from the previous section for the Parato distribution to even converge $\alpha>1$ and for the mean to be well defined $\alpha>2$. Without some further limiting factor (e.g. exponential limiting), the Pareto will always be a bit tail heavy because there will be some limit on how high an order of central moments is defined.
  135.  
  136. Furthermore, not only are the higher order moments not guaranteed to be defined but even the first order moment is heavily tail dependent. Sometimes this is known as (Breaking the curve) where a few exceptionally high values can play a large role in the mean.
  137.  
  138. The rule of thumb for a Pareto distribution is that 20\% of all people receive 80\% of all income. As given on Wikipedia with this rule we have,
  139. \begin{equation}
  140. {\displaystyle \alpha_{(80-20)} =\log _{4}5={\cfrac {\log _{10}5}{\log _{10}4}}\approx 1.161}
  141. \end{equation}
  142.  
  143. as we will show later this number is close to what one might infer from Oxfam data for wealth.
  144.  
  145.  
  146. \subsection{Kurtosis}
  147.  
  148. Kurtosis plays an important role in determining how quickly various estimates of central moments coverage and is also a measure of how tail heavy a function is. The Kurtosis for the Pareto distribution is (\href{https://en.wikipedia.org/w/index.php?title=Pareto_distribution&oldid=965348211#Relation_to_the_\%22Pareto_principle\%22}{from wikipedia} \cite{WikipediaParetoDistribution} ):
  149.  
  150. \begin{equation}
  151. \text{Excess kurtosis}=\frac{6(\alpha^3+\alpha^2-6\alpha-2)}{\alpha(\alpha-3)(\alpha-4)}\text{ for }\alpha>4
  152. \end{equation}
  153.  
  154. The Pareto distribution has an Excess Kurtosis value which is greater than one. This type of distribution is referred to as \href{https://en.wikipedia.org/w/index.php?title=Kurtosis&oldid=965968832#Leptokurtic}{Leptokurtic} \cite{WikipediaKurtosis} and is characterized by a fatter tail. Other examples of such distibutions are  Student's t-distribution, Rayleigh distribution, Laplace distribution, Poisson distribution and the logistic distribution.
  155.  
  156. \section{Lorenz curve} \label{LorenzCurve}
  157.  
  158. The Lorenz Curve provides a good way to visualize inequality (\href{https://www.facebook.com/groups/280538506628903/permalink/285154029500684/}{faceook})(\href{https://en.wikipedia.org/w/index.php?title=Pareto_distribution&oldid=967068451#Lorenz_curve_and_Gini_coefficient}{wikipedia} \cite{WikipediaParetoDistribution} \cite{WikipediaLorenzCurve}).  
  159.  
  160. \includegraphics[width=0.9\textwidth]{ParetoLorenzSVG.png}
  161.  
  162. The formal definition is:
  163.  
  164. \begin{equation}
  165. L(F)=\frac{\int_{x_\mathrm{m}}^{x(F)}xf(x)\,dx}{\int_{x_\mathrm{m}}^\infty xf(x)\,dx} =\frac{\int_0^F x(F')\,dF'}{\int_0^1 x(F')\,dF'}
  166. \end{equation}
  167. where x(F) is the inverse of the CDF. The inverse of a PDF is known as a \cite{WikipediaQuantileFunction} (see section \ref{Sec_QuantileFunction})
  168.  
  169. The CDF is given in equation \eqref{eq:CDF_pareto} and has the following inverse.
  170.  
  171. \begin{equation}
  172. x(F)=\frac{x_\mathrm{m}}{(1-F)^{\frac{1}{\alpha}}} \label{eq:inv_cdf_pareto}
  173. \end{equation}
  174. where, $F(X)=P(x<X)$ and the Lorenz curve is therefore:
  175.  
  176. \begin{equation}
  177. L(F) = 1-(1-F)^{1-\frac{1}{\alpha}}, \label{eq:Lorenz_Curve}
  178. \end{equation}
  179.  
  180. rearranging:
  181.  
  182. \begin{equation}
  183. F=1-(1-L(F))^{\alpha \over (1-\alpha)}
  184. \end{equation}
  185.  
  186. From this we see that the variable $Y=(1-L(F))$ also has a survivale function which follows a power law. We can also differenate:
  187.  
  188. \begin{equation}
  189. f(L)=dF/dL={\alpha \over (1-\alpha)}(1-L(F))^{2 \alpha - 1 \over (1-\alpha)}  \label{eq:Lorenz_Curveasdf}
  190. \end{equation}
  191.  
  192. to get something like a pdf funciton in terms of the Lorenz value.
  193.  
  194. \section{The log-logistic Function and the Type II Pareto Distribution}
  195.  
  196. \subsection{Pareto Distributions Type I to Type IV}
  197. The Pareto distribution is a statement of the survival function. In this respect various functions are asymptotically equivalent to the Pareto function but differ for low values of the random variable.
  198.  
  199. \subsubsection{Type II Parato Distributions and the Lowmax Distribution}
  200.  
  201. Pareto Considered Several of these. The first of these is the Type II pareto distirbution (\href{https://en.wikipedia.org/w/index.php?title=Pareto_distribution&oldid=967068451#Pareto_types_I\%E2\%80\%93IV}{wikipedia}  \cite{WikipediaParetoDistribution} )(\href{https://www.facebook.com/groups/280538506628903/permalink/281084956574258/?comment_id=281090623240358}{fb}) wich reduces to the lowmax distribution (\href{https://en.wikipedia.org/w/index.php?title=Lomax_distribution&oldid=958008294#Characterization}{wikipedia}  \cite{WikipediaLomax} )(\href{https://www.facebook.com/groups/280538506628903/permalink/281084956574258/}{fb})  when the parameter $\mu=0$ is zero.
  202.  
  203. \begin{equation}
  204. {\displaystyle {\overline {F}}(x)=\Pr(X>x)=1-F(x) = \left[1+{\frac {x-\mu }{\sigma }}\right]^{-\alpha }}
  205. \end{equation}
  206.  
  207. the lomax distribution was referred to by Johnson \& Kotz (1970) \cite{Johnson1970} as a Pareto distribution of the second kind ( \href{https://www.facebook.com/groups/280538506628903/permalink/281081976574556/}{facebook} \cite{Clark1999}), which has the following probability mass function.
  208.  
  209. \begin{equation}
  210. {\displaystyle {\displaystyle p(x)={{\alpha \lambda ^{\alpha }} \over {(x+\lambda )^{\alpha +1}}}}={\alpha  \over \lambda }\left[{1+{x \over \lambda }}\right]^{-(\alpha +1)},\qquad x\geq 0,}
  211. \end{equation}
  212.  
  213. the mean for the Type II Pareto distribution is given by:
  214.  
  215. \begin{equation}
  216. E[X]=\frac{ \sigma }{\alpha-1}
  217. \end{equation}
  218.  
  219. and in general the central moments are:
  220.  
  221. \begin{equation}
  222. E[X^\delta]= \frac{ \sigma^\delta \Gamma(\alpha-\delta)\Gamma(1+\delta)}{\Gamma(\alpha)}
  223. \end{equation}
  224.  
  225.  
  226. where for positive integers (\href{https://en.wikipedia.org/w/index.php?title=Gamma_function&oldid=962235242}{wikipedia} \cite{WikipediaGammaFn}) the gamma function can be expressed as a factorial.
  227. \begin{equation}
  228. {\displaystyle \Gamma (n)=(n-1)!\ .}
  229. \end{equation}
  230.  
  231. \subsubsection{Type III \& IV Parato Distributions}
  232.  
  233. A type IV Parato Distribution can generalizes Types I through to III as follows:
  234.  
  235. \begin{equation}
  236. P(IV)(\sigma, \sigma, 1, \alpha) = P(I)(\sigma, \alpha),
  237. \end{equation}  
  238. \begin{equation}
  239. P(IV)(\mu, \sigma, 1, \alpha) = P(II)(\mu, \sigma, \alpha),
  240. \end{equation}  
  241. \begin{equation}
  242. P(IV)(\mu, \sigma, \gamma, 1) = P(III)(\mu, \sigma, \gamma).
  243. \end{equation}  
  244.  
  245. The survival function for the Type IV Pareto distribution is:
  246.  
  247. \begin{equation}
  248. {\displaystyle {\overline {F}}(x)=P(X>x)=1-F(x) = \left[1+\left({\frac {x-\mu }{\sigma }}\right)^{1/\gamma }\right]^{-\alpha }} \label{eq:TypeIVParetoSurvival}
  249. \end{equation}
  250. where, ${\displaystyle x\geq \mu }$ and $\mu \in R \;\;$ $\sigma, \gamma > 0, \alpha$ \newline
  251.  
  252. and has the following central moments
  253.  
  254. \begin{equation}
  255. E[X^\delta]= \frac{\sigma^\delta\Gamma(\alpha-\gamma \delta)\Gamma(1+\gamma \delta)}{\Gamma(\alpha)}
  256. \end{equation}
  257.  
  258. where $\alpha$ is the tail index, $\mu$ is location, $\sigma$ is scale, $\gamma$ is an inequality parameter.
  259.  
  260. \subsection{The Log-Logistic Distribution} \label{LogLogisticDist}
  261.  
  262. The cumulative distribution for the Type IV Pareto distribution can be written as:
  263.  
  264. \begin{equation}
  265. {\displaystyle F(x)=1-{\overline F}(x)=P(X<x)= 1-\left[1+\left({\frac {x-\mu }{\sigma }}\right)^{1/\gamma }\right]^{-\alpha }} \label{eq:GenLogLogDist}
  266. \end{equation}
  267. rearranging
  268. \begin{equation}
  269. {\displaystyle F(x)= \frac{\left[ \sigma^{1/\gamma} + \left(x-\mu\right)^{1/\gamma } \right]^{\alpha}}{\left[ \sigma^{1/\gamma} + \left(x-\mu\right)^{1/\gamma } \right]^{\alpha}}- {\sigma^{\alpha / \gamma} \over \left[ \sigma^{1/\gamma} + \left(x-\mu\right)^{1/\gamma } \right]^{\alpha} } }
  270. \end{equation}
  271.  
  272. and when $\alpha=1$ is close to one this is approximately
  273.  
  274. \begin{equation}
  275. {\displaystyle F(x)= \frac{\left(x-\mu\right)^{\beta }}{ \sigma^{\beta} + \left(x-\mu\right)^{\beta }}} \label{eq:LogLogisticPRIII_CDF}
  276. \end{equation}
  277. where, $\beta=\alpha/\gamma$ \newline
  278.  
  279. which when $\mu=0$ is the log-logistic distribution (\href{https://en.wikipedia.org/w/index.php?title=Log-logistic_distribution&oldid=943797276}{wikipedia} \cite{WikipediaLogLogisticDistribution} ).
  280.  
  281. \subsubsection{Alpha ($\alpha$) approximately equal to one is exact for Type III Pareto}
  282.  
  283. The above approximation $\alpha=1$ is exact for a "Type III" Pareto distribution.
  284.  
  285. \begin{equation}
  286. \overline{F}(x)=1-F(x)={\displaystyle \left[1+\left({\frac {x-\mu }{\sigma }}\right)^{1/\gamma }\right]^{-1}}
  287. \end{equation}
  288.  
  289. Also for large values of X the "\emph{Type IV Parato distribution}" (equation \eqref{eq:TypeIVParetoSurvival}) reduces to a "\emph{Type I Pareto distribution}". With $alpha=1$ then $\gamma$ is a free parameter to fit the tail behavior which is the same for Pareto Distributions of Types I to IV.
  290.  
  291. When both $\gamma=1$, $\sigma=1$ and  $\mu=0$ we get a special cases of both the lomax
  292. \footnote{If X has a Lomax distribution, then  $\frac {X}{\sigma }\sim \beta ^{\prime }(1,\sigma )$ (\href{https://en.wikipedia.org/w/index.php?title=Lomax_distribution&oldid=958008294\#Relation_to_the_beta_prime_distribution}{Wikipedia} \cite{WikipediaLomax} ) }
  293. and \href{https://en.wikipedia.org/wiki/Beta_prime_distribution}{beta prime distributions} and F(2,2) distribution.
  294. \footnote{The Lomax distribution with shape parameter $\alpha = 1$ and scale parameter $\sigma = 1$ has density $f(x)=\frac{1}{(1+x)^{2}}$, the same distribution as an \href{https://en.wikipedia.org/wiki/F-distribution}{F(2,2) distribution}. ( \href{https://en.wikipedia.org/w/index.php?title=Lomax_distribution&oldid=958008294\#Relation_to_the_F_distribution}{wikipedia} \cite{WikipediaLomax} )}.
  295.  
  296.  
  297.  
  298. \subsubsection{The Moments of the Log-Logistic Distribution}
  299.  
  300. The log-logistic distribution has the following central moments:
  301.  
  302. \begin{equation}
  303. \operatorname {E}(X)=\alpha b/\sin b,\quad \beta >1, \; b=\pi /\beta
  304. \end{equation}
  305. \begin{equation}
  306. \operatorname {Var}(X)=\alpha ^{2}\left(2b/\sin 2b-b^{2}/\sin ^{2}b\right),\quad \beta >2,  \; b=\pi /\beta
  307. \end{equation}
  308.  
  309. \section{Derivation of Log-Type Distributions}
  310.  
  311. The log-logistic distribution is the probability distribution of a random variable whose logarithm has a logistic distribution. In general we can consider a random variable of the form:
  312. \begin{equation}
  313. X=e^{\mu +\sigma Z}
  314. \end{equation}
  315.  
  316. Where Z is a random variable of a given type (e.g. logistic or normal) and X is a variable who is a distribution of that type. Stated formally:
  317.  
  318. \begin{equation}
  319. {\displaystyle \ln(X)\sim {f_X(X;\mu ,\sigma ^{2}).}}
  320. \end{equation}
  321.  
  322. and it follows:
  323.  
  324. \begin{equation}
  325. {\displaystyle {\begin{aligned}f_{X}(x)&={\frac {\rm {d}}{{\rm {d}}x}}\Pr(X\leq x)={\frac {\rm {d}}{{\rm {d}}x}}\Pr(\ln X\leq \ln x)={\frac {\rm {d}}{{\rm {d}}x}}\Phi \left({\frac {\ln x-\mu }{\sigma }}\right)\\[6pt]&=\varphi \left({\frac {\ln x-\mu }{\sigma }}\right){\frac {\rm {d}}{{\rm {d}}x}}\left({\frac {\ln x-\mu }{\sigma }}\right)=\varphi \left({\frac {\ln x-\mu }{\sigma }}\right){\frac {1}{\sigma x}}\\[6pt].\end{aligned}}}
  326. \end{equation}
  327.  
  328. and if $\phi(x)$ is a normal distribution then
  329. \begin{equation}
  330. f_{X}(x)={\frac {1}{x}}\cdot {\frac {1}{\sigma {\sqrt {2\pi \,}}}}\exp \left(-{\frac {(\ln x-\mu )^{2}}{2\sigma ^{2}}}\right)
  331. \end{equation}
  332.  
  333. alternatively if $\phi(x)$ is a logistic distribution then
  334.  
  335. \begin{equation}
  336. f(x;\alpha ,\beta )={\frac  {(\beta /\alpha )(x/\alpha )^{{\beta -1}}}{\left(1+(x/\alpha )^{{\beta }}\right)^{2}}}
  337. \end{equation}
  338.  
  339. \section{The Quantile Function} \label{Sec_QuantileFunction}
  340.  
  341. \subsection{The Type III Pareto is Essentially log-logistic but slightly more general}
  342. In section \ref{LogLogisticDist} we showed that the Type III Pareto distribution is equivalent to the log-logistic distribution (Eq \eqref{eq:LogLogisticPRIII_CDF} w/ $\mu=0$)  when $\mu=0$. Also when $\mu=0$ the type IV Pareto distribution (Equation \eqref{eq:TypeIVParetoSurvival} ) will converage to the log-logistic distribution as $\alpha$ approaches 1.
  343.  
  344. All types (i.e.Types I to IV) as well as the log-logistic distrtion will converge to the "\emph{Type I Pareto Distribution}" for large values of $X$. The Type III pareto distribution can be obtained by setting $\alpha=1$ in the Type IV pareto distbution and one can pick $\gamma$ to match the tail behavior of any Type I Pareto distribution.  
  345.  
  346. \subsection{The Quantile Function for the Type III Pareto Distribution}
  347.  
  348. For the following analysis with the cumulative distirbution function given in equation \eqref{eq:GenLogLogDist} since it is more general than the log-logistic distirubtion. We can invert this equation by solving for $X$ in terms of the value of the cumulative distribution function.
  349.  
  350. \begin{equation}
  351. x=\mu + \left[ {\sigma^\beta F(x) \over 1 - F(x) } \right]^{\left( 1/\beta\right) }=\mu + \sigma \left[ {F(x) \over 1 - F(x) } \right]^{\left( 1/\beta\right) }
  352. \end{equation} \label{eq:inv_cdf_paretoIII}
  353.  
  354. The result is the Quantile Function for the Type III Pareto distribution and if we set $\mu=0$ this is the Quantile Function for the log-logistic distribution (\href{https://en.wikipedia.org/w/index.php?title=Logistic_distribution&oldid=955853904#Quantile_function}{wikipedia} \cite{WikipediaQuantileFunction} )(\href{https://www.facebook.com/groups/280538506628903/permalink/280655966617157/}{facebook}).
  355.  
  356. \subsection{The Asymptotic Quantile Function For Types I \& III Parato Distributions}
  357.  
  358. The form of the Type III Pareto Distiribution Quantile Function \eqref{eq:inv_cdf_paretoIII} is noticeably different than the Type I Parto Distiribution Quantile Function (i.e. equation  \eqref{eq:inv_cdf_pareto}). The main distinguishing factor is the $F(x)$ in the numberator is not present in the Type I version of the Quantile Function.
  359.  
  360. The asymptotic similarity can be shown by using a new variable $\epsilon = 1-F(x)$. With this substitution \eqref{eq:inv_cdf_paretoIII} becomes:
  361.  
  362. \begin{equation}
  363. x=\mu + \sigma \left[ \frac{1}{\epsilon} -1 \right]^{\left( 1/\beta\right) }\cong \mu + \sigma\left[ \frac{1}{\epsilon} \right]^{\left( 1/\beta\right) }
  364. \end{equation} \label{eq:inv_cdf_paretoIIIapprox}
  365.  
  366. when both $\mu=0$ and $\sigma=(x_m)^{1/\beta}$ we get the same asymptotic result for both the types I and III Pareto distributions.
  367.  
  368. \section{The Isograph}
  369.  
  370. If we rearrange the Quantile Function for the type III Pareto distribution
  371.  
  372. \begin{equation}
  373. x^\prime=\frac{x-\mu}{\sigma}= \left[ {F(x) \over 1 - F(x) } \right]^{\left( 1/\beta\right)}
  374. \end{equation} \label{eq:inv_cdf_LogLogistic}
  375.  
  376. we get what looks like the Quantile function of the log-logistic distribution in terms of a new variable $x^\prime$. The parameter $\mu$ can be thought of as a minimum value and $\sigma$ can be thought of as a scale parameter.
  377.  
  378. If we take the natural logarithm of each side we get:
  379.  
  380. \begin{equation}
  381. ln(x^\prime)=ln \left( \frac{x-\mu}{\sigma} \right)= ln \left( \left[ {F(x) \over 1 - F(x) } \right]^{\left( 1/\beta\right)} \right)=\left( \frac{1}{\beta}\right)ln \left( \left[ {F(x) \over 1 - F(x) } \right] \right)
  382. \end{equation} \label{eq:inv_cdf_LogLogistic_logspace}
  383.  
  384. Using the natation of (Chauvel2014 \cite{Chauvel2014}), we can write this as:
  385. \begin{equation}
  386. \begin{aligned}
  387. & ln(m_i)=\alpha ln(p_i/(1-p_i)) \\
  388. & or \; M_i=\alpha X_i
  389. \end{aligned}
  390. \end{equation} \label{eq:LogitRankParetoChauvel}
  391.  
  392. which is still the log space representation of the log-logistic Quantile function and indirectly (via a change of variables) the Type III pareto distribution. This log-space form of the distibution is known as the  Champernowne-I–Fisk (CF), which can be written as $CF_\alpha$ or CF-I. The Champernowne-I–Fisk is a special case of a four parmater distribugion known as the Champernowne-II (1937) four-parameter distribution \cite{Chauvel2014} (Fisk (1961) \cite{Chauvel1961} )
  393.  
  394. Chauvel (2014 \cite{Chauvel2014}), replaced $\alpha$ by a function of $X_i$ so that both for very large and very small values of $X_i$ (i.e. the tails) the curve fit a pareto distribution and in the middle it matched the median. Or stated mathematically,
  395. \begin{equation}
  396. M_i=ISO(X_i) X_i
  397. \end{equation}
  398. and by definition the ISO graph is the average slope (i.e. $\alpha=ISO(X_i)=\frac{M_i}{X_i}$ ) of \eqref{eq:LogitRankParetoChauvel}. When the ISO graph is interpolated via equation \eqref{eq:AGBISO} then we will call this the ABG curve (for alpha, beta gamma) to be consistent with Chauvel 2014 \cite{Chauvel2014}. \newline
  399.  
  400. To provided a smooth transition between the tails and the median Chauvel (2014 \cite{Chauvel2014}) used hyperbolic tangent functions.
  401. \begin{equation}
  402. \theta_1(X)=tanh(X/2) \; and \; \theta_2(X)=tanh^2(X/2)
  403. \end{equation}
  404.  
  405. \includegraphics[width=0.7\textwidth]{Theta1and2_hyperbolicTangents.png}
  406.  
  407. both of these functions gradually increase in magnitude from zero. The difference and sums of each of these functions behave similar but only on one side of the Y axis and are zero on the opposite side. This can be used to gradually phase in a function on opposite sides of the y axis by defining the following parameters.
  408. \begin{equation}
  409. B(X)=\frac{\theta_1(X)+\theta_2(X)}{2} \; and \; G(X)=\frac{-\theta_1(X)+\theta_2(X)}{2}
  410. \end{equation}
  411.  
  412. We can now define an interpolating function for $ISO(X_i)$ as a linear combination of $1$, $(B(X_i)$ and %G(X_i)$ as follows:
  413.  
  414. \begin{equation}
  415. ISO(X_i)=\alpha+\beta B(X_i)+\gamma G(X_i) \label{eq:AGBISO}
  416. \end{equation}
  417. Which is a piece-wise fit to our there interpolation points (i.e. the median and both tails) using a smooth transition.
  418.  
  419.  
  420. \subsection{The Relation of B(X) and G(X) to AI Techniques}
  421.  
  422. B(X) and G(X) are like fuzzy numbers which represent wealth either greater than or less than the median respectively. Also the smooth transitional properties of the hyperbolic tangent make it a popular choice for a sigmoid function in neural networks.
  423.  
  424. \subsection{the log-logit rank and the median}
  425.  
  426. Equations \eqref{eq:inv_cdf_LogLogistic_logspace} or equivalently equation \eqref{eq:LogitRankParetoChauvel} in Chauvel's notation, maps the logit-rank of a variable to the ln of a related variable. When constructing the ISO graph this variable is typically the original variable divided by the median.
  427.  
  428. The median provides a common point to compare curves and also be dividing be the median there is the convenient property where the logarithm changes from positive to negative which facilities the previously discussed interpolation.
  429.  
  430. \subsection{Ex. log (Wealth Inequality) using the log-logit rank }
  431.  
  432. A rank is simply a way of sorting data. The log-logit rank provides a one to one continues from percentiles in a way that is linear for the Pareto distribution. For example we can use it to compare the wealth distributionin America between 2013 and 1992. The steeper slope in 2013 indicates more inequality.
  433.  
  434. \includegraphics[width=1.2\textwidth]{LogitWealth.png}  
  435.  
  436. \subsection{Ex. ISOgraphs }
  437.  
  438. The linearity in the previous graph shows that a Pareto type distribution is a good fit but doesn't show well the level of inequality at each income level. Such differences in inequality are better shown with the ISO graph and the plots of this graph also better show the differences between the tails and the median that we would get by trying to fit the exponent to a Pareto distirbution. The following figure is from Chauvel2014 \cite{Chauvel2014}
  439.  
  440. \includegraphics[width=1.2\textwidth]{ISOGraph_Examples}
  441.  
  442. \subsection{more stuff}
  443.  
  444.  
  445. The Isograph can be obtained by first subtracting $\mu$ from each side of equation \eqref{eq:inv_cdf_paretoIII} and then dividing by the median to yield a log-logit transformation of the Type III Pareto Distribution.
  446.  
  447. This should be s straight line with slope $(1/\beta)$ and intercept $\frac{\sigma}{\sigma_{median}}=\sigma^\prime$ \newline
  448.  
  449. As can be scene this log-logit transformation produces a faily straight line \cite{isographslide} \newline
  450.  
  451.  
  452.  
  453. Dividing the Y variable \cite{Mishra2017} \cite{Chauvel2018} we get the isograph, which is a constant when the curve is a Type III Pareto distribution. The deviation from this constant represents unexpected inequality within a given group. Typically the logrithm used for this graph is the natural logarithm. The isograph essentially shows where the Type III Pareto is not a good fit.
  454.  
  455. \section{The Quantile Function}
  456.  
  457.  
  458. \begin{thebibliography}{9}
  459. \bibitem{wikipediaSurvivalFunction}
  460. Wikipedia, Survival function,
  461. \url{https://en.wikipedia.org/w/index.php?title=Survival_function&oldid=920310453#Definition} (\href{https://www.facebook.com/groups/280538506628903/permalink/281646936518060/}{Facebook:281646936518060})
  462. \begin{verbatim}
  463. Breadcrumb:
  464. https://www.facebook.com/groups/280538506628903/permalink/281646936518060/\end{verbatim}
  465.  
  466. \bibitem{JulietteFournierSep2015}
  467. JulietteFournier Sep 2015, Generalized Pareto curves:Theory and application using income and inheritance tabulations for France 1901-2012, \url{http://piketty.pse.ens.fr/files/Fournier2015.pdf} (\href{https://www.facebook.com/groups/280538506628903/permalink/281658899850197/}{Facebook:281658899850197})
  468.  
  469.  
  470. \bibitem{Persky1992}
  471. Persky, J. (1992). Retrospectives: Pareto’s Law.Journal of Economic Perspectives, 6(2):181–192.
  472.  
  473. \bibitem{WikipediaPowerLaw} \url{https://en.wikipedia.org/w/index.php?title=Power_law&oldid=965150788#Power-law_probability_distributions}
  474.  
  475. \bibitem{WikipediaParetoDistribution}
  476. \url{https://en.wikipedia.org/w/index.php?title=Pareto_distribution&oldid=965348211#Relation_to_the_\%22Pareto_principle\%22}
  477.  
  478. \bibitem{WikipediaKurtosis}
  479. \url{https://en.wikipedia.org/w/index.php?title=Kurtosis&oldid=965968832#Leptokurtic}
  480.  
  481. \bibitem{WikipediaParetoPrinciple}
  482. \url{https://en.wikipedia.org/w/index.php?title=Pareto_principle&oldid=964003639}
  483.  
  484. \bibitem{WikipediaLorenzCurve}
  485. \url{https://en.wikipedia.org/w/index.php?title=Lorenz_curve&oldid=946106761}
  486.  
  487. \bibitem{WikipediaQuantileFunction}
  488. \url{https://en.wikipedia.org/w/index.php?title=Logistic_distribution&oldid=955853904#Quantile_function}
  489.  
  490. \bibitem{WikipediaLomax}
  491. \url{https://en.wikipedia.org/w/index.php?title=Lomax_distribution&oldid=958008294#Characterization}
  492.  
  493. \bibitem{Clark1999}
  494. R. M. Clark (1999), Generalizations of power-law distributions applicable to sampledfault-trace lengths: model choice, parameter estimation and caveats, Geophys. J. Int.(1999)136,357\^372
  495.  
  496. \bibitem{Johnson1970}
  497. Johnson, N.L. and Kotz (1970). Continuous Univariate Distributions I, Houghton Mi, New York
  498.  
  499. \bibitem{WikipediaGammaFn}
  500. Aswini Kumar Mishra, EXAMINING CHANGES IN THE LEVEL AND SHAPE OF INCOME DISTRIBUTIONS IN INDIA, 2005-2012  
  501. \url{https://en.wikipedia.org/w/index.php?title=Gamma_function&oldid=962235242}
  502.  
  503. \bibitem{isographslide}
  504. Slide 18 of \url{https://slideplayer.com/slide/14345914/}, Income and wealth distribution
  505.  
  506. \bibitem{Mishra2017}
  507. Aswini Kumar Mishra, EXAMINING CHANGES IN THE LEVEL AND SHAPE OF INCOME DISTRIBUTIONS IN INDIA, 2005-2012  
  508. pg 5 of \url{https://pdfs.semanticscholar.org/58c2/c262230b2a150a1d4c68d1806d9cbe5e7212.pdf} for isograph deffintion
  509.  
  510. \bibitem{Chauvel2018}
  511. Louis Chauvel (2018), Wealth as an Increasing Source of Inequality and Distortion in Income Groups
  512. pg 5 of \url{http://www.iariw.org/copenhagen/chauvel.pdf} for isograph deffintion
  513.  
  514. \bibitem{Chauvel2014}
  515. THE INTENSITY AND SHAPE OF INEQUALITY: THE ABG METHODOF DISTRIBUTIONAL ANALYSIS
  516. \url{https://www.gc.cuny.edu/CUNY_GC/media/LISCenter/2019\%20Inequality\%20by\%20the\%20Numbers/Instructor\%20Readings/Chauvel-1.pdf}
  517.  
  518. \bibitem{Chauvel1961}
  519. Fisk, P. R.,"The Graduation of Income Distributions," Econometrica, 29, 171–85,1961.
  520.  
  521. \bibitem{WikipediaMathewEffect}
  522. \url{https://en.wikipedia.org/w/index.php?title=Matthew_effect&oldid=962195433}
  523.  
  524. \bibitem{Crovella1997}
  525. Crovella, Mark E.; Bestavros, Azer (December 1997). \href{https://www.cs.bu.edu/~crovella/paper-archive/self-sim/journal-version.pdf}{Self-Similarity in World Wide Web Traffic}: Evidence and Possible Causes (PDF). IEEE/ACM Transactions on Networking. 5. pp. 835–846.
  526.  
  527. \bibitem{Galvani2005}
  528. Galvani, Alison P.; May, Robert M. (2005). "\href{https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7095140/}{Epidemiology: Dimensions of superspreading}". Nature. 438 (7066): 293–295. Bibcode:2005Natur.438..293G. doi:10.1038/438293a. PMC 7095140. PMID 16292292.
  529.  
  530. \bibitem{Bol2018}
  531. Bol, T.; de Vaan, M.; van de Rijt, A. (2018). "\href{http://www.pnas.org/content/pnas/115/19/4887.full.pdf}{The Matthew Effect in Science Funding}" (PDF). PNAS. 115 (19): 4887–4890. doi:10.1073/pnas.1719557115. PMC 5948972. PMID 29686094.
  532.  
  533. \bibitem{Reed2004}
  534. Reed, William J.; et al. (2004). "The Double Pareto-Lognormal Distribution – A New Parametric Model for Size Distributions". Communications in Statistics – Theory and Methods. 33 (8): 1733–53. CiteSeerX 10.1.1.70.4555. doi:10.1081/sta-120037438.
  535.  
  536. \bibitem{Barabasi1999}
  537. Barabási, A-L; Albert, R (1999). "Emergence of scaling in random networks". Science. 286 (5439): 509–512. arXiv:\href{https://arxiv.org/abs/cond-mat/9910332}{cond\-mat\/9910332}. Bibcode:1999Sci...286..509B. doi:10.1126/science.286.5439.509. PMID 10521342.
  538.  
  539. \bibitem{Perc2014}
  540. Perc, Matjaž (2014). "The Matthew effect in empirical data". Journal of the Royal Society Interface. 12 (104): 20140378. arXiv:1408.5124. Bibcode:2014arXiv1408.5124P. doi:10.1098/rsif.2014.0378. PMC 4233686. PMID 24990288.
  541.  
  542. \bibitem{Guadamuz2011}
  543. Guadamuz, Andres (2011). Networks, Complexity And Internet Regulation – Scale-Free Law. Edward Elgar. ISBN 9781848443105.
  544.  
  545. \bibitem{Kempe2011}
  546. Kempe, C., Eriksson‐Gustavsson, A. L., \& Samuelsson, S (2011). "Are There any Matthew Effects in Literacy and Cognitive Development?". Scandinavian Journal of Educational Research. 55 (2): 181–196. doi:10.1080/00313831.2011.554699.
  547.  
  548. \bibitem{Adams1990}
  549. Adams, Marilyn J. (1990). Beginning to Read: Thinking and Learning about Print. Cambridge, MA: MIT Press. pp. 59–60.
  550.  
  551. \bibitem{WikipediaShapeParameter}
  552. \url{https://en.wikipedia.org/w/index.php?title=Shape_parameter&oldid=952709345}
  553.  
  554.  
  555. \bibitem{WikipediaLogLogisticDistribution}
  556. \url{https://en.wikipedia.org/w/index.php?title=Log-logistic_distribution&oldid=943797276}
  557.  
  558. \bibitem{einstein}
  559. Albert Einstein.
  560. \textit{Zur Elektrodynamik bewegter K{\"o}rper}. (German)
  561. [\textit{On the electrodynamics of moving bodies}].
  562. Annalen der Physik, 322(10):891–921, 1905.
  563.  
  564.  
  565. \bibitem{knuthwebsite}
  566. Knuth: Computers and Typesetting,
  567. \\\texttt{http://www-cs-faculty.stanford.edu/\~{}uno/abcde.html}
  568. \end{thebibliography}
  569.  
  570.  
  571. \end{document}
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement