Why is this estimator biased?












2












$begingroup$


$X_{1},X_{2},..,X_{n}$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^{-mu}$ is $hat theta =e^{-bar x}$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias







share|cite|improve this question









$endgroup$








  • 6




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    Mar 22 at 20:54












  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    Mar 22 at 21:01
















2












$begingroup$


$X_{1},X_{2},..,X_{n}$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^{-mu}$ is $hat theta =e^{-bar x}$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias







share|cite|improve this question









$endgroup$








  • 6




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    Mar 22 at 20:54












  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    Mar 22 at 21:01














2












2








2


2



$begingroup$


$X_{1},X_{2},..,X_{n}$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^{-mu}$ is $hat theta =e^{-bar x}$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias







share|cite|improve this question









$endgroup$




$X_{1},X_{2},..,X_{n}$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^{-mu}$ is $hat theta =e^{-bar x}$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias




estimation poisson-distribution bias






share|cite|improve this question













share|cite|improve this question











share|cite|improve this question




share|cite|improve this question










asked Mar 22 at 20:47









QualityQuality

30019




30019








  • 6




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    Mar 22 at 20:54












  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    Mar 22 at 21:01














  • 6




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    Mar 22 at 20:54












  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    Mar 22 at 21:01








6




6




$begingroup$
E[f(X)] != f(E[X]) in general.
$endgroup$
– The Laconic
Mar 22 at 20:54






$begingroup$
E[f(X)] != f(E[X]) in general.
$endgroup$
– The Laconic
Mar 22 at 20:54














$begingroup$
I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
$endgroup$
– Quality
Mar 22 at 21:01




$begingroup$
I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
$endgroup$
– Quality
Mar 22 at 21:01










2 Answers
2






active

oldest

votes


















5












$begingroup$

Recall that the moment generating function of $X sim operatorname{Poisson}(mu)$ is
$$
E[e^{s X}] = exp(mu(e^s - 1))
$$
for all $s in mathbb{R}$



Proof.
We just compute:
$$
begin{aligned}
E[e^{s X}]
&= sum_{k=0}^infty e^{s k} e^{-mu} frac{mu^k}{k!} \
&= e^{-mu} sum_{k=0}^infty frac{left(mu e^sright)^k}{k!} \
&= e^{-mu} e^{mu e^s} \
&= exp(mu(e^s - 1)).
end{aligned}
$$
We will use this result with $s = -1/n$.



If $X_1, ldots, X_n sim operatorname{Poisson}(mu)$ are i.i.d. and
$$
widehat{theta}
= expleft(-frac{1}{n} sum_{i=1}^n X_iright)
= prod_{i=1}^n expleft(-frac{X_i}{n}right),
$$
then, using independence,
$$
begin{aligned}
E[widehat{theta}]
&= prod_{i=1}^n Eleft[e^{-X_i / n}right] \
&= prod_{i=1}^n exp(mu(e^{-1/n} - 1)) \
&= exp(n mu(e^{-1/n} - 1)) \
&neq e^{-mu},
end{aligned}
$$
so $widehat{theta}$ is not an unbiased estimator of $e^{-mu}$






share|cite|improve this answer









$endgroup$













  • $begingroup$
    Thank you, makes perfect sense
    $endgroup$
    – Quality
    Mar 22 at 21:16



















6












$begingroup$

As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



$$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



, provided the expectations exist.



Verify that $g(x)=e^{-x}$ is a convex function from the fact that $g''>0$.



The equality does not hold because $g$ is not an affine function or a constant function.






share|cite|improve this answer









$endgroup$














    Your Answer





    StackExchange.ifUsing("editor", function () {
    return StackExchange.using("mathjaxEditing", function () {
    StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
    StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
    });
    });
    }, "mathjax-editing");

    StackExchange.ready(function() {
    var channelOptions = {
    tags: "".split(" "),
    id: "65"
    };
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function() {
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled) {
    StackExchange.using("snippets", function() {
    createEditor();
    });
    }
    else {
    createEditor();
    }
    });

    function createEditor() {
    StackExchange.prepareEditor({
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: false,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: null,
    bindNavPrevention: true,
    postfix: "",
    imageUploader: {
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    },
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    });


    }
    });














    draft saved

    draft discarded


















    StackExchange.ready(
    function () {
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f398954%2fwhy-is-this-estimator-biased%23new-answer', 'question_page');
    }
    );

    Post as a guest















    Required, but never shown

























    2 Answers
    2






    active

    oldest

    votes








    2 Answers
    2






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    5












    $begingroup$

    Recall that the moment generating function of $X sim operatorname{Poisson}(mu)$ is
    $$
    E[e^{s X}] = exp(mu(e^s - 1))
    $$
    for all $s in mathbb{R}$



    Proof.
    We just compute:
    $$
    begin{aligned}
    E[e^{s X}]
    &= sum_{k=0}^infty e^{s k} e^{-mu} frac{mu^k}{k!} \
    &= e^{-mu} sum_{k=0}^infty frac{left(mu e^sright)^k}{k!} \
    &= e^{-mu} e^{mu e^s} \
    &= exp(mu(e^s - 1)).
    end{aligned}
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatorname{Poisson}(mu)$ are i.i.d. and
    $$
    widehat{theta}
    = expleft(-frac{1}{n} sum_{i=1}^n X_iright)
    = prod_{i=1}^n expleft(-frac{X_i}{n}right),
    $$
    then, using independence,
    $$
    begin{aligned}
    E[widehat{theta}]
    &= prod_{i=1}^n Eleft[e^{-X_i / n}right] \
    &= prod_{i=1}^n exp(mu(e^{-1/n} - 1)) \
    &= exp(n mu(e^{-1/n} - 1)) \
    &neq e^{-mu},
    end{aligned}
    $$
    so $widehat{theta}$ is not an unbiased estimator of $e^{-mu}$






    share|cite|improve this answer









    $endgroup$













    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      Mar 22 at 21:16
















    5












    $begingroup$

    Recall that the moment generating function of $X sim operatorname{Poisson}(mu)$ is
    $$
    E[e^{s X}] = exp(mu(e^s - 1))
    $$
    for all $s in mathbb{R}$



    Proof.
    We just compute:
    $$
    begin{aligned}
    E[e^{s X}]
    &= sum_{k=0}^infty e^{s k} e^{-mu} frac{mu^k}{k!} \
    &= e^{-mu} sum_{k=0}^infty frac{left(mu e^sright)^k}{k!} \
    &= e^{-mu} e^{mu e^s} \
    &= exp(mu(e^s - 1)).
    end{aligned}
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatorname{Poisson}(mu)$ are i.i.d. and
    $$
    widehat{theta}
    = expleft(-frac{1}{n} sum_{i=1}^n X_iright)
    = prod_{i=1}^n expleft(-frac{X_i}{n}right),
    $$
    then, using independence,
    $$
    begin{aligned}
    E[widehat{theta}]
    &= prod_{i=1}^n Eleft[e^{-X_i / n}right] \
    &= prod_{i=1}^n exp(mu(e^{-1/n} - 1)) \
    &= exp(n mu(e^{-1/n} - 1)) \
    &neq e^{-mu},
    end{aligned}
    $$
    so $widehat{theta}$ is not an unbiased estimator of $e^{-mu}$






    share|cite|improve this answer









    $endgroup$













    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      Mar 22 at 21:16














    5












    5








    5





    $begingroup$

    Recall that the moment generating function of $X sim operatorname{Poisson}(mu)$ is
    $$
    E[e^{s X}] = exp(mu(e^s - 1))
    $$
    for all $s in mathbb{R}$



    Proof.
    We just compute:
    $$
    begin{aligned}
    E[e^{s X}]
    &= sum_{k=0}^infty e^{s k} e^{-mu} frac{mu^k}{k!} \
    &= e^{-mu} sum_{k=0}^infty frac{left(mu e^sright)^k}{k!} \
    &= e^{-mu} e^{mu e^s} \
    &= exp(mu(e^s - 1)).
    end{aligned}
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatorname{Poisson}(mu)$ are i.i.d. and
    $$
    widehat{theta}
    = expleft(-frac{1}{n} sum_{i=1}^n X_iright)
    = prod_{i=1}^n expleft(-frac{X_i}{n}right),
    $$
    then, using independence,
    $$
    begin{aligned}
    E[widehat{theta}]
    &= prod_{i=1}^n Eleft[e^{-X_i / n}right] \
    &= prod_{i=1}^n exp(mu(e^{-1/n} - 1)) \
    &= exp(n mu(e^{-1/n} - 1)) \
    &neq e^{-mu},
    end{aligned}
    $$
    so $widehat{theta}$ is not an unbiased estimator of $e^{-mu}$






    share|cite|improve this answer









    $endgroup$



    Recall that the moment generating function of $X sim operatorname{Poisson}(mu)$ is
    $$
    E[e^{s X}] = exp(mu(e^s - 1))
    $$
    for all $s in mathbb{R}$



    Proof.
    We just compute:
    $$
    begin{aligned}
    E[e^{s X}]
    &= sum_{k=0}^infty e^{s k} e^{-mu} frac{mu^k}{k!} \
    &= e^{-mu} sum_{k=0}^infty frac{left(mu e^sright)^k}{k!} \
    &= e^{-mu} e^{mu e^s} \
    &= exp(mu(e^s - 1)).
    end{aligned}
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatorname{Poisson}(mu)$ are i.i.d. and
    $$
    widehat{theta}
    = expleft(-frac{1}{n} sum_{i=1}^n X_iright)
    = prod_{i=1}^n expleft(-frac{X_i}{n}right),
    $$
    then, using independence,
    $$
    begin{aligned}
    E[widehat{theta}]
    &= prod_{i=1}^n Eleft[e^{-X_i / n}right] \
    &= prod_{i=1}^n exp(mu(e^{-1/n} - 1)) \
    &= exp(n mu(e^{-1/n} - 1)) \
    &neq e^{-mu},
    end{aligned}
    $$
    so $widehat{theta}$ is not an unbiased estimator of $e^{-mu}$







    share|cite|improve this answer












    share|cite|improve this answer



    share|cite|improve this answer










    answered Mar 22 at 21:12









    Artem MavrinArtem Mavrin

    1,211710




    1,211710












    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      Mar 22 at 21:16


















    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      Mar 22 at 21:16
















    $begingroup$
    Thank you, makes perfect sense
    $endgroup$
    – Quality
    Mar 22 at 21:16




    $begingroup$
    Thank you, makes perfect sense
    $endgroup$
    – Quality
    Mar 22 at 21:16













    6












    $begingroup$

    As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



    $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



    , provided the expectations exist.



    Verify that $g(x)=e^{-x}$ is a convex function from the fact that $g''>0$.



    The equality does not hold because $g$ is not an affine function or a constant function.






    share|cite|improve this answer









    $endgroup$


















      6












      $begingroup$

      As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



      $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



      , provided the expectations exist.



      Verify that $g(x)=e^{-x}$ is a convex function from the fact that $g''>0$.



      The equality does not hold because $g$ is not an affine function or a constant function.






      share|cite|improve this answer









      $endgroup$
















        6












        6








        6





        $begingroup$

        As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



        $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



        , provided the expectations exist.



        Verify that $g(x)=e^{-x}$ is a convex function from the fact that $g''>0$.



        The equality does not hold because $g$ is not an affine function or a constant function.






        share|cite|improve this answer









        $endgroup$



        As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



        $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



        , provided the expectations exist.



        Verify that $g(x)=e^{-x}$ is a convex function from the fact that $g''>0$.



        The equality does not hold because $g$ is not an affine function or a constant function.







        share|cite|improve this answer












        share|cite|improve this answer



        share|cite|improve this answer










        answered Mar 22 at 21:16









        StubbornAtomStubbornAtom

        2,8621532




        2,8621532






























            draft saved

            draft discarded




















































            Thanks for contributing an answer to Cross Validated!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid …



            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.


            Use MathJax to format equations. MathJax reference.


            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f398954%2fwhy-is-this-estimator-biased%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            -

            Popular posts from this blog

            "Incorrect syntax near the keyword 'ON'. (on update cascade, on delete cascade,)

            Image
            .everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ height:90px;width:728px;box-sizing:border-box; } 2 total noob sorry any help greatly appreciated. I keep getting this "Incorrect syntax near the keyword 'ON'." heres my codes code one CREATE TABLE supplier ( supplierID INT PRIMARY KEY, ISBN INT FOREIGN KEY REFERENCES book(ISBN), price DECIMAL (5,2), ON UPDATE CASCADE, ON DELETE CASCADE, ); code two CREATE TABLE orders ( orderID INT PRIMARY KEY, customerID INT FOREIGN KEY REFERENCES customer(customerID), ISBN INT FOREIGN KEY REFERENCES book(ISBN), orderDate date, ON UPDATE CASCADE, ON DELETE CASCADE, ); Ive run out of stuff to try other than dumbing it down to uselessness.
            Read more

            Alcedinidae

            Image
            Alcedinidae Martin-pêcheur à dos bleu ( Alcedo azurea ) Classification (COI) Règne Animalia Embranchement Chordata Sous-embr. Vertebrata Classe Aves Ordre Coraciiformes Famille Alcedinidae Rafinesque, 1815 Les Alcédinidés ou Alcedinidae forment une famille d'oiseaux plus connus sous les noms de martins-pêcheurs et martins-chasseurs. Sommaire 1 Description 2 Répartition et habitat 3 Systématique 3.1 Liste alphabétique des genres 3.2 Liste des espèces 4 Chez les Anciens : l'alcyon 4.1 Étymologie (Littré) 4.2 Oiseau « fabuleux » ? 5 Notes 6 Articles connexes 7 Liens externes 7.1 Bibliographie Description | Ce sont des oiseaux compacts de taille petite à moyenne (10 à 46 cm), au bec droit et long, en forme de poignard. Leurs pattes sont courtes, et ils portent un plumage aux couleurs vives. Répartition et habitat | Cosmopolites, ils fréquentent surtout
            Read more

            RAC Tourist Trophy

            Image
            Pour les articles homonymes, voir Tourist Trophy. Le RAC Tourist Trophy est une course automobile organisée par le Royal Automobile Club d'Angleterre. Créée en 1905, cette course a fait partie des épreuves comptant pour le championnat du monde des voitures de sport entre 1953 et 1955, en 1958 et 1959, et entre 1962 et 1965. Après une interruption de 17 ans (l'épreuve s'arrête après 1988), le RAC Tourist Trophy reprend en 2005 sous l'égide de la FIA GT. Palmarès | John Napier sur Arrol-Johnston, vainqueur du premier RAC Tourist Trophy, en 1905. L'honorable C.S. Rolls, vainqueur du RAC Tourist Trophy 1906. Ernest Curtis, sur Rover 20 hp, vainqueur du RAC Tourist Trophy 1907. William Watson, vainqueur du RAC Tourist Trophy 1908. Kenelm Lee Guinness, vainqueur du RAC Tourist Trophy 1914 sur Sunbeam. Départ du RAC Tourist Trophy 1928. Louis Gérard, vainqueur du RAC Tourist Trophy 1938 sur Delage. Année Circuit Vainqueur
            Read more