From: aaronshaw Date: Wed, 7 Oct 2020 15:56:27 +0000 (-0500) Subject: initial commit of ch4 exercise solutions X-Git-Url: https://code.communitydata.science/stats_class_2020.git/commitdiff_plain/9fe7d4d5dbb837c15d092d00d95621a7315abddd?ds=sidebyside initial commit of ch4 exercise solutions --- diff --git a/os_exercises/ch4_exercises_solutions.html b/os_exercises/ch4_exercises_solutions.html new file mode 100644 index 0000000..faf1fd5 --- /dev/null +++ b/os_exercises/ch4_exercises_solutions.html @@ -0,0 +1,1687 @@ + + + + + + + + + + + + + + + +Chapter 4 Textbook exercises + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+ + + +
+
+
+
+
+ +
+ + + + + + + +

All exercises taken from the OpenIntro Statistics textbook, \(4^{th}\) edition, Chapter 4.

+
+

4.4 Triathlons

+
    +
  1. Let \(M\) denote the finishing times of Men, Ages 30 - 34 and \(W\) denote the finishing times of Women, Ages 25 - 29. Then,
    2. +
+

\[M ∼ N (μ = 4313, σ = 583)\] \[W ∼ N (μ = 5261, σ = 807)\]

+
    +

  1. Recall that Z-scores are a standardization: for a given value of a random variable you subtract the mean of the corresponding distribution from the value and divide by the standard deviation. The formula notation is given in the OpenIntro textbook.

    +

    Let’s let R calculate it for us:

    +
    ## Mary
+(5513 - 5261) / 807
    +
    ## [1] 0.3122677
    +
    ## Leo:
+(4948 - 4313) / 583
    +
    ## [1] 1.089194
    +

    Since the Z score tells you how many standard deviation units above/below the mean each value is, we can see that Mary finished 0.31 standard deviations above the mean in her category while Leo finished 1.09 standard deviations above the mean in his.

    2. +

  2. Mary finished in a much faster time with respect to her reference group. Her time was fewer standard deviation units above the mean, implying that a larger proportion of the distribution had higher (slower) race times.

    3. +

  3. Note that the question is asking about the area under the distribution to the right (greater than) of Leo’s race time. Using the Z-score table (Appendix C.1) in the book, we can see that Leo finished faster than approximately \(1-0.86 = .14\) or \(14\%\) of his reference group. This corresponds the probability \(P(Z >1.09)\) for a normal distribution. You could also use R to calculate this (note that the OpenIntro reading introduced the pnorm() function on p.136):

    +
    1-pnorm(1.09)
    +
    ## [1] 0.1378566
    4. +

  4. Again, this is about calculating the area under the distribution ot the right (greater than) Mary’s race time. Mary finished faster than approximately \(1-0.62 = .38\) or \(38\%\) of her category. This corresponds to the probability \(P(Z >0.31)\) for a normal distribution. Again, here’s how you could find that using R:

    +
    1-pnorm(0.31)
    +
    ## [1] 0.3782805
    5. +

  5. The answer for part b would not change as standardized values (Z-scores) can be computed for any distribution. However, the interpretation and percentile calculations (parts c-e) would be different because they all presume a normal distribution.

    6. +
+
+
+

4.6 More triathlons

+
    +

  1. The fastest \(5\%\) are the \(5^{th}\) percentile of the distribution. Using the Appendix C.1 table again, the Z score corresponding to the \(5^{th}\) percentile of the normal distribution is approximately -1.65. You can find this value more precisely in R using the qnorm() function (more on this in the Week 5 R tutorial):

    +
    qnorm(.05)
    +
    ## [1] -1.644854
    +

    Once you have that, you can plug it into the Z score formula and calculate the cutoff time (\(x\)): \[Z = −1.64 = \frac{x − 4313}{583} → x = −1.64 × 583 + 4313 = 3357~seconds\] Note that the solution there is in seconds. If you divide that by 60 it looks like the fastest \(5\%\) of males in this age group finished in a little bit less than 56 minutes or less.

    2. +

  2. The slowest \(10\%\) are in the \(90^{th}\) percentile of the distribution. The Z score corresponding to the \(90^{th}\) percentile of the normal distribution is approximately 1.28. Again, here’s that calculation in R:

    +
    qnorm(.9)
    +
    ## [1] 1.281552
    +

    Then put it all together again to calculate the cutoff: \[Z = 1.28 = \frac{x-5261}{807} → x = 1.28 \times 807 + 5261 = 6294 ~seconds\] Divide that by 60 and it looks like the slowest \(10\%\) of females in this age group finished in about 1 hour 45 minutes or more.

    3. +
+
+
+

4.22 Arachnophobia

+

This question focuses on applying the knowledge from section 4.3 of the textbook on binomial distributions. Our old friend the binomial coefficient comes in quite handy…

+
    +

  1. Recall from the birthday problems that a binomial probability of “at least one” successful trial can also be thought of as “one minus the probability of none.” With this in hand, you can start to plug values into the formula for the probability of observing \(k\) successess out of \(n\) independent binomial trials given on p. 150. \[P(at~least~1~arachnophobe)=1-P(none)\]
    +\[1-P(none)=1-{10 \choose 0}0.07^{0}(1-0.07)^{10-0}\]
    +Let’s let R handle the arithmetic:

    +
    1-(choose(10,0)*1*(.93^10))
    +
    ## [1] 0.5160177
    2. +

  2. This one just requires you to plug a different value for \(n\) into the same formula: \[P(2~arachnophobes)={10 \choose 2}0.07^2(1-0.07)^{(10-2)}\]

    +
    choose(10,2)*0.07^2*0.93^8
    +
    ## [1] 0.1233878
    3. +

  3. You can think of the probability of “at most one” success in a binomial trial as equal to the sum of the probability of two potential outcomes: zero or one. \[P(\leq1~arachnophobes)=P(none)+P(one)\]
    +Off to the races with our same formula again: \[{10 \choose 0}0.07^00.93^{10}+{10 \choose 1}0.07^1 0.93^9\] And R can solve that quickly:

    +
    (choose(10,0)*1*(.93^10))+(choose(10,1)*0.07*(0.93^9))
    +
    ## [1] 0.8482701
    4. +

  4. The question asks us to calculate whether random assignment to tents is likely to ensure \(\leq1~arachnophobe\) per tent. We can think about this as a slight twist on the result we calculated for part c above. Specifically, the answer to part c is the complementary probability of the outcome we’re looking to avoid in this case (more than 1 arachnophobe per tent). In more formal notation:
    +\[P(>1~arachnophobe) = 1-P(\leq1~arachnophobe)\] \[P(>1~arachnophobe) = 1-0.84 = 0.16 = 16\%\]
    +That covers the probability of multiple arachnophobes per tent, but as to whether or not it seems “reasonable” to randomly assign the teenagers to tents given this probability, the \(16\%\) result cannot answer that part of the question. Making a decision based on a probability is an entirely separate issue! On the one hand, the probability of a bad outcome is not huge, but the decision should really depend on how heavily the counselor weighs the negative potential outcome given a \(16\%\) chance of having multiple arachnophobic campers in one of the tents. The question makes it sound like the counselor “wants to make sure” there’s not a critical mass of arachnophobes in any one tent, so a \(16\%\) probability of failure implies that they should not use random assignment. Indeed, if the camp counselor has taken a statistics course, they might consider any probability of failure greater than \(5\%\) as unacceptably high, but this assumes a pretty sophisticated and risk-averse camp counselor (who, let’s be honest, is probably a teenager themselves with an under-developed prefrontal cortex and therefore highly unikely to base their decision on a mathematical and risk-averse assessment of the underlying probabilities). Personally, I can’t even pretend to understand teenage decision-making and the idea that the counselor’s actions would have any relationship to discrete calculations of probabilities is laughable. Who assigns these questions anyway?

    5. +
+
+ + + +
+
+ +
+ + + + + + + + + + + + + + + + diff --git a/os_exercises/ch4_exercises_solutions.pdf b/os_exercises/ch4_exercises_solutions.pdf new file mode 100644 index 0000000..f41e68d Binary files /dev/null and b/os_exercises/ch4_exercises_solutions.pdf differ diff --git a/os_exercises/ch4_exercises_solutions.rmd b/os_exercises/ch4_exercises_solutions.rmd new file mode 100644 index 0000000..eca3d99 --- /dev/null +++ b/os_exercises/ch4_exercises_solutions.rmd @@ -0,0 +1,116 @@ +--- +title: "Chapter 4 Textbook exercises" +subtitle: "Solutions to even-numbered questions \nStatistics and statistical programming \nNorthwestern University \nMTS + 525" +author: "Aaron Shaw" +date: "October 7, 2020" +output: + html_document: + toc: yes + toc_depth: 3 + toc_float: + collapsed: false + smooth_scroll: true + theme: readable + pdf_document: + toc: yes + toc_depth: '3' + latex_engine: xelatex +header-includes: + - \newcommand{\lt}{<} + - \newcommand{\gt}{>} +--- + +```{r setup, include=FALSE} +knitr::opts_chunk$set(echo = TRUE) + +``` + + + +All exercises taken from the *OpenIntro Statistics* textbook, $4^{th}$ edition, Chapter 4. + +### 4.4 Triathlons + +(a) Let $M$ denote the finishing times of *Men, Ages 30 - 34* and $W$ denote the finishing times of *Women, Ages 25 - 29*. Then, + +$$M ∼ N (μ = 4313, σ = 583)$$ +$$W ∼ N (μ = 5261, σ = 807)$$ + + +(b) Recall that Z-scores are a standardization: for a given value of a random variable you subtract the mean of the corresponding distribution from the value and divide by the standard deviation. The formula notation is given in the *OpenIntro* textbook. + + Let's let R calculate it for us: + ```{r} + ## Mary + (5513 - 5261) / 807 + + ## Leo: + (4948 - 4313) / 583 + ``` + Since the Z score tells you how many standard deviation units above/below the mean each value is, we can see that Mary finished 0.31 standard deviations above the mean in her category while Leo finished 1.09 standard deviations above the mean in his. + +(c) Mary finished in a much faster time with respect to her reference group. Her time was fewer standard deviation units above the mean, implying that a larger proportion of the distribution had higher (slower) race times. + +(d) Note that the question is asking about the area under the distribution to the right (greater than) of Leo's race time. Using the Z-score table (Appendix C.1) in the book, we can see that Leo finished *faster* than approximately $1-0.86 = .14$ or $14\%$ of his reference group. This corresponds the probability $P(Z \gt 1.09)$ for a normal distribution. You could also use R to calculate this (note that the *OpenIntro* reading introduced the `pnorm()` function on p.136): + ```{r} + 1-pnorm(1.09) + ``` + +(e) Again, this is about calculating the area under the distribution ot the right (greater than) Mary's race time. Mary finished *faster* than approximately $1-0.62 = .38$ or $38\%$ of her category. This corresponds to the probability $P(Z \gt 0.31)$ for a normal distribution. Again, here's how you could find that using R: + ```{r} + 1-pnorm(0.31) + ``` +(f) The answer for part b would not change as standardized values (Z-scores) can be computed for any distribution. However, the interpretation and percentile calculations (parts c-e) *would* be different because they all presume a normal distribution. + + +### 4.6 More triathlons + +(a) The fastest $5\%$ are the $5^{th}$ percentile of the distribution. Using the Appendix C.1 table again, the Z score corresponding to the $5^{th}$ percentile of the normal distribution is approximately -1.65. You can find this value more precisely in R using the `qnorm()` function (more on this in the [Week 5 R tutorial](https://communitydata.science/~ads/teaching/2020/stats/r_tutorials/w05-R_tutorial.html)): + ```{r} + qnorm(.05) + ``` + Once you have that, you can plug it into the Z score formula and calculate the cutoff time ($x$): +$$Z = −1.64 = \frac{x − 4313}{583} → x = −1.64 × 583 + 4313 = 3357~seconds$$ + Note that the solution there is in seconds. If you divide that by 60 it looks like the fastest $5\%$ of males in this age group finished in a little bit less than 56 minutes *or less*. + +(b) The slowest $10\%$ are in the $90^{th}$ percentile of the distribution. The Z score corresponding to the $90^{th}$ percentile of the normal distribution is approximately 1.28. Again, here's that calculation in R: + ```{r} + qnorm(.9) + ``` + Then put it all together again to calculate the cutoff: + $$Z = 1.28 = \frac{x-5261}{807} → x = 1.28 \times 807 + 5261 = 6294 ~seconds$$ + Divide that by 60 and it looks like the slowest $10\%$ of females in this age group finished in about 1 hour 45 minutes *or more*. + +### 4.22 Arachnophobia + + +This question focuses on applying the knowledge from section 4.3 of the textbook on binomial distributions. Our old friend the binomial coefficient comes in quite handy... + + +(a) Recall from the birthday problems that a binomial probability of "at least one" successful trial can also be thought of as "one minus the probability of none." With this in hand, you can start to plug values into the formula for the probability of observing $k$ successess out of $n$ independent binomial trials given on p. 150. +$$P(at~least~1~arachnophobe)=1-P(none)$$ +$$1-P(none)=1-{10 \choose 0}0.07^{0}(1-0.07)^{10-0}$$ + Let's let R handle the arithmetic: + ```{r} + 1-(choose(10,0)*1*(.93^10)) + ``` + +(b) This one just requires you to plug a different value for $n$ into the same formula: +$$P(2~arachnophobes)={10 \choose 2}0.07^2(1-0.07)^{(10-2)}$$ + ```{r} + choose(10,2)*0.07^2*0.93^8 + ``` +(c) You can think of the probability of "at most one" success in a binomial trial as equal to the sum of the probability of two potential outcomes: zero or one. + $$P(\leq1~arachnophobes)=P(none)+P(one)$$ + Off to the races with our same formula again: + $${10 \choose 0}0.07^00.93^{10}+{10 \choose 1}0.07^1 0.93^9$$ + And R can solve that quickly: + ```{r} + (choose(10,0)*1*(.93^10))+(choose(10,1)*0.07*(0.93^9)) + ``` + +(d) The question asks us to calculate whether random assignment to tents is likely to ensure $\leq1~arachnophobe$ per tent. We can think about this as a slight twist on the result we calculated for part c above. Specifically, the answer to part c is the complementary probability of the outcome we're looking to avoid in this case (more than 1 arachnophobe per tent). In more formal notation: +$$P(\gt1~arachnophobe) = 1-P(\leq1~arachnophobe)$$ +$$P(\gt1~arachnophobe) = 1-0.84 = 0.16 = 16\%$$ + That covers the *probability* of multiple arachnophobes per tent, but as to whether or not it seems "reasonable" to randomly assign the teenagers to tents given this probability, the $16\%$ result cannot answer that part of the question. Making a decision based on a probability is an entirely separate issue! On the one hand, the probability of a bad outcome is not *huge*, but the decision should really depend on how heavily the counselor weighs the negative potential outcome given a $16\%$ chance of having multiple arachnophobic campers in one of the tents. The question makes it sound like the counselor "wants to make sure" there's not a critical mass of arachnophobes in any one tent, so a $16\%$ probability of failure implies that they should *not* use random assignment. Indeed, if the camp counselor has taken a statistics course, they might consider *any* probability of failure greater than $5\%$ as unacceptably high, but this assumes a pretty sophisticated and risk-averse camp counselor (who, let's be honest, is probably a teenager themselves with an under-developed prefrontal cortex and therefore *highly unikely* to base their decision on a mathematical and risk-averse assessment of the underlying probabilities). Personally, I can't even pretend to understand teenage decision-making and the idea that the counselor's actions would have any relationship to discrete calculations of probabilities is laughable. Who assigns these questions anyway?