Probability Foundations
Build a solid understanding of probability, the mathematical language underlying all of statistics. Covers basic rules, conditional probability, Bayes theorem, and common counting methods.
What You'll Learn
- ✓Apply the addition and multiplication rules of probability correctly.
- ✓Calculate and interpret conditional probabilities.
- ✓Use counting methods (permutations and combinations) to solve probability problems.
1. Basic Probability Rules
Probability assigns a number between 0 and 1 to events, representing how likely they are. The addition rule handles "or" situations and the multiplication rule handles "and" situations, with adjustments for non-mutually-exclusive or dependent events.
Key Points
- •P(A or B) = P(A) + P(B) - P(A and B) for any two events.
- •P(A and B) = P(A) * P(B|A), which simplifies to P(A) * P(B) if events are independent.
- •The complement rule states P(not A) = 1 - P(A), which is often the easiest way to solve "at least one" problems.
2. Conditional Probability and Bayes Theorem
Conditional probability answers the question: given that one event has occurred, what is the probability of another? Bayes theorem reverses the conditioning, allowing you to update probabilities based on new evidence.
Key Points
- •P(A|B) = P(A and B) / P(B), assuming P(B) > 0.
- •Bayes theorem: P(A|B) = P(B|A) * P(A) / P(B).
- •Tree diagrams and two-way tables are powerful tools for organizing conditional probability calculations.
3. Counting Methods
When outcomes are equally likely, probability equals the number of favorable outcomes divided by total outcomes. Permutations count ordered arrangements, while combinations count unordered selections.
Key Points
- •Permutations (order matters): nPr = n! / (n-r)!.
- •Combinations (order does not matter): nCr = n! / [r!(n-r)!].
- •The multiplication principle states that if there are m ways to do one thing and n ways to do another, there are m*n ways to do both.
Key Takeaways
- ★Independent events satisfy P(A and B) = P(A) * P(B); do not confuse independence with mutual exclusivity.
- ★Mutually exclusive events cannot occur together: P(A and B) = 0.
- ★The law of total probability breaks P(B) into a sum over all partitions of the sample space.
- ★Bayes theorem is the foundation of Bayesian statistics and is used extensively in medical testing and spam filtering.
Practice Questions
1. A bag has 5 red and 3 blue marbles. Two are drawn without replacement. What is P(both red)?
2. Events A and B are independent with P(A) = 0.4 and P(B) = 0.3. Find P(A or B).
FAQs
Common questions about this topic
Independent events do not affect each other: knowing one occurred does not change the probability of the other. Mutually exclusive events cannot occur simultaneously. Crucially, mutually exclusive events with nonzero probabilities are never independent, because if one occurs the other has probability zero.
Use permutations when order matters (e.g., arranging people in a line, assigning ranked positions). Use combinations when order does not matter (e.g., choosing a committee, selecting lottery numbers). If the problem says "how many ways to choose" without regard to order, use combinations.