Model G20 2027 at FLAME University, registrations now open

Probability | CBSE Class 12 Maths Notes

24 min read

On this page

These Class 12 Mathematics notes cover conditional probability, its properties, the multiplication rule, independent events, complements, partitions of a sample space, total probability, Bayes’ theorem and random variables, with worked calculations involving coins, dice, cards, coloured balls and manufacturing.

What does conditional probability mean?

How does new information change the sample space?

A random experiment has uncertain outcomes. Its sample space, denoted by SS, is the set of possible outcomes. An event is a subset of that space. Let EE and FF denote two events, and let P(E)P(E) mean the probability of event EE.

The notation E∩FE\cap F means the intersection: both events occur. The notation E∪FE\cup F means the union: at least one occurs. The complement E′E' contains outcomes in which EE does not occur. These meanings remain the same throughout probability calculations.

When we learn that FF has occurred, outcomes outside FF are no longer relevant to the conditional calculation. The outcomes favourable to EE within this reduced space are precisely those belonging to E∩FE\cap F. This is the basis of conditional probability.

Definition: The conditional probability of EE given FF, written P(E∣F)P(E\mid F), is P(E∣F)=P(E∩F)P(F),P(F)≠0.P(E\mid F)=\frac{P(E\cap F)}{P(F)},\qquad P(F)\ne0. The event after the vertical bar is the information already given.

If outcomes are equally likely, let n(E∩F)n(E\cap F) denote the number belonging to both events and n(F)n(F) the number belonging to the conditioning event. Counting within the reduced space gives P(E∣F)=n(E∩F)n(F).P(E\mid F)=\frac{n(E\cap F)}{n(F)}.

What happens in the three-coin experiment?

Let HH stand for a head and TT for a tail. For three fair coins with equally likely ordered outcomes, the sample space is S={HHH,HHT,HTH,THH,HTT,THT,TTH,TTT}.S=\{HHH,HHT,HTH,THH,HTT,THT,TTH,TTT\}.

Worked example 1. Three fair coins are tossed. Find the probability of at least two heads, given that the first coin shows a tail.

Answer: Let EE mean at least two heads and FF mean a tail on the first coin.

  1. List the conditioning outcomes: F={THH,THT,TTH,TTT}F=\{THH,THT,TTH,TTT\}, so P(F)=4/8=1/2P(F)=4/8=1/2.
  2. Find the favourable intersection: E∩F={THH}E\cap F=\{THH\}, so P(E∩F)=1/8P(E\cap F)=1/8.
  3. Apply the definition: P(E∣F)=1/81/2=18×2=14.P(E\mid F)=\frac{1/8}{1/2}=\frac18\times2=\frac14.

Before receiving the information, four of the eight outcomes have at least two heads. After conditioning, only one of the four retained outcomes qualifies. The probability therefore changes because the calculation refers to a different collection of possible outcomes.

Which properties does conditional probability satisfy?

Property: certainty and the probability range

Once an event FF of nonzero probability is known to have occurred, both the original sample space and FF itself are certain. Conditional probability also stays between zero and one: P(S∣F)=P(F∣F)=1,0≤P(E∣F)≤1.P(S\mid F)=P(F\mid F)=1,\qquad 0\le P(E\mid F)\le1.

The denominator is fixed by the information given. For example, the intersection of the sample space with FF is FF itself. Substituting that intersection into the conditional-probability definition gives the same probability in the numerator and denominator.

Property: addition under a fixed condition

Let AA and BB denote any two events in the same sample space. Provided P(F)≠0P(F)\ne0, the conditional addition rule is P((A∪B)∣F)=P(A∣F)+P(B∣F)−P((A∩B)∣F).P((A\cup B)\mid F)=P(A\mid F)+P(B\mid F)-P((A\cap B)\mid F).

  1. Apply the definition to the union: P((A∪B)∣F)=P((A∪B)∩F)P(F).P((A\cup B)\mid F)=\frac{P((A\cup B)\cap F)}{P(F)}.
  2. Distribute the intersection across the union: (A∪B)∩F=(A∩F)∪(B∩F).(A\cup B)\cap F=(A\cap F)\cup(B\cap F).
  3. Use the ordinary addition rule in the numerator: P((A∪B)∣F)=P(A∩F)+P(B∩F)−P(A∩B∩F)P(F).P((A\cup B)\mid F)=\frac{P(A\cap F)+P(B\cap F)-P(A\cap B\cap F)}{P(F)}.
  4. Divide each term by the same denominator: P((A∪B)∣F)=P(A∣F)+P(B∣F)−P((A∩B)∣F).P((A\cup B)\mid F)=P(A\mid F)+P(B\mid F)-P((A\cap B)\mid F).

If AA and BB are disjoint, they have no common outcome. Their intersection is the empty set, denoted by ∅\varnothing, and the overlap term vanishes. The probabilities of the two events can then be added directly under the same condition.

Property: the conditional complement rule

The complement must be taken for the event whose probability is sought while retaining the given condition. The complement rule follows from certainty and disjoint addition.

  1. An event and its complement cover the sample space: E∪E′=S.E\cup E'=S.
  2. They are disjoint, so conditional addition gives P(E∣F)+P(E′∣F)=P(S∣F)=1.P(E\mid F)+P(E'\mid F)=P(S\mid F)=1.
  3. Rearrange to obtain P(E′∣F)=1−P(E∣F).P(E'\mid F)=1-P(E\mid F).

Note: Replacing the conditioning event by its complement asks a different question. The complement rule above keeps FF fixed throughout; it changes whether EE occurs within that same reduced space.

How do we solve conditional problems with equally likely outcomes?

The first task is to translate the words into events. Identify the information already known, then find which outcomes satisfy both that information and the event being asked about. For equally likely outcomes, the answer is a ratio of those two counts.

A useful working order is to write the conditioning set before counting favourable outcomes. This prevents the original sample-space size from being used after the problem has restricted the possible outcomes. The same method applies to numbered cards, repeated dice throws and coin tosses.

How does a restriction change a card calculation?

Worked example 2. Ten cards numbered from 11 to 1010 are thoroughly mixed, and one is selected randomly. Given that its number is greater than 33, find the probability that it is even.

Answer: Let AA mean an even number and BB mean a number greater than 33.

  1. Write the conditioning set: B={4,5,6,7,8,9,10}.B=\{4,5,6,7,8,9,10\}.
  2. Keep the even members of that set: A∩B={4,6,8,10}.A\cap B=\{4,6,8,10\}.
  3. Express the relevant probabilities in the original space: P(B)=710,P(A∩B)=410.P(B)=\frac7{10},\qquad P(A\cap B)=\frac4{10}.
  4. Divide to obtain P(A∣B)=4/107/10=410×107=47.P(A\mid B)=\frac{4/10}{7/10}=\frac4{10}\times\frac{10}7=\frac47.

The card numbered 22 is even, but it does not satisfy the condition. Including it among favourable outcomes would count a possibility that the question has already excluded. Both the numerator and denominator must refer to compatible events.

Why must ordered dice outcomes be retained?

Worked example 3. A fair die is thrown twice, with all 3636 ordered outcomes equally likely. Given that the sum is 66, find the probability that 44 appeared at least once.

Answer: Let EE mean at least one 44, and FF mean a sum of 66.

  1. List the possible ordered pairs under the condition: F={(1,5),(2,4),(3,3),(4,2),(5,1)}.F=\{(1,5),(2,4),(3,3),(4,2),(5,1)\}.
  2. Select the pairs containing 44: E∩F={(2,4),(4,2)}.E\cap F=\{(2,4),(4,2)\}.
  3. Calculate P(F)=536,P(E∩F)=236.P(F)=\frac5{36},\qquad P(E\cap F)=\frac2{36}.
  4. Use conditional probability: P(E∣F)=2/365/36=236×365=25.P(E\mid F)=\frac{2/36}{5/36}=\frac2{36}\times\frac{36}5=\frac25.

The first entry records the first throw and the second entry records the second. Reversing two different entries gives a different elementary outcome. Maintaining that order makes the counting agree with the actual experiment.

How is conditional probability used when outcomes are not equally likely?

The probability-ratio definition does not require all elementary outcomes to have equal probability. What changes is how we calculate the probabilities of the condition and the intersection. We add the assigned probabilities of their outcomes instead of using their counts alone.

What does the coin-and-die tree show?

Consider an experiment that begins with a fair coin. If it shows a head, toss the coin again; if it shows a tail, throw a fair die. A pair such as (H,T)(H,T) records two coin results, whereas (T,5)(T,5) records a tail followed by a die result.

What the figure shows

Coin-and-die outcomes

The tree splits into head and tail. The head path ends at two coin outcomes; the tail path ends at six numbered die outcomes. The probability version labels each coin-pair outcome 1/41/4 and each tail-and-die outcome 1/121/12.

See Figs. 13.1 and 13.2 in your NCERT textbook

The tree has eight terminal outcomes, but they do not receive equal probabilities. The two coin-pair outcomes each have a greater probability than any one tail-and-die outcome. Counting all eight as equally likely would therefore misrepresent this experiment.

Worked example 4. In this experiment, find the probability that the die shows a number greater than 44, given that there is at least one tail.

Answer: Let EE mean a die result greater than 44, and let FF mean at least one tail.

  1. Calculate each type of terminal probability: P({(H,H)})=P({(H,T)})=12×12=14.P(\{(H,H)\})=P(\{(H,T)\})=\frac12\times\frac12=\frac14. For each die result ii, where ii is an integer from 11 to 66, P({(T,i)})=12×16=112.P(\{(T,i)\})=\frac12\times\frac16=\frac1{12}.
  2. The conditioning event consists of (H,T)(H,T) and all six outcomes beginning with TT. Their probabilities are 1/41/4 and 1/121/12 each, respectively.
  3. Add the probabilities of those outcomes: P(F)=14+6×112=14+12=34.P(F)=\frac14+6\times\frac1{12}=\frac14+\frac12=\frac34.
  4. The favourable outcomes are (T,5)(T,5) and (T,6)(T,6), both within FF: P(E∩F)=112+112=16.P(E\cap F)=\frac1{12}+\frac1{12}=\frac16.
  5. Divide using the general definition: P(E∣F)=1/63/4=16×43=29.P(E\mid F)=\frac{1/6}{3/4}=\frac16\times\frac43=\frac29.

The condition retains seven outcomes, but their unequal probabilities prevent a simple favourable-count ratio. The essential question is how much probability belongs to each retained outcome. The conditional formula itself remains unchanged.

How does the multiplication theorem handle successive events?

Theorem: multiplication of probabilities

The event E∩FE\cap F means that both events occur. The multiplication theorem expresses its probability through one event and a conditional probability for the other. It follows directly by rearranging the definition of conditional probability.

  1. Begin with P(F∣E)=P(E∩F)P(E),P(E)≠0.P(F\mid E)=\frac{P(E\cap F)}{P(E)},\qquad P(E)\ne0.
  2. Multiply both sides by the denominator: P(E∩F)=P(E)P(F∣E).P(E\cap F)=P(E)P(F\mid E).
  3. Reverse the conditioning when P(F)≠0P(F)\ne0: P(E∩F)=P(F)P(E∣F).P(E\cap F)=P(F)P(E\mid F).

Choosing the order is a matter of which conditional probability is available. In successive draws, chronological order usually makes the changing contents easy to track. Removing an object changes the collection used for the next draw when there is no replacement.

Worked example 5. An urn contains 1010 black and 55 white balls. Two balls are drawn randomly, one after another without replacement. Find the probability that both are black.

Answer: Let EE mean a black first ball and FF a black second ball.

  1. Count the original total and first-draw probability: 10+5=15,P(E)=1015.10+5=15,\qquad P(E)=\frac{10}{15}.
  2. After a black first draw, 99 black balls remain among 1414 balls: P(F∣E)=914.P(F\mid E)=\frac9{14}.
  3. Apply the multiplication theorem: P(E∩F)=1015×914=90210=37.P(E\cap F)=\frac{10}{15}\times\frac9{14}=\frac{90}{210}=\frac37.

How does the rule extend to three events?

Let GG denote a third event. The last factor must condition on both preceding events together. When the relevant conditioning probabilities are nonzero, P(E∩F∩G)=P(E)P(F∣E)P(G∣E∩F).P(E\cap F\cap G)=P(E)P(F\mid E)P(G\mid E\cap F).

Worked example 6. Three cards are drawn successively without replacement from a well-shuffled standard pack of 5252 cards containing four kings and four aces. Find the probability that the first two cards are kings and the third is an ace.

Answer: Let K1K_1 and K2K_2 mean a king on the first and second draws, and A3A_3 an ace on the third.

  1. Initially four kings are available: P(K1)=452.P(K_1)=\frac4{52}.
  2. After one king is removed, three remain: P(K2∣K1)=351.P(K_2\mid K_1)=\frac3{51}.
  3. After two kings are removed, all four aces remain among fifty cards: P(A3∣K1∩K2)=450.P(A_3\mid K_1\cap K_2)=\frac4{50}.
  4. Multiply and simplify: P(K1∩K2∩A3)=452×351×450=48132600=25525.P(K_1\cap K_2\cap A_3)=\frac4{52}\times\frac3{51}\times\frac4{50}=\frac{48}{132600}=\frac2{5525}.

Each factor describes the next required event under the preceding successful draws. The ace count stays unchanged because the removed cards were kings, while the total number of available cards decreases at each stage.

How can we recognise independent events?

Two events are independent when the occurrence of one does not change the probability of the other. With nonzero conditioning probabilities, this means P(E∣F)=P(E),P(F∣E)=P(F).P(E\mid F)=P(E),\qquad P(F\mid E)=P(F).

Result: the product test for independence

The product definition is P(E∩F)=P(E)P(F).P(E\cap F)=P(E)P(F). It avoids division by an event probability. If this equality fails, the events are dependent. To test independence, calculate the intersection probability and the product separately before comparing them.

Worked example 7. A fair die is thrown. Let EE be the event that the result is a multiple of 33, and FF the event that it is even. Determine whether they are independent.

Answer: All six die outcomes are equally likely.

  1. List the events and their intersection: E={3,6},F={2,4,6},E∩F={6}.E=\{3,6\},\quad F=\{2,4,6\},\quad E\cap F=\{6\}.
  2. Find their probabilities: P(E)=26=13,P(F)=36=12,P(E∩F)=16.P(E)=\frac26=\frac13,\quad P(F)=\frac36=\frac12,\quad P(E\cap F)=\frac16.
  3. Compute the product: P(E)P(F)=13×12=16.P(E)P(F)=\frac13\times\frac12=\frac16.
  4. Compare: P(E∩F)=P(E)P(F)P(E\cap F)=P(E)P(F). Hence the events are independent, despite sharing the outcome 66.

How does independence differ from mutual exclusion?

FeatureIndependent eventsMutually exclusive events
MeaningOne event does not affect the probability of the other.The events have no common outcome.
Mathematical testP(E∩F)=P(E)P(F)P(E\cap F)=P(E)P(F)E∩F=∅E\cap F=\varnothing
When both probabilities are nonzeroThe intersection has nonzero probability.The intersection has zero probability.

Two mutually exclusive events with nonzero probabilities cannot be independent. If one occurs, the other cannot occur. Conversely, independent events with nonzero probabilities cannot be mutually exclusive, because the product of those probabilities is nonzero.

Independence concerns probabilities, while mutual exclusion concerns whether the event sets overlap. Do not infer independence from the wording alone when probabilities or outcome sets are available. The product comparison supplies a direct mathematical check.

How do complements and groups of events affect independence?

Result: independence is preserved by complements

If EE and FF are independent, so are EE and F′F', E′E' and FF, and E′E' and F′F'. This allows a problem involving non-occurrence to be handled using the same independence assumption.

What the figure shows

Events and their complements

A rectangle labelled SS contains overlapping circles labelled EE and FF. The diagram labels the overlap, the portions belonging to just one circle, and the region outside both circles using intersections and complements.

See Fig. 13.3 in your NCERT textbook

Derivation: independence of an event and a complement

  1. Split EE into two disjoint parts: E=(E∩F)∪(E∩F′).E=(E\cap F)\cup(E\cap F').
  2. Add their probabilities and rearrange: P(E∩F′)=P(E)−P(E∩F).P(E\cap F')=P(E)-P(E\cap F).
  3. Substitute independence: P(E∩F′)=P(E)−P(E)P(F).P(E\cap F')=P(E)-P(E)P(F).
  4. Factor and use the complement rule: P(E∩F′)=P(E)[1−P(F)]=P(E)P(F′).P(E\cap F')=P(E)[1-P(F)]=P(E)P(F').

The product test now establishes the required independence. Interchanging the event labels and applying the same argument gives the corresponding results for the other complement pairs.

How do we calculate at least one occurrence?

For independent events AA and BB, “at least one” includes either event alone as well as both together. Start with the addition rule, then use independence and the complement probabilities to obtain a convenient expression.

  1. Apply addition: P(A∪B)=P(A)+P(B)−P(A∩B).P(A\cup B)=P(A)+P(B)-P(A\cap B).
  2. Use independence: P(A∪B)=P(A)+P(B)−P(A)P(B).P(A\cup B)=P(A)+P(B)-P(A)P(B).
  3. Factor the terms involving the second event: P(A∪B)=P(A)+P(B)[1−P(A)].P(A\cup B)=P(A)+P(B)[1-P(A)].
  4. Use the first complement probability: P(A∪B)=P(A)+P(B)P(A′).P(A\cup B)=P(A)+P(B)P(A').
  5. Replace the remaining first-event probability: P(A∪B)=1−P(A′)+P(B)P(A′).P(A\cup B)=1-P(A')+P(B)P(A').
  6. Factor again: P(A∪B)=1−P(A′)[1−P(B)].P(A\cup B)=1-P(A')[1-P(B)].
  7. Use the second complement probability: P(A∪B)=1−P(A′)P(B′).P(A\cup B)=1-P(A')P(B').

What must be checked for three events?

Let CC denote a third event. Mutual independence requires all three pairwise conditions and the three-event condition: P(A∩B)=P(A)P(B),P(A\cap B)=P(A)P(B), P(A∩C)=P(A)P(C),P(A\cap C)=P(A)P(C), P(B∩C)=P(B)P(C),P(B\cap C)=P(B)P(C), P(A∩B∩C)=P(A)P(B)P(C).P(A\cap B\cap C)=P(A)P(B)P(C).

If any one of these requirements fails, the three events are not mutually independent. Checking the pairs alone does not complete the definition. The probability of the simultaneous occurrence of all three must also satisfy its product condition.

How does a partition lead to the theorem of total probability?

What is a partition of the sample space?

Let E1,E2,…,EnE_1,E_2,\ldots,E_n be events, where nn is the number of events in the collection. They form a partition when they are pairwise disjoint, collectively exhaustive and each has nonzero probability. Let ii and jj denote indices identifying events in this collection.

The conditions are Ei∩Ej=∅(i≠j),⋃j=1nEj=S,P(Ej)>0.E_i\cap E_j=\varnothing\quad(i\ne j),\qquad \bigcup_{j=1}^{n}E_j=S,\qquad P(E_j)>0. The large union symbol means the union of all the indexed events. Exactly one member of this collection occurs in an outcome of the experiment.

What the figure shows

Partition and an intersecting event

A rectangle labelled SS is divided into regions labelled with indexed events. A shaded oval labelled AA crosses several regions, showing the parts of AA lying within the partition.

See Fig. 13.4 in your NCERT textbook

Theorem: total probability

For an event AA, the theorem of total probability states P(A)=∑j=1nP(Ej)P(A∣Ej).P(A)=\sum_{j=1}^{n}P(E_j)P(A\mid E_j). The summation symbol instructs us to add the displayed product for every partition event, from the first through the last.

  1. Intersect AA with the whole sample space and then the partition: A=A∩S=A∩(E1∪⋯∪En).A=A\cap S=A\cap(E_1\cup\cdots\cup E_n).
  2. Distribute the intersection: A=(A∩E1)∪⋯∪(A∩En).A=(A\cap E_1)\cup\cdots\cup(A\cap E_n).
  3. These parts are disjoint, so add their probabilities: P(A)=∑j=1nP(A∩Ej).P(A)=\sum_{j=1}^{n}P(A\cap E_j).
  4. Use the multiplication rule in every term: P(A)=∑j=1nP(Ej)P(A∣Ej).P(A)=\sum_{j=1}^{n}P(E_j)P(A\mid E_j).

Weighting matters: a conditional probability describes what happens within one case. Its contribution to the overall probability also depends on how likely that case is. The total is obtained by adding all these weighted contributions.

How is the theorem used with two cases?

Worked example 8. A construction job faces a strike with probability 0.650.65. The probability of timely completion is 0.320.32 if there is a strike and 0.800.80 if there is no strike. Find the probability of timely completion.

Answer: Let AA mean timely completion and BB mean a strike.

  1. Find the other case probability: P(B′)=1−0.65=0.35.P(B')=1-0.65=0.35.
  2. Use the given conditional values: P(A∣B)=0.32,P(A∣B′)=0.80.P(A\mid B)=0.32,\qquad P(A\mid B')=0.80.
  3. Weight the two possibilities: P(A)=P(B)P(A∣B)+P(B′)P(A∣B′).P(A)=P(B)P(A\mid B)+P(B')P(A\mid B').
  4. Substitute and add: P(A)=0.65×0.32+0.35×0.80=0.208+0.280=0.488.P(A)=0.65\times0.32+0.35\times0.80=0.208+0.280=0.488.

A strike and no strike exhaust the possibilities and cannot occur together. This makes them suitable partition events. Timely completion, however, can occur under either case, so both contributions belong in the calculation.

How does Bayes’ theorem reverse a conditional probability?

Total probability moves from possible cases to the probability of an observed event. Bayes’ theorem asks which case occurred after the event is known. The events forming the partition are called hypotheses, because each describes a possible explanation of the observed result.

The probability P(Ei)P(E_i) is the prior probability of hypothesis EiE_i. The conditional probability P(Ei∣A)P(E_i\mid A), after event AA is known, is its posterior probability. Reversing the order around the conditioning bar changes the question being answered.

Theorem: Bayes’ formula and its proof

Suppose the partition events have nonzero probabilities and P(A)≠0P(A)\ne0. Then P(Ei∣A)=P(Ei)P(A∣Ei)∑j=1nP(Ej)P(A∣Ej).P(E_i\mid A)=\frac{P(E_i)P(A\mid E_i)}{\sum_{j=1}^{n}P(E_j)P(A\mid E_j)}.

  1. Start with conditional probability for the hypothesis: P(Ei∣A)=P(A∩Ei)P(A).P(E_i\mid A)=\frac{P(A\cap E_i)}{P(A)}.
  2. Expand the numerator using multiplication: P(Ei∣A)=P(Ei)P(A∣Ei)P(A).P(E_i\mid A)=\frac{P(E_i)P(A\mid E_i)}{P(A)}.
  3. Replace the denominator using total probability: P(Ei∣A)=P(Ei)P(A∣Ei)∑j=1nP(Ej)P(A∣Ej).P(E_i\mid A)=\frac{P(E_i)P(A\mid E_i)}{\sum_{j=1}^{n}P(E_j)P(A\mid E_j)}.

The numerator measures the joint occurrence of the selected hypothesis and the observation. The denominator includes the observation arising through every possible hypothesis. Omitting a possible case would leave part of the observed event out of the denominator.

How do we infer which bag was selected?

Worked example 9. Bag I contains 33 red and 44 black balls. Bag II contains 55 red and 66 black balls. Choose either bag with equal probability, then draw a ball randomly. Given that it is red, find the probability that Bag II was chosen.

Answer: Let E1E_1 and E2E_2 mean choosing Bag I and Bag II respectively, and AA mean drawing red.

  1. State the bag probabilities: P(E1)=P(E2)=12.P(E_1)=P(E_2)=\frac12.
  2. Find the red probabilities within each bag: P(A∣E1)=33+4=37,P(A∣E2)=55+6=511.P(A\mid E_1)=\frac3{3+4}=\frac37,\qquad P(A\mid E_2)=\frac5{5+6}=\frac5{11}.
  3. Compute the total probability of red: P(A)=12×37+12×511=314+522=33+35154=3477.P(A)=\frac12\times\frac37+\frac12\times\frac5{11}=\frac3{14}+\frac5{22}=\frac{33+35}{154}=\frac{34}{77}.
  4. Compute the required joint probability: P(E2∩A)=12×511=522.P(E_2\cap A)=\frac12\times\frac5{11}=\frac5{22}.
  5. Divide to obtain the posterior probability: P(E2∣A)=5/2234/77=522×7734=3568.P(E_2\mid A)=\frac{5/22}{34/77}=\frac5{22}\times\frac{77}{34}=\frac{35}{68}.

The question asks for the bag given the colour. The probability of red given Bag II is one ingredient, but is not the requested answer. The calculation must also account for the chance of obtaining red from Bag I.

How do we organise a Bayes problem with several sources?

When an observed item may come from several sources, organise two kinds of data separately: how frequently each source supplies an item, and how frequently that source produces the observed kind of item. These become the prior and conditional probabilities in the calculation.

How should manufacturing data be arranged?

Worked example 10. Machines A, B and C produce 25%25\%, 35%35\% and 40%40\% of a factory’s bolts respectively. Their respective defective rates are 5%5\%, 4%4\% and 2%2\%. A randomly chosen bolt is defective. Find the probability that machine B produced it.

Answer: Let B1,B2,B3B_1,B_2,B_3 denote production by machines A, B and C respectively. Let DD mean a defective bolt.

MachineProduction probabilityConditional defective probability
AP(B1)=0.25P(B_1)=0.25P(D∣B1)=0.05P(D\mid B_1)=0.05
BP(B2)=0.35P(B_2)=0.35P(D∣B2)=0.04P(D\mid B_2)=0.04
CP(B3)=0.40P(B_3)=0.40P(D∣B3)=0.02P(D\mid B_3)=0.02
  1. Compute the defective contribution from machine A: P(B1∩D)=0.25×0.05=0.0125.P(B_1\cap D)=0.25\times0.05=0.0125.
  2. Compute the contribution from machine B: P(B2∩D)=0.35×0.04=0.0140.P(B_2\cap D)=0.35\times0.04=0.0140.
  3. Compute the contribution from machine C: P(B3∩D)=0.40×0.02=0.0080.P(B_3\cap D)=0.40\times0.02=0.0080.
  4. Add all contributions: P(D)=0.0125+0.0140+0.0080=0.0345.P(D)=0.0125+0.0140+0.0080=0.0345.
  5. Divide the required contribution by the total: P(B2∣D)=0.01400.0345=140345=2869.P(B_2\mid D)=\frac{0.0140}{0.0345}=\frac{140}{345}=\frac{28}{69}.

The production shares belong to the entire output; the defective rates describe the output of each machine separately. Multiplying the two probabilities makes their bases compatible. Each product then represents a contribution to the defective probability for the whole factory.

What distinguishes the three probabilities?

The prior probability refers to machine B before inspecting the bolt. The conditional defective probability refers to defects among bolts already known to come from machine B. The posterior probability refers to machine B among bolts already known to be defective.

These statements describe different selections, even though they use the same two events. Defining the events before substituting numbers keeps those meanings visible. A complete Bayes solution identifies the partition, calculates the full observation probability and then selects the appropriate numerator.

What is a random variable?

Definition: A random variable is a real-valued function whose domain is the sample space of a random experiment. It assigns a real number to each outcome, rather than naming an event or listing a set of outcomes.

How can one experiment define different random variables?

Consider tossing a coin twice, with S={HH,HT,TH,TT}S=\{HH,HT,TH,TT\}. Let XX denote the number of heads. Let YY denote the number of heads minus the number of tails. Both are random variables on the same sample space, but their rules differ.

OutcomeValue of XXValue of YY
HHHHX(HH)=2X(HH)=2Y(HH)=2Y(HH)=2
HTHTX(HT)=1X(HT)=1Y(HT)=0Y(HT)=0
THTHX(TH)=1X(TH)=1Y(TH)=0Y(TH)=0
TTTTX(TT)=0X(TT)=0Y(TT)=−2Y(TT)=-2

The notation X(HH)X(HH) means the value assigned by the function XX to the outcome HHHH. Different outcomes can receive the same value: the two mixed outcomes both contain one head. A random variable therefore need not assign distinct numbers to distinct outcomes.

The assignment rule is essential. Merely specifying a coin-toss experiment does not uniquely determine its random variable. The number of heads and the difference between heads and tails are different numerical descriptions of those same outcomes.

Glossary

  • Sample space — The set of all possible outcomes associated with a random experiment.
  • Event — A subset of the sample space containing outcomes described by a specified condition.
  • Conditional probability — The probability of an event when another event of nonzero probability is known to have occurred.
  • Intersection — The event containing outcomes common to the events being considered together.
  • Complement — The event containing all sample-space outcomes outside the specified original event.
  • Independent events — Events whose joint probability equals the product of their individual probabilities.
  • Mutually exclusive events — Events that have no common outcome and therefore cannot occur together.
  • Exhaustive events — A collection of events whose union covers the entire sample space.
  • Partition — Pairwise disjoint, exhaustive events with nonzero probabilities, dividing the sample space into separate cases.
  • Hypotheses — The partition events representing possible cases when applying Bayes’ theorem to an observed event.
  • Prior probability — The probability assigned to a hypothesis before conditioning on the observed event.
  • Posterior probability — The conditional probability of a hypothesis given that the observed event has occurred.
  • Random variable — A real-valued function defined on the sample space of a random experiment.

Common errors and misconceptions

  • Misconception: Conditional probability keeps the original sample space for counting. Correct: Restrict attention to the given event, and count favourable outcomes within it when those outcomes are equally likely.
  • Misconception: The two directions of a conditional probability are interchangeable. Correct: P(E∣F)P(E\mid F) conditions on FF, whereas P(F∣E)P(F\mid E) conditions on EE; their denominators may differ.
  • Misconception: Any finite list of outcomes can be used with a favourable-count ratio. Correct: That shortcut requires equally likely outcomes. Otherwise add the assigned outcome probabilities.
  • Misconception: Independent and mutually exclusive mean the same thing. Correct: Independence uses a product equality; mutual exclusion means no common outcome. With nonzero event probabilities, the two properties are incompatible.
  • Misconception: Successive draws without replacement use the same counts at every stage. Correct: Remove the previously drawn objects before calculating the next conditional probability.
  • Misconception: Pairwise independence completes the check for three mutually independent events. Correct: The three-event intersection must also equal the product of the three individual probabilities.
  • Misconception: Bayes’ denominator needs only the hypothesis being investigated. Correct: It must include the observed event arising through every member of the partition.
  • Misconception: Conditioning on a zero-probability event gives zero. Correct: The conditional-probability ratio used here is undefined when its denominator is zero.

Exam-style questions with model answers

Q1. Events AA and BB satisfy P(A)=7/13P(A)=7/13, P(B)=9/13P(B)=9/13 and P(A∩B)=4/13P(A\cap B)=4/13. Find P(A∣B)P(A\mid B). [2 marks]
  1. The conditioning event is BB, which has nonzero probability. Therefore use P(A∣B)=P(A∩B)P(B).P(A\mid B)=\frac{P(A\cap B)}{P(B)}.
  2. Substitute and simplify: P(A∣B)=4/139/13=413×139=49.P(A\mid B)=\frac{4/13}{9/13}=\frac4{13}\times\frac{13}9=\frac49.
Q2. A fair die is thrown. Let E={3,6}E=\{3,6\} and F={2,4,6}F=\{2,4,6\}. Test whether the events are independent, and explain whether they are mutually exclusive. [3 marks]
  1. The six possible results are equally likely. Counting the members of the two events gives P(E)=26=13,P(F)=36=12.P(E)=\frac26=\frac13,\qquad P(F)=\frac36=\frac12.
  2. The common outcome is 66, so E∩F={6},P(E∩F)=16.E\cap F=\{6\},\qquad P(E\cap F)=\frac16.
  3. The product is P(E)P(F)=13×12=16P(E)P(F)=\frac13\times\frac12=\frac16. It equals the intersection probability, so the events are independent.
  4. They are not mutually exclusive because the common outcome belongs to both events. Independence does not require their event sets to be disjoint.
Q3. An urn contains 1010 black and 55 white balls. Two balls are drawn randomly without replacement. Calculate the probability that both are black, explaining the second-draw probability. [3 marks]
  1. Let EE mean that the first ball is black and FF that the second is black. The urn initially contains 1515 balls, so P(E)=10/15P(E)=10/15.
  2. Given a black first draw, one black ball has been removed. Thus 99 black balls remain among 1414 balls, giving P(F∣E)=9/14P(F\mid E)=9/14.
  3. Apply the multiplication theorem and simplify: P(E∩F)=P(E)P(F∣E)=1015×914=90210=37.P(E\cap F)=P(E)P(F\mid E)=\frac{10}{15}\times\frac9{14}=\frac{90}{210}=\frac37.
Q4. A construction job faces a strike with probability 0.650.65. Timely completion has probability 0.320.32 during a strike and 0.800.80 without a strike. Find the probability of timely completion. [3 marks]
  1. Let AA mean timely completion and BB mean a strike. The complementary case has probability P(B′)=1−0.65=0.35P(B')=1-0.65=0.35.
  2. A strike and no strike form disjoint, exhaustive cases. Weight the probability of timely completion within each case by the probability of that case: P(A)=P(B)P(A∣B)+P(B′)P(A∣B′).P(A)=P(B)P(A\mid B)+P(B')P(A\mid B').
  3. Substitution gives P(A)=0.65×0.32+0.35×0.80=0.208+0.280=0.488.P(A)=0.65\times0.32+0.35\times0.80=0.208+0.280=0.488. Both routes to timely completion have been included.
Q5. Bag I contains 33 red and 44 black balls, and Bag II contains 55 red and 66 black balls. A bag is chosen with equal probability and a ball is drawn randomly. It is red. Find the probability that it came from Bag II. [5 marks]
  1. Let E1E_1 and E2E_2 mean the selection of Bags I and II, and let AA mean a red ball. The bag events form a partition with P(E1)=P(E2)=1/2P(E_1)=P(E_2)=1/2.
  2. There are seven balls in Bag I and eleven in Bag II. Therefore P(A∣E1)=3/7P(A\mid E_1)=3/7 and P(A∣E2)=5/11P(A\mid E_2)=5/11.
  3. Find the total probability of the observation by including both bags: P(A)=12×37+12×511=33154+35154=68154.P(A)=\frac12\times\frac37+\frac12\times\frac5{11}=\frac{33}{154}+\frac{35}{154}=\frac{68}{154}.
  4. The joint probability of choosing Bag II and drawing red is P(E2∩A)=12×511=522=35154.P(E_2\cap A)=\frac12\times\frac5{11}=\frac5{22}=\frac{35}{154}.
  5. Condition this joint probability on the observed red ball: P(E2∣A)=35/15468/154=3568.P(E_2\mid A)=\frac{35/154}{68/154}=\frac{35}{68}. This is the probability of the bag given the colour, which is the direction requested.
Q6. Machines A, B and C supply 25%25\%, 35%35\% and 40%40\% of bolts. Their defective rates are 5%5\%, 4%4\% and 2%2\% respectively. A random bolt is defective. Find the probability that machine B supplied it. [5 marks]
  1. Let B1,B2,B3B_1,B_2,B_3 mean the bolt came from machines A, B and C, and let DD mean a defective bolt. These source events are mutually exclusive and exhaustive.
  2. Express the source probabilities as 0.250.25, 0.350.35 and 0.400.40. The corresponding defective probabilities conditional on those sources are 0.050.05, 0.040.04 and 0.020.02.
  3. Multiply within each source: P(B1∩D)=0.25×0.05=0.0125,P(B_1\cap D)=0.25\times0.05=0.0125, P(B2∩D)=0.35×0.04=0.0140,P(B_2\cap D)=0.35\times0.04=0.0140, P(B3∩D)=0.40×0.02=0.0080.P(B_3\cap D)=0.40\times0.02=0.0080.
  4. Add these disjoint contributions to obtain the entire defective probability: P(D)=0.0125+0.0140+0.0080=0.0345.P(D)=0.0125+0.0140+0.0080=0.0345.
  5. Bayes’ theorem divides machine B’s contribution by the total: P(B2∣D)=0.01400.0345=140345=2869.P(B_2\mid D)=\frac{0.0140}{0.0345}=\frac{140}{345}=\frac{28}{69}. This accounts for both its output share and its defective rate.
Q7. Let EE and FF be independent events in the same sample space, so P(E∩F)=P(E)P(F)P(E\cap F)=P(E)P(F). Prove that EE and the complement F′F' are independent. [3 marks]
  1. The parts of EE inside and outside FF are disjoint and together make up EE: E=(E∩F)∪(E∩F′).E=(E\cap F)\cup(E\cap F').
  2. Add their probabilities, then isolate the required intersection: P(E∩F′)=P(E)−P(E∩F).P(E\cap F')=P(E)-P(E\cap F).
  3. Use the stated independence and factor the result: P(E∩F′)=P(E)−P(E)P(F)=P(E)[1−P(F)].P(E\cap F')=P(E)-P(E)P(F)=P(E)[1-P(F)].
  4. Since P(F′)=1−P(F)P(F')=1-P(F), this becomes P(E∩F′)=P(E)P(F′)P(E\cap F')=P(E)P(F'). It is exactly the product condition for independence of the required pair.

Key takeaways

  • Conditional probability uses the given event as the reduced sample space and requires that event to have nonzero probability.
  • Counting favourable outcomes works directly when the outcomes being counted are equally likely; otherwise use their assigned probabilities.
  • The multiplication theorem combines a first-event probability with conditional probabilities that reflect what has already occurred.
  • Independence is a product relation between probabilities; mutual exclusion means that the event sets have no common outcome.
  • For three mutually independent events, check every pairwise product condition and the product condition for the three-event intersection.
  • Total probability adds the contributions of disjoint, exhaustive cases, weighting each conditional probability by its case probability.
  • Bayes’ theorem finds the probability of a hypothesis after an observation by dividing its joint contribution by the observation probability.
  • A random variable assigns a real number to each outcome, and different assignment rules can describe the same experiment.

Test yourself

What must be true of the conditioning event before the conditional-probability ratio can be used?

Its probability must be nonzero, because that probability is the denominator of the defining ratio.

For events EE and FF, with P(F)≠0P(F)\ne0, what is the complement rule for EE given FF?

The rule is P(E′∣F)=1−P(E∣F)P(E'\mid F)=1-P(E\mid F). The conditioning event remains the same on both sides.

Why is favourable-outcome counting unsuitable for the coin-and-die experiment?

Its terminal outcomes have unequal probabilities. Add the probabilities of the relevant outcomes before forming the conditional ratio.

Can mutually exclusive events with nonzero probabilities be independent?

No. Their intersection probability is zero, whereas the product of their nonzero probabilities is positive.

What three requirements define a partition used in total probability?

The events are pairwise disjoint, together cover the sample space, and each has nonzero probability.

What is the difference between prior and posterior probabilities?

A prior probability describes a hypothesis before conditioning. A posterior probability describes that hypothesis after the observed event is known.

If three events satisfy the pairwise product conditions, what additional condition is required for mutual independence?

The probability that all three occur together must also equal the product of their three individual probabilities.

Must a random variable assign different values to different outcomes?

No. In two coin tosses, counting heads assigns one to each of the two mixed outcomes.