Skip to main content

    Method document

    Sample size to estimate a difference between two proportions

    How many participants are needed in each of two independent groups to estimate the difference between the proportions with an outcome to within a chosen number of percentage points. Covers unequal groups, finite populations, cluster sampling and non-response.

    Engine version 1.0.0 · Reviewed 1 October 2026

    https://statwisely.com/methods/precision-proportion-difference/

    When to use it

    • Estimating how much more common an outcome is in one group than another, in percentage points: between two regions, sexes, or exposure groups.
    • Comparisons whose objective is stated as a precision rather than a test.

    Not for

    • Showing that two proportions differ. Use a powered two-proportion test under “Detect an effect”.
    • A relative comparison. For “twice as common”, use the relative risk or the odds ratio.
    • Paired or matched data, such as the same people before and after.

    Notation

    n1, n2n_1,\ n_2
    Sample sizes of groups 1 and 2
    p1, p2p_1,\ p_2
    Expected proportions in groups 1 and 2
    rar_a
    Allocation ratio n₂ / n₁
    EE
    Margin of error for the difference, on the proportion scale
    z1−α/2z_{1-\alpha/2}
    Standard normal quantile for confidence 1 − α (1.960 for 95%)
    N1, N2N_1,\ N_2
    Population sizes of the two groups
    DE\mathrm{DE}
    Design effect
    ρ\rho
    Intracluster correlation coefficient (ICC)
    mm
    Usable observations per cluster
    kk
    Number of clusters in each group
    CV\mathrm{CV}
    Coefficient of variation of cluster size
    L, UL,\ U
    Low and high ends of the range of cluster values
    qq
    Non-response rate

    Formulas

    Simple random sampling

    n1=⌈z1−α/22[p1(1−p1)+p2(1−p2)/ra]E2⌉,n2=⌈ra n1⌉n_1 = \left\lceil \frac{z_{1-\alpha/2}^{2}\left[p_1(1-p_1) + p_2(1-p_2)/r_a\right]}{E^{2}} \right\rceil, \qquad n_2 = \lceil r_a\, n_1 \rceil

    The normal-approximation interval for a difference between independent proportions, solved for n₁ [1]. Left empty, p₂ is taken to equal p₁, which is the most demanding case when both are near 50%.

    Finite population correction

    ni′=⌈ni1+(ni−1)/Ni⌉,i=1,2n_i' = \left\lceil \frac{n_i}{1 + (n_i - 1)/N_i} \right\rceil, \qquad i = 1, 2

    Applied to each group against its own population when population sizes are given [3]. It matters only when a group is a sizeable share of its population, and is not offered with cluster sampling.

    Design effect from an ICC

    DE=1+(m−1) ρ\mathrm{DE} = 1 + (m - 1)\,\rho

    For clusters of equal size [4]. A design effect can also be entered directly, in which case no ICC is used.

    Unequal cluster sizes

    DE=1+[(CV2+1) m−1]ρ,CV=SD⁡(sj)sˉ\mathrm{DE} = 1 + \left[(\mathrm{CV}^{2} + 1)\,m - 1\right]\rho, \qquad \mathrm{CV} = \frac{\operatorname{SD}(s_j)}{\bar{s}}

    When each cluster is given its own share s_j of the sample, the CV of those shares enlarges the design effect [5]. With a design effect entered directly the shares only divide the sample, since a measured design effect already reflects its survey’s cluster sizes.

    Number of clusters for a chosen cluster size

    k=max⁡ ⁣(2, ⌈n⋅DEm⌉),nclustered=k mk = \max\!\left(2,\ \left\lceil \frac{n \cdot \mathrm{DE}}{m} \right\rceil\right), \qquad n_{\text{clustered}} = k\,m

    Applied to each group separately, with distinct clusters in each. The requirement is rounded up to whole clusters, so the total can exceed n × DE slightly, and rounding can shift the allocation ratio a little.

    Cluster size for a fixed number of clusters

    m=⌈n (1−ρ)k−n ρ⌉,k>n ρm = \left\lceil \frac{n\,(1-\rho)}{k - n\,\rho} \right\rceil, \qquad k > n\,\rho

    Solving k·m = n·DE for m. Below that number of clusters no cluster size reaches the margin, because each extra person per cluster adds less and less information; the calculator reports the minimum number of clusters instead. With two groups, k clusters are taken in each.

    ICC from a range across clusters

    ρ≈[(U−L)/4]2p1 (1−p1)\rho \approx \frac{\left[(U - L)/4\right]^{2}}{p_1\,(1-p_1)}

    When no ICC is available: the range within which most clusters’ values are expected to fall is taken as about four between-cluster standard deviations, and the ICC is their share of the first group’s variance p₁(1 − p₁). An elicitation aid, not a measurement. With two groups, the range describes the first group’s clusters.

    Few clusters

    n  ←  n(tk−1, 1−α/2z1−α/2)2n \;\leftarrow\; n \left(\frac{t_{k-1,\,1-\alpha/2}}{z_{1-\alpha/2}}\right)^{2}

    Optional. With few clusters the interval is built on k − 1 degrees of freedom, so the normal critical value is replaced by t. Because k depends on n, this is iterated until it settles.

    Non-response

    napproach=⌈n1−q⌉n_{\text{approach}} = \left\lceil \frac{n}{1 - q} \right\rceil

    The number to approach in each group so that n respond. Applied last, after any clustering.

    Parameters

    Confidence level1−α1-\alpha

    Values: 90%, 95% or 99%

    95% is the convention in health research. A higher level widens the interval, so the same margin needs a larger sample.

    Margin of errorEE

    Values: Above 0 and below 1 on the proportion scale; 0.1 means ±10 percentage points

    An absolute margin for the difference, in percentage points. It should be small compared with the difference you expect, or the interval will not tell the groups apart.

    Expected proportion in group 1p1p_1

    Values: Between 0 and 1

    From previous studies, routine data or a pilot study.

    Expected proportion in group 2p2p_2Optional

    Values: Between 0 and 1; leave empty to use p₁

    When unknown, leaving it empty assumes no difference, which is conservative when p₁ is near 50%.

    Allocation ratiora=n2/n1r_a = n_2/n_1Optional

    Values: Above 0; 1 for equal groups

    The planned size of group 2 divided by group 1. Equal groups give the most precision for a given total; use another ratio when one group is easier or cheaper to recruit.

    Population sizesN1, N2N_1,\ N_2Optional

    Values: Whole numbers of at least 2; leave the second empty if both groups come from populations of the same size

    Leave empty for large populations. They matter only when a group would be more than about 5% of its population. Not available with cluster sampling.

    Expected non-response rateqqOptional

    Values: 0% up to, but not including, 100%

    The share of people approached who will not take part; use the response rate of a comparable study. Approaching more people restores the number of respondents, not their representativeness: if non-responders differ, the estimate can still be biased.

    Intracluster correlation (ICC)ρ\rhoOptional

    Values: From 0 to 1

    The share of the outcome’s variation that lies between clusters. Published ICCs for health outcomes in primary-care and community clusters are mostly small, often below 0.05 [7], but depend on the outcome and the kind of cluster; prefer an estimate from a comparable study.

    Range of values across clustersL, UL,\ UOptional

    Values: Two values in the outcome’s units, the first below the second

    An alternative to the ICC: the range within which you expect most clusters’ values to fall. It is converted to an ICC by the formula above.

    Design effectDE\mathrm{DE}Optional

    Values: Above 0; usually between 1 and 3

    An alternative to the ICC, when a previous study of the same design reports its design effect.

    Observations per clustermmOptional

    Values: A whole number of at least 1

    Usable responses per cluster. Larger clusters are cheaper to reach, but when the ICC is above zero each additional person in a cluster adds less information.

    Number of clusters in each groupkkOptional

    Values: A whole number of at least 2

    Instead of a cluster size, when the clusters are fixed: the emirates of a country, the schools of a district. The calculator then finds the cluster size, or reports how many clusters the margin needs.

    Share of the sample for each clustersjs_jOptional

    Values: One positive value per cluster, on any scale

    When clusters will contribute unequally, for example in proportion to their population. With an ICC, unequal shares enlarge the design effect [5].

    Correction for few clusterstk−1t_{k-1}Optional

    Values: On or off

    Uses t on k − 1 degrees of freedom instead of the normal distribution. Worth applying when there are few clusters, roughly fewer than 30.

    Assumptions

    • The two groups are independent random samples, and participants respond independently apart from the clustering specified.
    • The normal approximation holds in both groups: the expected numbers with and without the outcome are comfortably above 10 in each. Otherwise analyse with a better interval, such as Newcombe’s [2].
    • With cluster sampling: the two groups have distinct clusters, with the same ICC and cluster size in each; clusters are of equal size unless shares are given; the sampled clusters are a small fraction of all clusters; and the analysis accounts for the clustering, for example with survey-design standard errors [4, 6].
    • Non-response is unrelated to the outcome.

    Worked examples

    Two equal groups

    Expected proportions 30% and 50%, margin ±10 points: n₁ = 1.96² × (0.3 × 0.7 + 0.5 × 0.5) / 0.1² = 176.71, rounded up to 177 per group.

    Group 1: 177 · Group 2: 177 · Total: 354

    Protocol statement

    To estimate the difference between two proportions with 95% confidence and a margin of error of ±10 percentage points, assuming expected proportions of 30% and 50% in the two groups, the required sample size is 177 participants per group, 354 in total. Calculated with StatWisely (statwisely.com) using: n₁ = z_(1-α/2)² × (p₁(1-p₁) + p₂(1-p₂)/r) / E²; n₂ = r × n₁. These are planning estimates; confirm the final design with a qualified statistician.

    Open this example in the calculator

    Allowing for non-response

    Expecting 10% not to take part: 177 / (1 − 0.10) = 196.7, so 197 are approached in each group.

    Group 1: 177 · Group 2: 177 · Total: 354 · To approach: 197 and 197

    Open this example in the calculator

    Cluster sampling with an ICC

    ICC 0.02 and 20 per cluster: DE = 1 + 19 × 0.02 = 1.38. Each group needs 177 × 1.38 = 244.3, so 13 clusters of 20 and 260 participants per group.

    Group 1: 260 · Group 2: 260 · Total: 520

    Protocol statement

    To estimate the difference between two proportions with 95% confidence and a margin of error of ±10 percentage points, assuming expected proportions of 30% and 50% in the two groups, 354 participants would be required under simple random sampling. Allowing for a design effect of 1.38 (ICC 0.02, 20 per cluster) for cluster sampling, the required sample size is 260 participants per group, 520 in total, in 13 clusters of 20 in each group. This assumes clusters of equal size, distinct between the two groups, with a negligible sampling fraction. Calculated with StatWisely (statwisely.com) using: n₁ = z_(1-α/2)² × (p₁(1-p₁) + p₂(1-p₂)/r) / E²; n₂ = r × n₁; clustered: n x DE, DE = 1 + (m-1)ρ. These are planning estimates; confirm the final design with a qualified statistician.

    Open this example in the calculator

    Validation

    • Every worked example on this page is recomputed by the StatWisely engine whenever the software is built. If a number or formula here stopped matching the calculator, the release would be stopped until this document was corrected.
    • An independent implementation in R recomputes this procedure, with and without cluster sampling, every night and before each production release, and the results are compared with the engine’s.
    • The basic result agrees with the closed form: 1.96² × 0.46 / 0.01 = 176.71, rounded up to 177 per group. In R, ceiling(qnorm(0.975)^2 * (0.3 * 0.7 + 0.5 * 0.5) / 0.1^2) returns 177.

    How to cite

    StatWisely. Sample size to estimate a difference between two proportions. Method document, engine version 1.0.0, reviewed 2026-10-01. https://statwisely.com/methods/precision-proportion-difference/

    Cite the original references for the formulas your design uses as well.

    References

    1. 1.Lwanga SK, Lemeshow S. Sample Size Determination in Health Studies: A Practical Manual. Geneva: World Health Organization; 1991.
    2. 2.Newcombe RG. Interval estimation for the difference between independent proportions: comparison of eleven methods. Statistics in Medicine. 1998;17(8):873–890.
    3. 3.Cochran WG. Sampling Techniques. 3rd ed. New York: John Wiley & Sons; 1977.
    4. 4.Kish L. Survey Sampling. New York: John Wiley & Sons; 1965.
    5. 5.Eldridge SM, Ashby D, Kerry S. Sample size for cluster randomized trials: effect of coefficient of variation of cluster size and analysis method. International Journal of Epidemiology. 2006;35(5):1292–1300. doi:10.1093/ije/dyl129
    6. 6.Donner A, Klar N. Design and Analysis of Cluster Randomization Trials in Health Research. London: Arnold; 2000.
    7. 7.Adams G, Gulliford MC, Ukoumunne OC, Eldridge S, Chinn S, Campbell MJ. Patterns of intra-cluster correlation from primary care research to inform study design and analysis. Journal of Clinical Epidemiology. 2004;57(8):785–794. doi:10.1016/j.jclinepi.2003.12.013