Method document
Sample size to estimate a difference between two proportions
How many participants are needed in each of two independent groups to estimate the difference between the proportions with an outcome to within a chosen number of percentage points. Covers unequal groups, finite populations, cluster sampling and non-response.
https://statwisely.com/methods/precision-proportion-difference/
When to use it
- Estimating how much more common an outcome is in one group than another, in percentage points: between two regions, sexes, or exposure groups.
- Comparisons whose objective is stated as a precision rather than a test.
Not for
- Showing that two proportions differ. Use a powered two-proportion test under “Detect an effect”.
- A relative comparison. For “twice as common”, use the relative risk or the odds ratio.
- Paired or matched data, such as the same people before and after.
Notation
- Sample sizes of groups 1 and 2
- Expected proportions in groups 1 and 2
- Allocation ratio n₂ / n₁
- Margin of error for the difference, on the proportion scale
- Standard normal quantile for confidence 1 − α (1.960 for 95%)
- Population sizes of the two groups
- Design effect
- Intracluster correlation coefficient (ICC)
- Usable observations per cluster
- Number of clusters in each group
- Coefficient of variation of cluster size
- Low and high ends of the range of cluster values
- Non-response rate
Formulas
Simple random sampling
The normal-approximation interval for a difference between independent proportions, solved for n₁ [1]. Left empty, p₂ is taken to equal p₁, which is the most demanding case when both are near 50%.
Finite population correction
Applied to each group against its own population when population sizes are given [3]. It matters only when a group is a sizeable share of its population, and is not offered with cluster sampling.
Design effect from an ICC
For clusters of equal size [4]. A design effect can also be entered directly, in which case no ICC is used.
Unequal cluster sizes
When each cluster is given its own share s_j of the sample, the CV of those shares enlarges the design effect [5]. With a design effect entered directly the shares only divide the sample, since a measured design effect already reflects its survey’s cluster sizes.
Number of clusters for a chosen cluster size
Applied to each group separately, with distinct clusters in each. The requirement is rounded up to whole clusters, so the total can exceed n × DE slightly, and rounding can shift the allocation ratio a little.
Cluster size for a fixed number of clusters
Solving k·m = n·DE for m. Below that number of clusters no cluster size reaches the margin, because each extra person per cluster adds less and less information; the calculator reports the minimum number of clusters instead. With two groups, k clusters are taken in each.
ICC from a range across clusters
When no ICC is available: the range within which most clusters’ values are expected to fall is taken as about four between-cluster standard deviations, and the ICC is their share of the first group’s variance p₁(1 − p₁). An elicitation aid, not a measurement. With two groups, the range describes the first group’s clusters.
Few clusters
Optional. With few clusters the interval is built on k − 1 degrees of freedom, so the normal critical value is replaced by t. Because k depends on n, this is iterated until it settles.
Non-response
The number to approach in each group so that n respond. Applied last, after any clustering.
Parameters
Confidence level
Values: 90%, 95% or 99%
95% is the convention in health research. A higher level widens the interval, so the same margin needs a larger sample.
Margin of error
Values: Above 0 and below 1 on the proportion scale; 0.1 means ±10 percentage points
An absolute margin for the difference, in percentage points. It should be small compared with the difference you expect, or the interval will not tell the groups apart.
Expected proportion in group 1
Values: Between 0 and 1
From previous studies, routine data or a pilot study.
Expected proportion in group 2Optional
Values: Between 0 and 1; leave empty to use p₁
When unknown, leaving it empty assumes no difference, which is conservative when p₁ is near 50%.
Allocation ratioOptional
Values: Above 0; 1 for equal groups
The planned size of group 2 divided by group 1. Equal groups give the most precision for a given total; use another ratio when one group is easier or cheaper to recruit.
Population sizesOptional
Values: Whole numbers of at least 2; leave the second empty if both groups come from populations of the same size
Leave empty for large populations. They matter only when a group would be more than about 5% of its population. Not available with cluster sampling.
Expected non-response rateOptional
Values: 0% up to, but not including, 100%
The share of people approached who will not take part; use the response rate of a comparable study. Approaching more people restores the number of respondents, not their representativeness: if non-responders differ, the estimate can still be biased.
Intracluster correlation (ICC)Optional
Values: From 0 to 1
The share of the outcome’s variation that lies between clusters. Published ICCs for health outcomes in primary-care and community clusters are mostly small, often below 0.05 [7], but depend on the outcome and the kind of cluster; prefer an estimate from a comparable study.
Range of values across clustersOptional
Values: Two values in the outcome’s units, the first below the second
An alternative to the ICC: the range within which you expect most clusters’ values to fall. It is converted to an ICC by the formula above.
Design effectOptional
Values: Above 0; usually between 1 and 3
An alternative to the ICC, when a previous study of the same design reports its design effect.
Observations per clusterOptional
Values: A whole number of at least 1
Usable responses per cluster. Larger clusters are cheaper to reach, but when the ICC is above zero each additional person in a cluster adds less information.
Number of clusters in each groupOptional
Values: A whole number of at least 2
Instead of a cluster size, when the clusters are fixed: the emirates of a country, the schools of a district. The calculator then finds the cluster size, or reports how many clusters the margin needs.
Share of the sample for each clusterOptional
Values: One positive value per cluster, on any scale
When clusters will contribute unequally, for example in proportion to their population. With an ICC, unequal shares enlarge the design effect [5].
Correction for few clustersOptional
Values: On or off
Uses t on k − 1 degrees of freedom instead of the normal distribution. Worth applying when there are few clusters, roughly fewer than 30.
Assumptions
- The two groups are independent random samples, and participants respond independently apart from the clustering specified.
- The normal approximation holds in both groups: the expected numbers with and without the outcome are comfortably above 10 in each. Otherwise analyse with a better interval, such as Newcombe’s [2].
- With cluster sampling: the two groups have distinct clusters, with the same ICC and cluster size in each; clusters are of equal size unless shares are given; the sampled clusters are a small fraction of all clusters; and the analysis accounts for the clustering, for example with survey-design standard errors [4, 6].
- Non-response is unrelated to the outcome.
Worked examples
Two equal groups
Expected proportions 30% and 50%, margin ±10 points: n₁ = 1.96² × (0.3 × 0.7 + 0.5 × 0.5) / 0.1² = 176.71, rounded up to 177 per group.
Group 1: 177 · Group 2: 177 · Total: 354
Open this example in the calculatorProtocol statement
To estimate the difference between two proportions with 95% confidence and a margin of error of ±10 percentage points, assuming expected proportions of 30% and 50% in the two groups, the required sample size is 177 participants per group, 354 in total. Calculated with StatWisely (statwisely.com) using: n₁ = z_(1-α/2)² × (p₁(1-p₁) + p₂(1-p₂)/r) / E²; n₂ = r × n₁. These are planning estimates; confirm the final design with a qualified statistician.
Allowing for non-response
Expecting 10% not to take part: 177 / (1 − 0.10) = 196.7, so 197 are approached in each group.
Group 1: 177 · Group 2: 177 · Total: 354 · To approach: 197 and 197
Open this example in the calculatorCluster sampling with an ICC
ICC 0.02 and 20 per cluster: DE = 1 + 19 × 0.02 = 1.38. Each group needs 177 × 1.38 = 244.3, so 13 clusters of 20 and 260 participants per group.
Group 1: 260 · Group 2: 260 · Total: 520
Open this example in the calculatorProtocol statement
To estimate the difference between two proportions with 95% confidence and a margin of error of ±10 percentage points, assuming expected proportions of 30% and 50% in the two groups, 354 participants would be required under simple random sampling. Allowing for a design effect of 1.38 (ICC 0.02, 20 per cluster) for cluster sampling, the required sample size is 260 participants per group, 520 in total, in 13 clusters of 20 in each group. This assumes clusters of equal size, distinct between the two groups, with a negligible sampling fraction. Calculated with StatWisely (statwisely.com) using: n₁ = z_(1-α/2)² × (p₁(1-p₁) + p₂(1-p₂)/r) / E²; n₂ = r × n₁; clustered: n x DE, DE = 1 + (m-1)ρ. These are planning estimates; confirm the final design with a qualified statistician.
Validation
- Every worked example on this page is recomputed by the StatWisely engine whenever the software is built. If a number or formula here stopped matching the calculator, the release would be stopped until this document was corrected.
- An independent implementation in R recomputes this procedure, with and without cluster sampling, every night and before each production release, and the results are compared with the engine’s.
- The basic result agrees with the closed form: 1.96² × 0.46 / 0.01 = 176.71, rounded up to 177 per group. In R, ceiling(qnorm(0.975)^2 * (0.3 * 0.7 + 0.5 * 0.5) / 0.1^2) returns 177.
How to cite
StatWisely. Sample size to estimate a difference between two proportions. Method document, engine version 1.0.0, reviewed 2026-10-01. https://statwisely.com/methods/precision-proportion-difference/
Cite the original references for the formulas your design uses as well.
References
- 1.Lwanga SK, Lemeshow S. Sample Size Determination in Health Studies: A Practical Manual. Geneva: World Health Organization; 1991.
- 2.Newcombe RG. Interval estimation for the difference between independent proportions: comparison of eleven methods. Statistics in Medicine. 1998;17(8):873–890.
- 3.Cochran WG. Sampling Techniques. 3rd ed. New York: John Wiley & Sons; 1977.
- 4.Kish L. Survey Sampling. New York: John Wiley & Sons; 1965.
- 5.Eldridge SM, Ashby D, Kerry S. Sample size for cluster randomized trials: effect of coefficient of variation of cluster size and analysis method. International Journal of Epidemiology. 2006;35(5):1292–1300. doi:10.1093/ije/dyl129
- 6.Donner A, Klar N. Design and Analysis of Cluster Randomization Trials in Health Research. London: Arnold; 2000.
- 7.Adams G, Gulliford MC, Ukoumunne OC, Eldridge S, Chinn S, Campbell MJ. Patterns of intra-cluster correlation from primary care research to inform study design and analysis. Journal of Clinical Epidemiology. 2004;57(8):785–794. doi:10.1016/j.jclinepi.2003.12.013