STATISTICS GLOSSARY
Superiority (binary)
Binary Outcome Superiority Trial

Binary Outcome Superiority Trial

A Binary Outcome Superiority Trial is a clinical trial method that aims to show that a treatment is superior to another treatment in terms of a binary outcome. A binary outcome refers to categories such as “success” vs. “failure” or “disease” vs. “health”.

Novustat is your experienced partner and advises you on all aspects of statistics, from data analysis to the interpretation of results, and helps you to gain maximum insight from your data sets. Contact us without obligation for further information!

Goal and concept

The main aim of such a study is to prove that the new treatment offers a statistically significant advantage over the existing treatment. In contrast to equivalence or non-inferiority studies, the focus here is on demonstrating superiority. This means that the results of the new treatment must be clearly better than those of the control group.

Free online calculators for calculating sample size

Use our online calculator to quickly and easily calculate the required sample size for your superiority study.
Calculator

Calculating the sample size

Calculating the sample size is crucial to ensuring that the study has sufficient statistical power to detect a genuine difference between the groups. This involves specifying an expected difference between the two groups that is considered clinically significant. Our specialized calculator helps you determine this difference and the required sample size.

Application and requirements

An example of a binary outcome superiority trial would be the comparison of a new drug treatment with an existing standard treatment for lowering blood pressure. If the aim is to significantly improve the cure rate of the new treatment, e.g. from 60% to 75%, then the trial demonstrates superiority if this difference is statistically and clinically significant.
Conducting such a trial requires a clear hypothesis, careful definition of the primary endpoint and detailed planning to minimize bias or random error.

Guidelines for calculating sample size for superiority trials with binary outcomes

The calculation of the sample size for a binary-outcome superiority trial is based on the expected difference between the groups, the significance level, and the statistical power. These parameters ensure that the study is robust enough to test the hypothesis of superiority.

Significance level (alpha)

The significance level, also known as alpha (α), defines the probability of finding a difference even though none actually exists. Typically, an alpha of 0.05 is used, which corresponds to a 5% risk of a Type I error.

Power (1-Beta)

The power (1-β) indicates how likely it is that the study will detect a real difference between the groups. A typical power of 80% means that the risk of a second type error (β) is 20%.

Percentage success rates in both groups

The success rate describes the proportion of patients in each group who achieve the desired result. In superiority studies, a significantly higher success rate is expected in the experimental group.

Expected difference (d)

The expected difference (d) indicates the minimum difference between the success rates of the groups that is considered clinically significant. For example, a value of 15% (d = 15) means that the new treatment must improve the success rate by at least 15% to be considered superior.

Formula for calculation

The sample size is calculated using the following formula:

\[n = \frac{f(\alpha, \beta) \cdot \left[ \pi_1 (100-\pi_1) + \pi_2 (100-\pi_2) \right]}{d^2}\]

Here, π1 represents the success rate in the experimental group, π2 represents the success rate in the control group, and f(α, β) represents the Z-scores for the significance level and power. This formula ensures a precise calculation of the sample size and helps you achieve reliable results in your superiority study.

What is a binary outcome superiority trial?

This study design tests whether a treatment performs statistically and clinically better than a comparator for a binary outcome.

Which binary outcomes are typical?

Typical outcomes have two categories, such as success or failure, diseased or healthy, or survived or deceased.

What determines the sample size?

It is mainly determined by expected success rates, the clinically relevant difference, significance level, and power.

What does the expected difference mean?

It is the smallest difference between the groups considered clinically meaningful.

What prerequisites does a robust study require?

A clear hypothesis, a clearly defined primary outcome, realistic effect assumptions, and a prespecified analysis plan are required.

Design superiority trials with binary outcomes on a sound basis.

A no-obligation initial assessment of your sample size and analysis plan.

NOVUSTAT supports you in defining clinically relevant effects, calculating power and sample size, and statistically analyzing binary outcomes.

Set realistic effect assumptions. Secure adequate power. Demonstrate superiority convincingly.
GDPR-compliant trust element on the NOVUSTAT website