Modeling patient recruitment


Feasibility is an increasingly important step in defining optimal site and country mix, as well as for generating a patient recruitment plan for a clinical study. With enrollment delays continuing to impact on clinical trial delivery1, there is room for improvement and a need for more accurate recruitment projections to improve the reliability of up-front planning. We examine some of the principles and practices behind the collection and analysis of robust feasibility data.

Patient accrual is a function of the total accumulated recruitment time (the sum of the country/site-specific active recruitment period across all sites) and the rate at which each site recruits patients. Recruitment planning must take into account the influences on both parameters to improve predictability (Table 1) and to incorporate:
– A modeling tool that considers the influences on the recruitment period
– Evaluation of how the recruitment rate has been defined.
The modeling tool needs to take into account anything that will impact the available total accumulated recruitment time, such as:
– Country-specific start-up times
– The predicted behavior of sites when they start to recruit
– Country-specific holidays
– Country-specific recruitment / screen failure rates
When these are built into the recruitment planning tool, even a simple liner formula can be used for recruitment planning2.

Defining recruitment rates

The best recruitment estimate will be when exactly the same study is conducted again at the same sites. However, there will always be differences between one study and the next that need to be considered. Estimated recruitment rates can be derived from a variety of sources:
– Evaluation of past performance metrics from your own database
– Analysis of published studies
– Therapeutic expert knowledge to identify protocol nuances and their impact on recruitment
– Local expert analysis on the local acceptance of the protocol
– Epidemiological data
– Site surveys to collect feasibility data
It is also important to consider the impact of criteria or procedures on patients’ willingness to participate and/or in­vestigators motivation to recruit patients.

Use of site surveys to

collect feasibility data

Investigators are often asked to provide recruitment projections at a very early stage in the planning process, and without access to the full protocol3. Therefore, care has to be taken in how data is collected, analysed and interpreted, and any assessor has to be aware of potential investigator overestimation. When investigators assess their recruitment rate, there is general acceptance that this will need to be reduced.
The questions asked will drive predictability. When Investigators were asked the two to three questions shown in Table 2, the feasibility results were on average eight times as high as the actual study results. However, there was considerable variability from country to country, with the ratio of planned versus actual recruitment ranging from 0.9 (Portugal) to 28 (Italy). This data was from four protocols, 23 countries, 145 feasibility sites and 395 study sites.
By adopting a more specific approach – drilling down through the key entry criteria and asking five patient population specific questions designed to assess the specific patient population – the variability improved considerably, giving more confidence in the reproducibility of the data generated by the approach presented here.
These feasibility results were con­sistently one to four times as high as the actual study results. The country specific ratio between planned and actual has been used to define the country specific “discount factors”, for example the percentage by which the investigator estimate has to be reduced to give an

estimate of the projected recruitment


Country specific discount


One approach is to apply a reduction of 50% (discount factor of 2) to investigator estimates4,5. In order to use country-specific discount factors effectively, they have to be fully calibrated for the feasibility approach and derived for each country. When this has been done, they can provide direction on the potential recruitment rate, taking into account therapeutic variation6.
Discount factors have been defined for the drill down approach (12 studies, 35 countries, 963 feasibility investigators, 550 study investigators). These were equivalent to 2 in some countries. But investigators in the US and many Western European countries tended to further overestimate their projections and required a higher discount factor of 2.3 to 3, while the Eastern European and Latin American Investigators tended to be more realistic with their estimates, requiring a factor of 1 to 1.5. These factors can be used to compensate for investigator overestimates.

Planned vs. actual


By applying the US discount factor (2.3) to a study to compensate for potential overestimation of US investigators, and using the principles described in this paper, we were able to effectively model the planned recruitment plan (Fig. 1).

Use of median to determine country averages

Analysis for both feasibility projections and the actual data (Fig. 2) of this hypercholesterolemia study shows that the frequency distributions were not symmetrical, but that there is a positive skew (i.e. the distribution has a tail to the right). This effect is more pronounced in the feasibility data than in the actual study data (Fig. 2), a finding that is consistent with data from other feasibility versus actual study comparisons (8 studies, 20 frequency distributions, 567 feasibility investigators and 326 study investigators), in which the average skew of the actual data (0.99) is consistently lower than that of the corresponding feasibility data (1.79).
The median should be used when calculating the average of a skewed distribution, as it is not influenced by outlier values in the tail of the distribution. If the arithmetic mean is used, it will be strongly influenced by the tail of the distribution, meaning those few investigators reporting high estimates of patients to be enrolled.
And as this effect is stronger in the feasibility data than actual recruitment data, this would lead to elevated projections. The data shown in Table 3 illustrate the value of using the median, which also reduces the temptation of removing some of the high outlying data points in calculating the mean (hypercholesterolemia study). This should become the measure of choice for recruitment planning7.

Well-planned feasibility allows for the collection of meaningful data that can be analyzed and reliably used for recruitment planning. We have described some simple modeling using a well designed tool, the use of calibrated, country specific discount factors and using the median to define the country average. With this approach, investigator estimates obtained from well-designed questionnaires can be converted into meaningful recruitment projections. This will allow more accurate planning of clinical trials, and prevent the accrual of additional costs due to recruitment delays.

Anne Schneeberger, PhD, and Janet Jones, PhD, Icon plc, Dublin

[1] Centerwatch 2008
[2] Reinventing Patient Recruitment, 2007
[3] Scrip June 2009
[4] PRA International: Better Feasibility for Global Clinical Trials, July 2007
[5] Joshua Schultz: Improving Subject Recruitment, Applied Clinical Trials, March 2008
[6] Benjamin Quartley: Partnering for Better Performance,, February 2009
[7] Michelle Jones and Stephen Jones: Data Based Predictions, Applied Clinical Trials, March 2008

Anne Schneeberger
Icon Clinical Research Inc.
320 Seven Springs Way
Suite 500
Brentwood, TN, US 37027
Tel.: +1-(0)615-309-4343
eMai l:



London - The not-for-profit UK Biobank, the most comprehensive health study in Britain, is now accessible to researchers from industry and academia. The resource, which contains some 1,000 pieces of health and lifestyle...



London – The British Wellcome Trust announced on 20 March that it will launch a £200m business to invest directly in healthcare and life sciences companies. The business, up to now running under its working title Project Sigma,...



Nanopore sequencer Oxford Nanopore Technologies, a UK firm that promises its third-generation technology could theoretically sequence a human genome in 15 minutes, impressed scientists with the first public presentation of its...



GlaxoSmithKline (GSK) is further strengthening its activity in the area of rare diseases. The London-based pharma giant has signed an early-stage deal to develop and commercialise treatments for lysosomal storage disorders...



London/Montreal - Angiochem will collaborate with British pharma trust GlaxoSmithKline (GSK) plc on treatments for lysosomal storage diseases (LSD). London-based GSK will pay $300m, including up to $31.5m in upfront cash and...



London - GlaxoSmithKline re-adjusts its €3.7bn R&D budget. Following a review, three of 38 R&D units will be cut and four new ones installed, the UK drug company said in a statement on 7 Februray. Furthermore, six of the...



London - AstraZeneca tries to shed some weight, anticipating a tough year ahead. 7,300 jobs will be gone soon, the Anglo-Swedish drug company said in a statement. Research and development operations will be cancelled in...



Newhouse – An example of Schumpeter's dictum of creative destruction can be witnessed in Scotland. A former research site of US-pharma company Merck will be reborn as a biotech science park. BioCity Scotland Ltd, a joint venture...

Displaying results 1 to 10 out of 396

1-10 Next >

© 2007-2016 BIOCOM


Current issue

All issues

Product of the week


Stock list

All quotes


  • RENEURON (UK)2.88 GBP4.73%
  • SUMMIT (UK)4.03 GBP3.87%


  • VITA 34 (D)4.14 EUR-7.17%
  • ADOCIA (F)53.20 EUR-5.67%


  • DIAMYD MEDICAL -B- (S)6.90 SEK47.1%
  • KARO BIO (S)42.00 SEK34.6%


  • BIONOR PHARMA (N)0.44 NOK-25.4%
  • E-THERAPEUTICS (UK)11.50 GBP-14.8%
  • ZEALAND PHARMA (DK)112.00 DKK-14.5%


  • NICOX (F)10.07 EUR430.0%
  • SAREUM HOLDINGS (UK)0.76 GBP245.5%
  • GENMAB (DK)1094.00 DKK85.0%


  • BB BIOTECH (D)44.29 EUR-83.1%
  • EVOCUTIS (UK)0.04 GBP-77.8%

No liability assumed, Date: 27.08.2016


All Events