Abstract' Content and GPs' Confidence in the Conclusion (ACOPI)
|ClinicalTrials.gov Identifier: NCT01679873|
Recruitment Status : Completed
First Posted : September 6, 2012
Last Update Posted : December 23, 2013
|First Submitted Date ICMJE||July 30, 2012|
|First Posted Date ICMJE||September 6, 2012|
|Last Update Posted Date||December 23, 2013|
|Study Start Date ICMJE||October 2012|
|Actual Primary Completion Date||October 2012 (Final data collection date for primary outcome measure)|
|Current Primary Outcome Measures ICMJE
||GPS' confidence on the conclusion of the abstract [ Time Frame: 30 days ]
measure on a numeric scale frome 0 to 10 where 0 is "no confidence" and 10 is "full confidence"
|Original Primary Outcome Measures ICMJE||Same as current|
|Change History||Complete list of historical versions of study NCT01679873 on ClinicalTrials.gov Archive Site|
|Current Secondary Outcome Measures ICMJE
|Original Secondary Outcome Measures ICMJE||Same as current|
|Current Other Outcome Measures ICMJE||Not Provided|
|Original Other Outcome Measures ICMJE||Not Provided|
|Brief Title ICMJE||Abstract' Content and GPs' Confidence in the Conclusion|
|Official Title ICMJE||Impact of Reporting Funding Sources and Conflicts of Interest in RCTs' Abstracts on General Practitioners' Confidence: a 3-arms Randomized Controlled Trial.|
Objective: The aim of this study is to assess the impact of reporting, in abstracts of randomized controlled trials, 1) the funding sources and 2) the conflicts of interest (COIs) of the authors on General Practitioners' confidence in the abstracts' conclusions.
Design: Randomized Controlled Trial in 3 arms. Participants: General Practitioners (GP). They will be recruited among residents from the Primary Care department of the Paris Descartes University and among a GP network who agreed to participate to research studies.
The allocation of participants will be done by a computerized randomization list, the sequence will be created by an independent statistician with a ratio 1: 1: 1. Participants will be blind of the hypothesis and of the randomization. Allocation concealment will be provided because only the statistician will have access to the randomization list.
Methods: Three interventions will be assessed corresponding to three different types of abstracts: 1) abstracts not reporting neither the funding sources neither COIs of authors, 2) abstracts reporting funding sources and 3) abstracts reporting funding sources and COIs of authors.
A sample of abstracts will be selected from published randomized trials, testing superiority, assessing pharmacological treatment, in the field of Primary Care and General Practice and having a conclusion in favor of the beneficial effect of experimental treatment in terms of tolerance and / or efficacy. They will then be standardized and modified to obtain three types of abstracts: 1) with funding sources, 2) with funding sources and COIs and 3) without either source of funding or COIs.
Participants will be asked to assess one abstract of their randomization arm. Outcome: The primary endpoint will be the GPs' confidence in conclusions. The secondary endpoints will be the quality perception of the study and the interpretation of the benefit of experimental treatment. Responses will be ranged by a 10-point numeric scale.
Potential interests: This study takes place in the field of Primary Care. We believe that better understandings of impact of funding sources and conflicts of interests are necessary to allow more transparency in medical research and in his translation into medical practice.
Sample size expected: 354 participants.
Dissemination of knowledge and research results is an essential step in the practice of Evidence-Based Medicine (EBM) (1).With the growing number of publications, a lack of accessibility, and the need for timely messages among information resources larger and larger, the General Practitioners (GP) often rely on abstracts of published trials (2).
Several methodological studies have shown an association between mode of financing, including industry funding, and how the results and conclusions of published trials are reported (3-14).
To improve transparency, the CONSORT recommends to report funding sources (15) in abstracts of randomized trials, which is not always followed. Efforts are also made to report conflicts of interest of authors (COIs). In its version in July 2010, the International Committee of Medical Journal Editors Uniform Disclosure Form for Potential Conflicts of Interest (ICMJE) recommends that editors ask to all authors who submit a manuscript, to complete the ICMJE statement (16,17). Despite this, understanding the complexity and severity of conflicts of interest is not yet fully taken into account by all the guidelines (18).
It was further demonstrated that the interpretation of results by physicians varies with their mode of presentation (19-22).
The investigators do not know to what extent the knowledge of funding sources and COIs may influence the interpretation of findings by the reader. The investigators are therefore interested in the impact of the presence of these elements in abstracts of published trials on GPs' confidence in the conclusions presented.
The aim of this study is to assess the impact of reporting, in abstracts of randomized controlled trials, 1) the funding sources and 2) the conflicts of interest (COIs) of the authors on General Practitioners' confidence in the abstracts' conclusions.
The investigators plan a 3 arms randomized parallel-group, conducted among GPs residents in Primary care and planned according to the CONSORT 2010 guidelines (23).
For allocation of the participants, a computer-generated list of random numbers will be used. Randomization sequence will be created by an independent statistician with R project with 1:1:1 ratio using random block sizes of 2, 4, and 6. The statistician will upload the randomization list on a secure internet system to assure allocation concealment.
GPs will be invited by e-mail to participate to this study. They will log on a secure internet system that will randomize the GP in 3 different arms: 1) abstracts not reporting neither funding neither COIs, 2) abstract reporting funding source and 3) abstract with funding and COIs.
Blinding participants is not possible in this study. To reduce the risk of bias, physicians will not be informed of the objectives of the study (ie study of the impact of the presentation of funding sources and COIS), or the existence of randomization. They will blind of the working hypotheses of the study.
GPs will be recruited among a network of GPs in France: this network consists of GPs who agreed to participate in research studies. It brings together members from the Collège Nationale des Généralistes Enseignants (CNGE) and GPs recruited by regional relays represented by 10 physicians members of primary Care departments.
Three interventions will be evaluated corresponding to 3 different types of abstracts: 1) abstracts not reporting the sources of financing or the COIs, 2) abstracts reporting the sources of funding as recommended by CONSORT for abstracts and 3) abstracts related funding sources and COIs.
To allow reproducibility and generalization of our results, abstracts will be selected from randomized controlled trials (RCTs) published in field of Primary Care. The investigators chose to select abstracts of RCTs because their contents are standardized because of the CONSORT guidelines. The investigators also chose to retain only the positive trials (conclusion in favor of the beneficial effect of experimental treatment in terms of tolerance and / or efficacy) to have a uniform interpretation of the results.
To identify abstracts, the investigators will search in Medline via PubMed for all indexed abstracts with using limits for randomized controlled trials, in English, published from the 1srt January 2010 to the 31 December 2010, in the Core Clinical Journal. The Core Clinical Journal was chosen to ensure a good quality of trials. The investigators restricted the search to the year 2010 to ensure that physicians do not remember the original abstract and thus preserve the blinding.
The eligibility criteria will be: randomized controlled trials, testing superiority, assessing pharmaceutical intervention (drugs) in the field of Primary Care (i.e. trials assessing treatments that may be prescribed by a GP, and those assessing treatments being prescribed in pathologies supported jointly between specialist and GP.), with a positive conclusion and funded only by the pharmaceutical industry.
Exclusion criteria will be: the non-pharmaceutical interventions (eg medical devices, patient education, etc..), equivalence or noninferiority trials, safety trials, trials assessing different pharmacological procedures, abstracts reporting a negative conclusion, not reporting or reporting the results in an ambiguous conclusion (successful trial but related the need for other studies), intermediate publications.
Construction of the modified Abstracts:
All abstracts will be standardized: the journal, date and registration number of ClinicalTrial.gov will be deleted. Authors' names will be replaced by generic names. A list of author names will be determined by drawing 20 names among the 200 names most common in the UK and will be identical for all abstracts.
The treatments will be referred to by "experimental treatment A" or "treatment B" in the abstract and in the title. The names of studies as an acronym will be deleted.
Finally, abstracts will be translated into French.
The three types of abstracts will be presented as follows:
Note that the investigators will consider in the same way "no conflict of interest" and the authors who do not report their COIs. We won't report it in the abstract.
Participants will be invited to participate in a study evaluating the interpretation of abstracts of RCTs by e-mail (with 3 reminders) or by an investigator during the national annual medical congress for general practice. They will be informed that their participation will take less than 5 minutes. After accepting, physicians will complete a questionnaire to collect their characteristics: date of birth, sex, status (resident or GP). Then they will be randomized and start immediately read the abstract and questionnaire. Participants will be asked to evaluate only a abstract in his arm of randomization.
The investigators estimate that 75 abstracts will be available to be assessed. Three main comparisons will be made: a comparison with the placebo group related funding sources, the comparison with the placebo group related funding sources and COIS and finally the comparison group of related funding sources with the related funding sources and COIS. With a significance level of 1.67% fixed for each of the three comparisons 2-2 (Bonferonni correction to maintain an overall significance level of 5%), it is necessary to have about 118 quotations in each arm to demonstrate an effect size equal to 0.5 on the numeric scale with a power of 90% for each comparison 2-2. As it is expected that each physician read a single abstract, it is necessary to include 118 physicians per arm (354 in total, each abstract is read 4.7 times on average (4 or 5 times in practice)).
Data analysis will be done with the software R project, in intention to treat. A description of the characteristics of physicians will be made initially. Qualitative variables will be described by their numbers, percentage and missing data by mode of response and quantitative variables by their rate, mean, standard deviation. In case of quantitative variables with asymmetric behavior, they will be presented with their median and interquartile range (25th percentile-75th percentile).
The primary analysis will be done on mean of GPs' confidence and the 3 possible comparisons will be made. The primary endpoint is quantitative, the test used for comparisons 2to 2 will be the non-parametric Mann Whitney 1.7% threshold. The same analysis is repeated for the secondary endpoints quantitative.
|Study Type ICMJE||Interventional|
|Study Phase||Not Applicable|
|Study Design ICMJE||Allocation: Randomized
Intervention Model: Parallel Assignment
Masking: Single (Participant)
Primary Purpose: Health Services Research
|Condition ICMJE||The Study Will Focus on no Specific Conditions|
|Intervention ICMJE||Other: Assess one type of abstract in the randomized arm
Participants will be asked to assess only one abstract in his arm of randomization. Three reminders will be made
|Publications *||Buffel du Vaure C, Boutron I, Perrodeau E, Ravaud P. Reporting funding source or conflict of interest in abstracts of randomized controlled trials, no evidence of a large impact on general practitioners' confidence in conclusions, a three-arm randomized controlled trial. BMC Med. 2014 Apr 28;12:69. doi: 10.1186/1741-7015-12-69.|
* Includes publications given by the data provider as well as publications identified by ClinicalTrials.gov Identifier (NCT Number) in Medline.
|Recruitment Status ICMJE||Completed|
|Actual Enrollment ICMJE
|Original Estimated Enrollment ICMJE
|Actual Study Completion Date||January 2013|
|Actual Primary Completion Date||October 2012 (Final data collection date for primary outcome measure)|
|Eligibility Criteria ICMJE||
|Ages||Child, Adult, Senior|
|Accepts Healthy Volunteers||No|
|Contacts ICMJE||Contact information is only displayed when the study is recruiting subjects|
|Listed Location Countries ICMJE||France|
|Removed Location Countries|
|NCT Number ICMJE||NCT01679873|
|Other Study ID Numbers ICMJE||CBV-001-HD|
|Has Data Monitoring Committee||No|
|U.S. FDA-regulated Product||Not Provided|
|IPD Sharing Statement||Not Provided|
|Responsible Party||Celine Buffel du Vaure, Hotel Dieu Hospital|
|Study Sponsor ICMJE||Hotel Dieu Hospital|
|Collaborators ICMJE||Not Provided|
|PRS Account||Hotel Dieu Hospital|
|Verification Date||December 2013|
ICMJE Data element required by the International Committee of Medical Journal Editors and the World Health Organization ICTRP