|Year : 2011 | Volume
| Issue : 2 | Page : 141-144
Quality of antidepressant drugs research articles published in Indian medical journals
Jaykaran Charan1, Deepak Saxena2, Preeti Yadav1, ND Kantharia1
1 Department of Pharmacology, Govt. Medical College, Surat, Gujarat, India
2 Department of Community Medicine, Govt. Medical College, Surat, Gujarat, India
|Date of Web Publication||20-Jan-2012|
Department of Pharmacology, Govt. Medical College, Surat, Gujarat
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Aim and Objective: Quality of methodological and statistical parameters published in various Indian Medical Journals are usually debated in terms of appropriateness. Aim of this manuscript is to analyze and validate efficacy studies on antidepressant drugs published in Indian Medical Journals regarding quality of various methodological and statistical parameters used. Materials and Methods: An in-depth review of Efficacy studies on Antidepressant published in Indian Medical Journals was conducted. Articles were retrieved from all possible sources like Published Journals, downloaded through Pubmed, MedInd, Opengate, Medknow, and Cochrane. These studies were analyzed and validated for various methodological and statistical parameters. Descriptive statistics for various parameters with confidence interval (CI) is also reported herewith. Results : Of 32 articles reviewed, primary and secondary endpoints and sample size calculation was reported in only one article (3.1%; 95% CI, 0.5 to 15.7%). Power and CI was not reported in any of the reviewed articles. Inclusion and exclusion criteria were reported in 9 (28.3%; 95% CI, 15.5 to 45.3%) articles. Information regarding randomization was mentioned in 12 (37.5%; 95% CI, 22.9 to 54.7%) articles, whereas reporting of blinding or open label status of the study was mentioned in 21 (65.6%; 95% CI, 48.3 to 79.5%) articles. Assumptions of statistical tests were not reported in any of the reviewed articles. Statistical tests were used in only 14 (43.7%; 95% CI, 28.1 to 60.6%) articles of which 70% of were inappropriate. All studies were underpowered for small and medium effect size. Conclusion: Quality of reporting of methodological and statistical aspects of antidepressant efficacy studies published in Indian medical journals are poor and hence makes difficult to conclude on issues related to validity of these studies.
Keywords: Antidepressants, efficacy, Indian medical journals
|How to cite this article:|
Charan J, Saxena D, Yadav P, Kantharia N D. Quality of antidepressant drugs research articles published in Indian medical journals. Indian J Psychol Med 2011;33:141-4
|How to cite this URL:|
Charan J, Saxena D, Yadav P, Kantharia N D. Quality of antidepressant drugs research articles published in Indian medical journals. Indian J Psychol Med [serial online] 2011 [cited 2020 Jan 20];33:141-4. Available from: http://www.ijpm.info/text.asp?2011/33/2/141/92062
| Introduction|| |
Clinical decisions for opting to an appropriate optimal treatment of patients are based on research done in the same area. Owing to busy schedule and infrequent continuous medical education, Clinicians usually come to know about the updates in respective subjects mainly through published articles published in journals. However, if the quality of published information in article is not up to the mark, it may impart incorrect or biased information to readers and that may affect optimal clinical decision making. Poor quality of published article may be because of either of two main reasons - one, study might not have been conducted properly, i.e., it may be poor methodologically, underpowered, use inappropriate statistics, etc., and second, all the parameters which can help authors to check validity of results are reported adequately in the published article. ,,,,
Depression is one of the common psychiatric disease and various antidepressants are tried for treatment of depression. Many studies are published in Indian Medical Journals regarding the efficacy of antidepressants in depression.  Presently, no data are available reporting the quality of these studies, this initiated designing of present study with an aim of exploring quality and checking the validity of research articles published on antidepressant in Indian Medical Journals.
| Materials and Methods|| |
A systematic search for the articles on Efficacy of Anti-Depressants published in Indian Journals was done. Articles were retrieved either in hard copies or in soft by use of database mainly Pubmed, Medind, Opengate, Medknow, and Cochrane. Relevant article search was initiated based on initial article list obtained by different keywords as related relevant to fulfill the aims of present study and Medial Subject Heading terms were created. Bibliographic indices of articles obtained were again searched to find more related articles. "Related article" link given in Pubmed was also reviewed to search more relevant articles.
Inclusion criteria of studies
As per the aims of the present study, we included only those studies related to efficacy of antidepressant drug (clinical trials and clinical studies) which were conducted and published in Indian Medical Journals. Only full articles and Original Articles were included.
Exclusion criteria of studies
All Short communications, Letter to Editor, Editorials, Case reports, Commentaries, View Point, and Reviews were excluded. Antidepressant research done outside India and articles published in journals other than Indian journals were also excluded.
Development of instrument
Two-stage Delphi technique for Conesus development was utilized to develop the instrument. The participants of the two-stage Delphi included faculties from the department of Pharmacology, Psychiatry and Community Medicine. Consensus was build upon deciding issues related to reporting of clinical studies as well as methodology and reporting parameters. The final guideline check questions to validate reporting of primary and secondary endpoints, reporting of inclusion and exclusion criteria, sample size and power, reporting of randomization, reporting of blinding/open label, reporting of fulfilling of assumptions of statistical tests, reporting of confidence interval (CI), appropriateness of statistical tests, and post hoc power.
Articles included in the study were validated on framed domain authors independently and then was revalidated by the second author. The First author (J.K) evaluated reported statistical tests for its appropriateness and all these statistical tests were again evaluated by second author (DS) for appropriateness (k=0.88). Calculation of post hoc power of these studies for Cohen's criteria of small effect size, medium effect size, and large effect size done with the help of G Power software.  Studies were considered underpowered when post hoc power calculation was found to be less than 80%. All these parameters were filled in predesigned performa.
The entire study was submitted for Expedite review to Institutional Ethical committee as it was database study based on articles published in Indian Medical Journals.
Descriptive statistics as frequency and percentages are used. 95% CI around the percentage are reported.
| Results|| |
A total of 32 articles as per the inclusion criteria were included in present study. Of these 32, 26 (81.2%; 95% CI, 64.6 to 91.15%) were clinical trials and 6 (18.7%; 95% CI, 8.8 to 35.3%) were clinical studies. Studies which mentioned "clinical trial" in title or in abstract or in material and method section were considered as clinical trials, rest were considered as clinical studies. Of these 32, 21 (65.6%; 95% CI, 48.3 to 79.5%) were positive studies and 11 (34.3%; 95% CI, 20.4 to 51.6%) were negative studies.
Of these 32 studies, information regarding primary and secondary endpoints were reported in only 1 (3.1%; 95% CI, 0.5 to 15.7%) article. Sample size calculation was reported in only 1 (3.1%; 95% CI, 0.5 to 15.7%) article. Average sample size was 24.4 per group. Most of the studies were having sample size less than 20 [Table 1]. Power was not reported in any of the article. Inclusion and exclusion criteria were reported in nine (28.3%; 95% CI, 15.5 to 45.3%) articles. Information regarding randomization was mentioned in 12 (37.5%; 95% CI, 22.9 to 54.7%) articles. Reporting of blinding or open label status of the study was mentioned in 21 (65.6%; 95% CI, 48.3 to 79.5%) articles.
Fulfilling of assumptions of statistical tests was not mentioned by any of the reviewed article. In 10 articles (31.2%; 95% CI, 17.9 to 48.5%), statistical tests were not used and results were given just by observing descriptive statistics. In eight articles (25%; 95% CI, 13.2 to 42.1%), P value was given but name of statistical test was not mentioned. In rest of the 14 articles (43.7%; 95% CI, 28.1 to 60.6%), statistical tests were used. Of these 14 articles, incorrect statistical test was used in 10 (71.4%) articles. Most common reason for inappropriate statistical test was use of parametric test for nonparametric data like score or scales. CI was reported in none of the 32 articles [Table 2].
On post hoc power calculation, it was observed that all studies were underpowered for small and medium effect size according to Cohen's criteria. Only eight (25%; 95% CI, 13.2 to 42.1%) studies were found to be adequately powered (=or >80%) for large effect size.
| Discussion|| |
Present study documents that the reporting of important parameters on the basis of which readers can assess the validity are deficient in published antidepressant efficacy studies as well as the methodology narrated on articles published in Indian Journals are not adequately done. Majority of the studies reviewed were underpowered and had use of inappropriate statistics and statistical tests. Hence, present study raises serious concerns on validity and scientific value of these studies.
One of the important observations of the present study is inappropriate reporting of various methodological parameters like primary and secondary endpoints, sample size calculation, inclusion and exclusion criteria, power, etc.; these parameters should be reported in detail so that readers can check the validity of published studies. Similar findings were observed in studies done for articles published in western and Indian journals. ,,
A particular statistical test can only be used if all the assumptions of the statistical tests are fulfilled; , however, it was observed that fulfillment of assumption of statistical tests were not mentioned in any of the articles reviewed in present study. In many articles, statistical tests were not used and in many articles, names of statistical tests were not mentioned. In the articles where statistical tests were used, more than 70% statistical tests used were inappropriate. As compared with other studies published in Indian and western medical journals, rates of use of inappropriate statistical tests in present study are high. ,,,,,, Various reasons like researchers', peer reviewers', and editors' poor knowledge of statistics and insufficient statistical review in ethics committee, etc., can be attributed to this high use of inappropriate statistical tests. 
Most of the studies were underpowered to document the actual difference between the groups and hence it raises methodological as well as ethical concerns. These studies because of insufficient power and poor statistics are scientifically useless and cannot justify the use of resources, deprivation of participants of these studies to normal established treatment. ,
One of the limitations of present study is that the findings of these studies are based on only 32 articles. Study with more articles could have increased the validity further.
| References|| |
|1.||Jaykaran, Kantharia ND, Yadav P, Deoghare S. Reporting of the methodological quality and ethical aspects in clinical trials published in Indian journals: A survey. J Postgrad Med 2011;57:82-3. |
|2.||Jaykaran, Kantharia ND, Yadav P, Bhardwaj P. Reporting statistics in clinical trials published in Indian journals: A survey. Pak J Med Sci 2010;26:212-6. |
|3.||Jaykaran, Yadav P, Chavda N, Kantharia ND. Some issue related to the reporting of statistics in clinical trials published in Indian medical journals: A Survey. Int J Pharmacol 2010;6:354-9. |
|4.||Jaykaran, Yadav P. Quality of reporting of statistics in the articles published in two Indian Pharmacology Journals: A survey. J Pharmacol Pharmacother 2011;2:85-9. |
|5.||Jaykaran, Saxena D, Yadav P, Kantharia ND, Solanki P. Quality of reporting of descriptive and inferential statistics in negative studies published in Indian Medical Journals. J Pharm Negat Results 2011;2:39-41. |
|6.||Avasthi A, Grover S, Aggarwal M. Research on antidepressants in India. Indian J Psychiatry 2010;52(Suppl 1):S341-54.. |
|7.||Faul F, Erdfelder E, Lang AG, Buchner A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 2007;39:175-91. |
|8.||Hebert RS, Wright SM, Dittus RS, Elasy TA. Prominent medical journals often provide insufficient information to assess the validity of studies with negative results. J Negat results Biomed 2002;1:1. |
|9.||Jay Karan, Goyal JP, Bhardwaj P, Yadav P. Statistical Reporting in Indian Pediatrics. Indian Pediatr 2009;46:811-2. |
|10.||Jaykaran, Yadav P, Bhardwaj P, Goyal J. Problems in reporting of statistics: Comparison between journal related to basic science with journal related to clinical practice. Internet J Epidemiol 2009;7:1. |
|11.||Jaykaran. How to select appropriate statistical test?. J Pharm Negat Results 2010;1:61-3. |
|12.||Altman DG. Statistics in medical journals: Developments in the 1980s. Stat Med 1991;10:1897-913. |
|13.||Gore SM, Jones IG, Rytter EC. Misuse of statistical methods: Critical assessment of articles in the BMJ from January to March 1976. Br Med J 1977;1:85-7. |
|14.||Pocock SJ, Hughes MD, Lee RJ. Statistical problems in the reporting of clinical trials. A survey of three medical journals. N Engl J Med 1987;317:426-32. |
|15.||Altman DG, Goodman SN, Schroter S. How statistical expertise is used in medical research. JAMA 2002;287:2817-20. |
|16.||Altman DG. Statistics and ethics in medical research: Misuse of statistics is unethical. Br Med J 1980;281:1267-9. |
|17.||Jaykaran, Saxena D. Clinical trials with poor methodological quality and inappropriate statistics: Are they ethical? J Pharm Negat Results 2011;2:42-3. |
[Table 1], [Table 2]