Indian Journal of Psychological Medicine
  Home | About Us | Editorial Board | Search | Ahead of print | Current Issue | Archives | Instructions | Contact | Advertise | Submission | Login 
Users Online: 254 
Wide layoutNarrow layoutFull screen layoutHome Print this page Email this page Small font sizeDefault font sizeIncrease font size


 
 Table of Contents    
COMMENTS ON PUBLISHED ARTICLE
Year : 2019  |  Volume : 41  |  Issue : 2  |  Page : 198  

Author's response to ‘Multiple Testing and Protection against Type I Error Using P Value Correction: Application in Cross-Sectional Study Designs’


Department of Psychopharmacology, National Institute of Mental Health and Neurosciences, Bangalore, Karnataka, India

Date of Web Publication4-Mar-2019

Correspondence Address:
Chittaranjan Andrade
Professor and Head, Department of Psychopharmacology, National Institute of Mental Health and Neurosciences, Bangalore - 560 029, Karnataka
India
Login to access the Email id

Source of Support: None, Conflict of Interest: None


DOI: 10.4103/IJPSYM.IJPSYM_61_19

Rights and Permissions

How to cite this article:
Andrade C. Author's response to ‘Multiple Testing and Protection against Type I Error Using P Value Correction: Application in Cross-Sectional Study Designs’. Indian J Psychol Med 2019;41:198

How to cite this URL:
Andrade C. Author's response to ‘Multiple Testing and Protection against Type I Error Using P Value Correction: Application in Cross-Sectional Study Designs’. Indian J Psychol Med [serial online] 2019 [cited 2019 May 22];41:198. Available from: http://www.ijpm.info/text.asp?2019/41/2/198/253380



Sir,

Menon[1] correctly points out that, in univariate analyses, in order to protect against a Type I (false positive) statistical error, the P value for statistical significance may need to be adjusted when many hypotheses are tested;[2] however, no adjustment of the P value is applied when the same variables are studied in a multivariable regression analysis. The situation is, therefore, paradoxical.

Several scenarios need to be considered here. First, in stepwise regressions, the false positive error rate is very high, and in one simulation, 30%–70% of the variables selected in different models were actually “pure noise”; therefore, stepwise regression procedures that use a statistical criterion for variable selection should emphatically be regarded as exploratory.[3]

Second, multivariable regressions commonly seek to examine the effect of one independent variable on the outcome of interest; the other variables in the equation are present to adjust for confounding. In effect, therefore, there is only one hypothesis being tested, and so, there is no inflation of the false positive error rate, and no P value adjustment required.

Third, in multivariable regressions in which several variables are selected based on a priori hypotheses, and entered in the regression equation to determine the extent to which each variable influences the outcome of interest, many hypotheses are being tested. Therefore, the P value for statistical significance does need to be adjusted; that is, that this is not usually done does not alter the fact that it needs to be done.

Finally, in multivariable regressions in which many variables are entered without a priori hypotheses and with a view to explore and identify potential relationships with the outcome of interest, the analysis should emphatically be considered exploratory because it is, in effect, a fishing expedition and one that is most vulnerable to false positive errors.

Financial support and sponsorship

Nil.

Conflicts of interest

There are no conflicts of interest.



 
   References Top

1.
Menon V. Multiple testing and protection against Type I error using P value correction: Application in cross-sectional study designs. Indian J Psychol Med 2019;41:197.  Back to cited text no. 1
  [Full text]  
2.
Andrade C. Multiple testing and protection against a type 1 (false positive) error using the Bonferroni and Hochberg corrections. Indian J Psychol Med 2019;41:99-100.  Back to cited text no. 2
  [Full text]  
3.
Norman GR, Streiner DL. Biostatistics: The Bare Essentials, 4th ed. Shelton, Connecticut, USA: People's Medical Publishing House; 2014.  Back to cited text no. 3
    




 

Top
 
 
  Search
 
  
    Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
    Access Statistics
    Email Alert *
    Add to My List *
* Registration required (free)  

 
  In this article
    References

 Article Access Statistics
    Viewed114    
    Printed0    
    Emailed0    
    PDF Downloaded9    
    Comments [Add]    

Recommend this journal