Multiple testing
Posted on

Forums
One of my Phd students recently received reviewer comments for a submitted paper in which she presented 9 univariate ACE models on separate outcome measures. One of the reviewers asked: “Please indicate how correction for multiple comparisons was handled for the genetic modeling. Given that several brain regions were being analyzed, what statistical threshold was used?”
First of all, is any such correction really needed for 9 outcomes?
Second, how would we go about performing such a correction in openmx? What output I'm used to seeing reported in papers often includes the p-value only for selection of the best fitting model, and the path loadings obtained from the model, but no p-values for these path loadings.
Thanks.
First of all, is any such correction really needed for 9 outcomes?
Second, how would we go about performing such a correction in openmx? What output I'm used to seeing reported in papers often includes the p-value only for selection of the best fitting model, and the path loadings obtained from the model, but no p-values for these path loadings.
Thanks.
Let me make sure I understand
Log in or register to post comments
How was it decided which models to fit?
Possibly, false discovery rate correction could be used. On the whole though, with genetic model estimates I don't think that these procedures are very helpful. By analogy, it is as though one has decided that 20,000 feet is a significantly high part of planet earth, so one draws a map that has a few contours around the Himalayas and the Andes, but is blank white otherwise. For the purposes of global navigation, the map is largely useless. It answers the question of whether there are significantly high bits of the Earth, but whether there are significantly highly heritable regions is rarely the question in structural MRI studies. For practical purposes, it is typically better to have a global map (recognizing its errors and all) than a map of where the big mountains are.
Log in or register to post comments
She compared monophenotype
Log in or register to post comments
In reply to She compared monophenotype by JBosdriesz
suggestions
Log in or register to post comments
I have two questions:
1. Are you saying there is a way to estimate the models entirely without specifying the N or SE[?](http://rahyabmoshaver.com "?")
2. Does your function also speak to Michael's point about using the correlation of the correlations in the model?
Log in or register to post comments