16 posts / 0 new

Tue, 12/10/2019 - 06:46

Offline

Joined: 12/04/2019 - 08:04

Complex data anaysis in REM doesn't result

Attachment	Size
syntax form metasem	114.44 KB

Dear Mike & colleagues,
First of all, I am grateful for asking my question to this forum where gurus of meta-SEM are helping people like me.
I'm trying to make analysis in your metasem package. I have 41 studies and so 41 correlation matrices. and the correlation matrices consist of 20x20.
While i was anaysing the data under the fixed effects model, the results came after a long time. But while i'm trying to analyse under the random effect model, the analysis is running but no results even though I wait a long time. Why i can not take the result, becouse of amount of matrices or items/complex data?

May I ask how can handle this problem?

Thanks for your time and patience.

(i added my syntax for you to review )

Thu, 12/12/2019 - 06:40

Mike Cheung

Offline

Joined: 10/08/2009 - 22:37

Hi vildan,

For the fixed-effects model, you are fitting a multiple-group analysis with 41 groups. For the random-effects model, there are 20x19/2 random effects. Both of them are computationally intensive. It may take a long time to run them. It may be better to run these analyses in High-performance computing (HPC) computers.

BTW, I have modified the code a bit for your reference. I hope it works.

## Add the variable labels to the data
var.names <- paste0("x", 1:20)
ucla <- lapply(ucla, function(x) {dimnames(x) <- list(var.names, var.names); x})
 
## First stage of the analysis
random1 <- tssem1(ucla, n, method="REM")
summary(random1)
 
## Create the model in lavaan syntax
model <- paste0("f =~ ", paste0("x", 1:20, collapse = "+"))
 
## Plot it for checking
plot(model)
 
## Convert it into RAM specification
RAM1 <- lavaan2RAM(model, obs.variables = var.names)
RAM1
 
## Second stage of the analysis
random2 <- tssem2(random1, RAM=RAM1)
summary(random2)
 
## Plot the results
plot(random2)

Best,
Mike

Thu, 05/27/2021 - 06:03

(Reply to #2) #3

yoinnami

Offline

Joined: 02/08/2021 - 08:46

Dear all,

I have 32 correlation matrices (6 rows x 6 columns) from 30 studies that all used the same questionnaire.

For one model, I am using 5 of the 6 variables that are modeled to be correlated with each other (i.e., variable 1 and 2, 1 and 3...). My tssem2 code (stage 2 random effects model) for the metaSEM package kept running for 47 days and stopped with a warning that it ran out of memory (my computer has 64gb memory). I executed the code on a few different computers of similar cpu and ram specs and I had the same warning message. To analyze the model, should I

(1) use high performance computing (HPC) services, following Mike's advice above. My random-effects model has 5x4/2 random effects (I am analyzing 5 of the 6 variables). So, is this really computationally intensive enough to use HPC? I thought my model was small and simple to estimate...

(2) write a more computer-friendly code (consuming less memory) after reading books such as "Advanced R"? This sounds like really technical.

(3) any other alternatives?

I have attached my code (that includes the data). In the file, my question is related to this line:
stage2random_model1 <- tssem2(stage1random, RAM=RAM1, diag.constraints=FALSE,
intervals.type="LB")# This model takes a long time to estimate.

Thanks very much,

Yo In'nami (first name-last name; male)
Professor
Division of English Language Education
Faculty of Science and Engineering
Chuo University
1-13-27 Kasuga, Bunkyo-ku, Tokyo 112-8551, Japan
+81-3-3817-1950
innami@tamacc.chuo-u.ac.jp
https://sites.google.com/site/yoinnami/

File attachments:

MetaSEM_stage2random_model1.txt

Fri, 05/28/2021 - 22:28

Mike Cheung

Offline

Joined: 10/08/2009 - 22:37

Dear Yo,

Dear Yo,
This model is not computationally intensive.

The tssem2 function uses some tricks to handle correlation structure properly. However, the limitation is that the model cannot be a correlation structure without any direct paths. I would consider it as a bug.

If you change the models to regression models or other path models, it takes seconds to fit them.

Best,
Mike

Sun, 05/30/2021 - 20:38

yoinnami

Offline

Joined: 02/08/2021 - 08:46

Hi Mike,

Thanks very much for your comment. Now I can better understand how the tssem2 function works. That also explains why I haven't seen examples like mine in your books and websites.

I'd like to obtain a synthesized inter-correlation matrix of six observed variables to examine my research question. The best I can is to report on the tssem1 (not tssem2) results? They are a pooled correlation matrix and I assume I could use that to examine the research question.

I also tried one-stage MASEM before posting my previous question. It kept running... and I had to terminate it forcefully.

One-stage meta-analytic structural equation modeling

Convert correlation matrices into a dataframe

my.df <- Cor2DataFrame(cordat5variables, N2)
my.df
head(my.df$data)

Fit the OSMASEM

fit0 <- osmasem(model.name="No moderator", RAM=RAM1, data=my.df)# This model takes a long time to estimate.

Further, I also tested a one-factor model with my data using the tssem2 function. It was estimated in a second and fit nicely.

Cheers,

Sun, 05/30/2021 - 22:27

Mike Cheung

Offline

Joined: 10/08/2009 - 22:37

Hi Yo,

RE: I'd like to obtain a synthesized inter-correlation matrix of six observed variables to examine my research question. The best I can is to report on the tssem1 (not tssem2) results? They are a pooled correlation matrix and I assume I could use that to examine the research question.

Yes.

RE: I also tried one-stage MASEM before posting my previous question. It kept running... and I had to terminate it forcefully.

If your models are the same in the tssem2() and osmasem(), please refer to my reply related to tssem2().

Best,
Mike

Mon, 05/31/2021 - 22:04

yoinnami

Offline

Joined: 02/08/2021 - 08:46

Hi Mike,

Thanks to your comment, I can now better understand how to proceed with my study.

I don't know how to thank you enough for taking time from your busy schedule to respond to my question.

Very best wishes,

Tue, 06/29/2021 - 02:08

yoinnami

Offline

Joined: 02/08/2021 - 08:46

Variance freed, but still warned to make it free

Dear all,

As my dependent variable is a single-indicator model, I fixed the residual variance of the observed variable at (1– reliability)*(measurement variance). I received this warning: "The variances of the dependent variables in 'Smatrix' should be free." To address this, the variance of the measure was freed. However, I still receive the warning.

I checked the checkRAM function used in the metaSEM, but the limitation of the function below does not apply to my case. I haven't fixed parameters in A.

Check both A and S: Variances of IVs must be fixed at 1 and DVs must be free

Limitation: it may still give warnings when there are DVs with fixed parameters in A

https://rdrr.io/cran/metaSEM/src/R/checkRAM.R

(1) Would you please advise as to how to revise my code? I thought fixing the variance was necessary to identify a single-indicator model but is not allowed in the metaSEM?
(2) Regardless of fixing the residual variance of the observed variable, the results are almost the same (with the same degrees of freedom). Does this mean such fixing is not necessary for a single-indicator model in the metaSEM?

I have attached the output and code files.

Thank you very much,

File attachments:

MetaSEMTest.doc

MetaSEMTest.txt

Wed, 06/30/2021 - 03:38

Mike Cheung

Offline

Joined: 10/08/2009 - 22:37

Hi Yo,

Since the variances of the dependent variables are functions of other parameters in the analysis of the correlation matrix, these variances are not free parameters. It is advisable not to fix them.

Second, there is only one indicator on the latent variable LCompre. It would help if you replaced the LCompre with its observed variable LC.

Mike

Wed, 06/30/2021 - 22:29

#10

yoinnami

Offline

Joined: 02/08/2021 - 08:46

Hi Mike,

As for the first point, thanks very much. I have understood your point.

As for the second point, I had, in fact, analyzed the data as you have suggested, before posting the questions. The results were almost the identical to those from the current analysis (with a different degree of freedom). The issue was that the six observed variables all loaded on the same, single factor. That was theoretically not something I wanted to examine. Thus, I have thought of constructing a single-indicator model that only consisted of the observed variable LC. This way, I can separately model LC from the remaining five observed variables that constituted another factor.

So, would it be sensible to ignore the warning "The variances of the dependent variables in 'Smatrix' should be free."? Even after freeing the variance of the dependent variable, I have received the warning.

Fri, 07/02/2021 - 00:53

#11

Mike Cheung

Offline

Joined: 10/08/2009 - 22:37

Hi Yo,

If you don't fix the measurement error related to the reliability, the two models are equivalent. Since the dfs are different, it indicates that something is wrong here.

Regarding the issue of fixing the measurement error related to reliability, it isn't very easy. There are at least two issues here: (1) correlation matrices are used here. Therefore, the diagonals of the model implied correlation matrices must be one. (2) The sampling error of a correlation has already been fixed for each study. Therefore, it is not clear how the measurement error can be added to the model.

Mike

Sun, 07/04/2021 - 00:19

#12

yoinnami

Offline

Joined: 02/08/2021 - 08:46

Hi Mike,

I have been unable to locate the parameter that should be freed to make the two models (i.e., my model and your model) equivalent. May I ask which parameter to free? In particular, I have freed the measurement error related to the reliability (LC). The model's degrees of freedom are 8.

$S
LC DA MT PK PE PS META LCompre
LC "0LCWITHLC" "0" "0" "0" "0" "0" "0" "0"
DA "0" "0DAWITHDA" "0" "0" "0" "0" "0" "0"
MT "0" "0" "0MTWITHMT" "0" "0" "0" "0" "0"
PK "0" "0" "0" "0PKWITHPK" "0" "0" "0" "0"
PE "0" "0" "0" "0" "0PEWITHPE" "0" "0" "0"
PS "0" "0" "0" "0" "0" "0PSWITHPS" "0" "0"
META "0" "0" "0" "0" "0" "0" "1" "0"
LCompre "0" "0" "0" "0" "0" "0" "0" "1"

Goodness-of-fit indices:

Value

Sample size 4621.0000

Chi-square of target model 20.7596

DF of target model 8.0000 (<--this: Yo)

Your suggested model has degrees of freedom of 9. Your model is this: "Second, there is only one indicator on the latent variable LCompre. It would help if you replaced the LCompre with its observed variable LC." I cannot match the df of my model (i.e., 8) to that of your model (i.e., 9). There is an error in my code.

> model3a <- '## Metacognitive strategy factor (META) is measured by DA, MT, PK, PE, and PS
+ META =~ METAonDADA + METAonMTMT + METAonPKPK + METAonPEPE + METAonPSPS
+ ## LC is regressed on META
+ LC ~ LCompreMETAMETA'
>
> plot(model3a, col="yellow", layout="spring")
> RAM3a <- lavaan2RAM(model3a, obs.variables=c("LC", "DA", "MT", "PK", "PE", "PS"))
>
> RAM3a
$A
LC DA MT PK PE PS META
LC "0" "0" "0" "0" "0" "0" "0LCompreMETA"
DA "0" "0" "0" "0" "0" "0" "0METAonDA"
MT "0" "0" "0" "0" "0" "0" "0METAonMT"
PK "0" "0" "0" "0" "0" "0" "0METAonPK"
PE "0" "0" "0" "0" "0" "0" "0METAonPE"
PS "0" "0" "0" "0" "0" "0" "0METAonPS"
META "0" "0" "0" "0" "0" "0" "0"

$S
LC DA MT PK PE PS META
LC "0LCWITHLC" "0" "0" "0" "0" "0" "0"
DA "0" "0DAWITHDA" "0" "0" "0" "0" "0"
MT "0" "0" "0MTWITHMT" "0" "0" "0" "0"
PK "0" "0" "0" "0PKWITHPK" "0" "0" "0"
PE "0" "0" "0" "0" "0PEWITHPE" "0" "0"
PS "0" "0" "0" "0" "0" "0PSWITHPS" "0"
META "0" "0" "0" "0" "0" "0" "1"

$F
LC DA MT PK PE PS META
LC 1 0 0 0 0 0 0
DA 0 1 0 0 0 0 0
MT 0 0 1 0 0 0 0
PK 0 0 0 1 0 0 0
PE 0 0 0 0 1 0 0
PS 0 0 0 0 0 1 0

$M
LC DA MT PK PE PS META
1 0 0 0 0 0 0 0

> stage2random_model3a <- tssem2(stage1random2, RAM=RAM3a, diag.constraints=FALSE, intervals.type="LB")
> summary(stage2random_model3a)

Call:
wls(Cov = pooledS, aCov = aCov, n = tssem1.obj$total.n, RAM = RAM,
Amatrix = Amatrix, Smatrix = Smatrix, Fmatrix = Fmatrix,
diag.constraints = diag.constraints, cor.analysis = cor.analysis,
intervals.type = intervals.type, mx.algebras = mx.algebras,
model.name = model.name, suppressWarnings = suppressWarnings,
silent = silent, run = run)

95% confidence intervals: Likelihood-based statistic
Coefficients:
Estimate Std.Error lbound ubound z value Pr(>|z|)
METAonDA 0.591859 NA 0.531698 0.653155 NA NA
LCompreMETA 0.312846 NA 0.252824 0.373454 NA NA
METAonMT 0.151865 NA 0.061752 0.241867 NA NA
METAonPE 0.616426 NA 0.560325 0.676011 NA NA
METAonPK 0.232201 NA 0.169570 0.295090 NA NA
METAonPS 0.755402 NA 0.690348 0.824983 NA NA

Goodness-of-fit indices:
Value
Sample size 4621.0000
Chi-square of target model 20.7596
DF of target model 9.0000 (<--this: Yo)

If I use "std.lv=FALSE", I no longer get the warning "The variances of the dependent variables in 'Smatrix' should be free." However, there is still a difference in the degrees of freedom between my model and your model.

> RAM3 <- lavaan2RAM(model3, obs.variables=c("LC", "DA", "MT", "PK", "PE", "PS"), std.lv=FALSE)
> RAM3

Goodness-of-fit indices:
Value
Sample size 4621.0000
Chi-square of target model 20.7596
DF of target model 8.0000 (<--this: Yo)

In the meantime, to explore another model, I have correlated the META factor with LC. The results say " The variances of the independent variables in 'Smatrix' must be fixed at 1." May I ask which parameter to fix? I have unsuccessfully attempted to do so...

$S
LC DA MT PK PE PS META
LC "0LCWITHLC" "0" "0" "0" "0" "0" "0LCompreMETA"
DA "0" "0DAWITHDA" "0" "0" "0" "0" "0"
MT "0" "0" "0MTWITHMT" "0" "0" "0" "0"
PK "0" "0" "0" "0PKWITHPK" "0" "0" "0"
PE "0" "0" "0" "0" "0PEWITHPE" "0" "0"
PS "0" "0" "0" "0" "0" "0PSWITHPS" "0"
META "0LCompreMETA" "0" "0" "0" "0" "0" "1"

I'm sorry I'm asking too much.

Mon, 07/05/2021 - 02:24

#13

Mike Cheung

Offline

Joined: 10/08/2009 - 22:37

Hi Yo,

Please see the attached PDF that shows two equivalent models--one with a latent variable and one without any latent variable.

Mike

File attachments:

test.pdf

Tue, 07/06/2021 - 22:40

#14

yoinnami

Offline

Joined: 02/08/2021 - 08:46

Hi Mike,

Thanks very much for your help. I have been able to reproduce the results. Referring to your examples and past answers to this forum, I always thought that the intervals.type="LB" works better than the intervals.type="z" and that diag.constraints=FALSE works better than diag.constraints=TRUE. I will be more careful when I analyze models in the future.

Best wishes,

Wed, 07/07/2021 - 02:38

#15

Mike Cheung

Offline

Joined: 10/08/2009 - 22:37

Hi Yo,

Yes. intervals.type="LB" should be preferable. But intervals.type="z" works much faster.

diag.constraints=FALSE and diag.constraints=TRUE are usually the same. But they are different in this case because there is a latent variable with 0 variance. diag.constraints=FALSE, which does not consider the error variance as a parameter, does not work here.

Best,
Mike

Thu, 07/08/2021 - 02:24

#16

yoinnami

Offline

Joined: 02/08/2021 - 08:46

Hi Mike,

Your responses have really helped me learn a lot about how the metaSEM package works. I don't know how to thank you enough.

Cheers,

Main menu

Navigation

You are here

Complex data anaysis in REM doesn't result

One-stage meta-analytic structural equation modeling

Convert correlation matrices into a dataframe

Fit the OSMASEM

Check both A and S: Variances of IVs must be fixed at 1 and DVs must be free

Limitation: it may still give warnings when there are DVs with fixed parameters in A

Goodness-of-fit indices:

Value

Sample size 4621.0000

Chi-square of target model 20.7596

DF of target model 8.0000 (<--this: Yo)

Main menu

User login

Navigation

You are here

Complex data anaysis in REM doesn't result

One-stage meta-analytic structural equation modeling

Convert correlation matrices into a dataframe

Fit the OSMASEM

Check both A and S: Variances of IVs must be fixed at 1 and DVs must be free

Limitation: it may still give warnings when there are DVs with fixed parameters in A

Goodness-of-fit indices:

Value

Sample size 4621.0000

Chi-square of target model 20.7596

DF of target model 8.0000 (<--this: Yo)

Search form