I'm working with a latent variable model and I'd like to predict a negative binomial count response variable. I found the clever cludge that @AdminRobK previously shared to use thresholds fixed to parametric quantiles for negative binomial distribution (#7856; 180313.R ). I think this approach will work well for me. The issue I've got is that my dependent variable is clearly zero-inflated. I've also got some minor observation-number differences that I'd like to incorporate as an offset.
I'm not exactly sure how to marry a zero-inflation model with the threshold parameterization of the negative binomial Rob used there? Can anyone offer a suggestion?
For the offset, with this parameterization, would it be correct to just add the log(number of observations) as a predictor in my model with a fixed coefficient of 1.0?
Thanks!
Hi, Brenton! As of OpenMx v2.18, that kludge of mine has built-in support, and it includes zero-inflation. The relevant function is
mxMarginalNegativeBinomial()
, which has an argument for the zero-inflation proportion,zeroInf
. This test script demonstrates its use (in the OpenMx source repository, it's tests/testthat/test-discrete.R .Could you say a bit more about the offset to which you refer?
Awesome! That's great!
For the offset: I've got substance use days for participants, but the time periods for each participant vary somewhat--some participants have 25 days of data, some 30, etc. If I were fitting an observed variable Poisson model, I would use a linear predictor like this:
log(count_dv) = log(days_observed) + β0 + β1x1 + β2x2 + …
So log(days_observed) is an offset/variable with coefficient fixed to 1.0.
OK, I think I get it. Sounds reasonable.
Just to be sure I'm interpreting these results correctly. Below, use_days_1_30_Use and use_days_1_30_Incar are specified with:
The Estimate for the Delta → use_days paths are regression coefficients on the normal latent "liability" variable underlying the negative binomial indicators, correct?
Do the Discrete parameters 1, 2, 3 correspond to the zero-inflation, size/dispersion, and mu parameters, respectively? (Could those be given informative labels in the output?) Are size and prob/mu parameterized as in ?pnbinom (that is NB2)? And the zero-inflation parameter is the marginal probability of 0 parameter from the binomial model?
Thanks!
> Do the Discrete parameters 1, 2, 3 correspond to the zero-inflation, size/dispersion, and mu parameters, respectively? (Could those be given informative labels in the output?)
You can easily figure it out using code like this,
Where the values show up in
mxMatrix
Discrete
tells you the meaning of the parameter. You can add labels to theDiscrete$labels
matrix to get labelled output in the summary table.> Are size and prob/mu parameterized as in ?pnbinom (that is NB2)?
You can use
mxGetExpected(model, "thresholds")
to check whether the proportions match what you expect.> And the zero-inflation parameter is the marginal probability of 0 parameter from the binomial model?
Actually I think it is the extra probability of zero beyond what the binomial model would predict.
Also, is it possible to disable the zero-inflation parameter?
Yes, just set it fixed to 0 or whatever value you prefer.
Ah, of course.
I have three zero inflated manifest variables for a CFA model. I assume that it is possible to use the mxMarginalPoisson to specify this model. This will form part of a larger model but I have deliberately kept this piece separate in the first instance to get something working. The model has been specified as follows (I am a novice OpenMX user having only used it briefly around 10 years ago).
model1 <- mxModel("ZIP CFA",
type = "RAM",
mxData(data, type = "raw"),
manifestVars = c("x1", "x2", "x3"),
mxPath(from = "F1", to = c("x1", "x2", "x3"),free=c(FALSE,TRUE,TRUE),values=c(1,1,1),labels=c("l1","l2","l3")),
mxPath(from = manifestVars, arrows = 2),
mxPath(from = "Externalising", arrows = 2, free = FALSE, values = 1.0),
mxPath( from=c("x1", "x2", "x3"), arrows=2, free=TRUE, values=c(1,1,1),labels=c("e1","e2","e3") ),
mxPath(from = "one", to = manifestVars, arrows = 1, free = TRUE, values = 1.0),
mxPath(from = "one", to = "F1", arrows = 1, free = FALSE, values = 0),
mxMarginalPoisson(vars=c("x1", "x2", "x3"),c(14,12,13),c(6,6,6),zeroInf=c(0.4,0.4,0.4))
)
The error that I am receiving is:
Running ZIP CFA with 14 parameters
Warning message:
In model 'ZIP CFA' Optimizer returned a non-zero status code 6. The model does not satisfy the first-order optimality conditions to the required accuracy, and no improved point for the merit function could be found during *the final linesearch (Mx status RED) *
If I run with 'mxTryHard':
Retry limit reached; Best fit=2771.4993 (started at 73171074) (11 attempt(s): 11 valid, 0 errors)
Is the model specification incorrect? OR is this likely to be a data issue? Thanks for any insights.