Discussion:
multicolliniearity
(too old to reply)
P. Mallikarjun Rao
2005-11-16 18:51:32 UTC
Permalink
Dear all,

How to avoid multi-colliniearity in SEM models?.


Thanks in advance

Regards,
Mallik



---------------------------------
Yahoo! FareChase - Search multiple travel sites in one click.

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html
Ed Rigdon
2005-11-16 20:01:35 UTC
Permalink
Malik--
Collinearity is the same in regression and SEM. First, be parsimonious
in specifying the set of predictors--don't include extra predictors just
to boost R square. Second, consider a hierarchical approach where you
add predictors in groups based on theoretical priority. Third, where you
have polynomial predictors--X squared, as well as X, or interactions
(X,Z and X * Z), center the main effects predictors before creating the
polynomial or multiplicative terms, to reduce "nonessential collinearity."
Fourth, use experiment design where feasible to manipulate predictors
so that they are orthogonal to each other. For categorical predictors,
consider alternatives to simple dummy codes which achieve lower
correlation between predictors. Finally, there are biased regression and
principal components tools that can help, but you may pay a high price
for using them.
--Ed Rigdon

Edward E. Rigdon, Professor and Chair,
Department of Marketing
Georgia State University
P.O. Box 3991
Atlanta, GA 30302-3991
(express: 35 Broad St., Suite 1300, zip 30303)
phone (404) 651-4180 fax (404) 651-4198
Dear all,

How to avoid multi-colliniearity in SEM models?.


Thanks in advance

Regards,
Mallik



---------------------------------
Yahoo! FareChase - Search multiple travel sites in one click.

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html
Jamilia Blake
2005-11-16 20:59:28 UTC
Permalink
Speaking of collinearity, does anyone know of a reference that discusses centering as a means for controlling for collinearity? Thanks.
jb

Ed Rigdon <***@LANGATE.GSU.EDU> wrote:
Malik--
Collinearity is the same in regression and SEM. First, be parsimonious
in specifying the set of predictors--don't include extra predictors just
to boost R square. Second, consider a hierarchical approach where you
add predictors in groups based on theoretical priority. Third, where you
have polynomial predictors--X squared, as well as X, or interactions
(X,Z and X * Z), center the main effects predictors before creating the
polynomial or multiplicative terms, to reduce "nonessential collinearity."
Fourth, use experiment design where feasible to manipulate predictors
so that they are orthogonal to each other. For categorical predictors,
consider alternatives to simple dummy codes which achieve lower
correlation between predictors. Finally, there are biased regression and
principal components tools that can help, but you may pay a high price
for using them.
--Ed Rigdon

Edward E. Rigdon, Professor and Chair,
Department of Marketing
Georgia State University
P.O. Box 3991
Atlanta, GA 30302-3991
(express: 35 Broad St., Suite 1300, zip 30303)
phone (404) 651-4180 fax (404) 651-4198
Dear all,

How to avoid multi-colliniearity in SEM models?.


Thanks in advance

Regards,
Mallik



---------------------------------
Yahoo! FareChase - Search multiple travel sites in one click.

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html




---------------------------------
Yahoo! FareChase - Search multiple travel sites in one click.

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html
Pavlos
2005-11-16 21:03:57 UTC
Permalink
Try the personal web page of professor Robert Ping regarding interaction and
quadratic effects.



Pavlos



_____

From: Structural Equation Modeling Discussion Group
[mailto:***@BAMA.UA.EDU] On Behalf Of Jamilia Blake
Sent: Wednesday, November 16, 2005 10:59 PM
To: ***@BAMA.UA.EDU
Subject: Re: multicolliniearity



Speaking of collinearity, does anyone know of a reference that discusses
centering as a means for controlling for collinearity? Thanks.

jb

Ed Rigdon <***@LANGATE.GSU.EDU> wrote:

Malik--
Collinearity is the same in regression and SEM. First, be parsimonious
in specifying the set of predictors--don't include extra predictors just
to boost R square. Second, consider a hierarchical approach where you
add predictors in groups based on theoretical priority. Third, where you
have polynomial predictors--X squared, as well as X, or interactions
(X,Z and X * Z), center the main effects predictors before creating the
polynomial or multiplicative terms, to reduce "nonessential collinearity."
Fourth, use experiment design where feasible to manipulate predictors
so that they are orthogonal to each other. For categorical predictors,
consider alternatives to simple dummy codes which achieve lower
correlation between predictors. Finally, there are biased regression and
principal components tools that can help, but you may pay a high price
for using them.
--Ed Rigdon

Edward E. Rigdon, Professor and Chair,
Department of Marketing
Georgia State University
P.O. Box 3991
Atlanta, GA 30302-3991
(express: 35 Broad St., Suite 1300, zip 30303)
phone (404) 651-4180 fax (404) 651-4198
Dear all,

How to avoid multi-colliniearity in SEM models?.


Thanks in advance

Regards,
Mallik



---------------------------------
Yahoo! FareChase - Search multiple travel sites in one click.

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html



_____

Yahoo!
<http://us.lrd.yahoo.com/_ylc=X3oDMTFqODRtdXQ4BF9TAzMyOTc1MDIEX3MDOTY2ODgxNj
kEcG9zAzEEc2VjA21haWwtZm9vdGVyBHNsawNmYw--/SIG=110oav78o/**http%3a/farechase
.yahoo.com/> FareChase - Search multiple travel sites in one click.
-------------------------------------------------------------- To
unsubscribe from SEMNET, send email to ***@bama.ua.edu with the body of
the message as: SIGNOFF SEMNET Search the archives at
http://bama.ua.edu/archives/semnet.html


--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html
Ed Rigdon
2005-11-16 21:17:04 UTC
Permalink
Try Sec. 6.2 and sec. 7.2 of Cohen, Cohen, West and Aiken (2003),
Applied Multiple Regression / Correlation Analysis for teh behavioral
Sciences (3rd ed.)
--Ed Rigdon

Edward E. Rigdon, Professor and Chair,
Department of Marketing
Georgia State University
P.O. Box 3991
Atlanta, GA 30302-3991
(express: 35 Broad St., Suite 1300, zip 30303)
phone (404) 651-4180 fax (404) 651-4198
Speaking of collinearity, does anyone know of a reference that discusses centering as a means for controlling for collinearity? Thanks.
jb

Ed Rigdon <***@LANGATE.GSU.EDU> wrote:
Malik--
Collinearity is the same in regression and SEM. First, be parsimonious
in specifying the set of predictors--don't include extra predictors just
to boost R square. Second, consider a hierarchical approach where you
add predictors in groups based on theoretical priority. Third, where you
have polynomial predictors--X squared, as well as X, or interactions
(X,Z and X * Z), center the main effects predictors before creating the
polynomial or multiplicative terms, to reduce "nonessential collinearity."
Fourth, use experiment design where feasible to manipulate predictors
so that they are orthogonal to each other. For categorical predictors,
consider alternatives to simple dummy codes which achieve lower
correlation between predictors. Finally, there are biased regression and
principal components tools that can help, but you may pay a high price
for using them.
--Ed Rigdon

Edward E. Rigdon, Professor and Chair,
Department of Marketing
Georgia State University
P.O. Box 3991
Atlanta, GA 30302-3991
(express: 35 Broad St., Suite 1300, zip 30303)
phone (404) 651-4180 fax (404) 651-4198
Dear all,

How to avoid multi-colliniearity in SEM models?.


Thanks in advance

Regards,
Mallik



---------------------------------
Yahoo! FareChase - Search multiple travel sites in one click.

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html




---------------------------------
Yahoo! FareChase - Search multiple travel sites in one click.

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html
David Stewart
2005-11-16 22:02:35 UTC
Permalink
Cohen, Cohen, West, & Aiken. (2003). Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences, 3rd ed. Mahwah, NJ: Lawrence Erlbaum Associates. pp. 264-267.

DS
********
Speaking of collinearity, does anyone know of a reference that discusses centering as a means for controlling for collinearity? Thanks.
jb

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html
Jamilia Blake
2005-11-17 00:32:48 UTC
Permalink
thank you.
jb

David Stewart <david-***@UTULSA.EDU> wrote:
Cohen, Cohen, West, & Aiken. (2003). Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences, 3rd ed. Mahwah, NJ: Lawrence Erlbaum Associates. pp. 264-267.

DS
********
Speaking of collinearity, does anyone know of a reference that discusses centering as a means for controlling for collinearity? Thanks.
jb

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html




---------------------------------
Yahoo! FareChase - Search multiple travel sites in one click.

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html
Alex Yu
2005-11-17 17:24:54 UTC
Permalink
Hi, These wbpages may also help

http://www.creative-wisdom.com/computer/sas/collinear_orthogonalization.htm

http://www.creative-wisdom.com/computer/sas/collinear_deviation.html




Jamilia Blake <***@YAHOO.COM> wrote:
thank you.
jb

David Stewart <david-***@UTULSA.EDU> wrote:
Cohen, Cohen, West, & Aiken. (2003). Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences, 3rd ed. Mahwah, NJ: Lawrence Erlbaum Associates. pp. 264-267.

DS
********
Speaking of collinearity, does anyone know of a reference that discusses centering as a means for controlling for collinearity? Thanks.
jb

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html



---------------------------------
Yahoo! FareChase - Search multiple travel sites in one click. -------------------------------------------------------------- To unsubscribe from SEMNET, send email to ***@bama.ua.edu with the body of the message as: SIGNOFF SEMNET Search the archives at http://bama.ua.edu/archives/semnet.html



---------------------------------
Yahoo! FareChase - Search multiple travel sites in one click.

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html
Gülhayat Gölbaþý
2005-11-18 14:45:32 UTC
Permalink
I'm new at SEM therefore I know little about SEM.
In the case of multicollinearity among almost all exogenous variables( e.g. single indicator latent variable) can the ridge regression be used instead of multiple regresion in path analysis? Partial ridge regression coefficient instead of partial regression coefficient?

Alex Yu <***@YAHOO.COM> wrote: Hi, These wbpages may also help

http://www.creative-wisdom.com/computer/sas/collinear_orthogonalization.htm

http://www.creative-wisdom.com/computer/sas/collinear_deviation.html




Jamilia Blake <***@YAHOO.COM> wrote:
thank you.
jb

David Stewart <david-***@UTULSA.EDU> wrote:
Cohen, Cohen, West, & Aiken. (2003). Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences, 3rd ed. Mahwah, NJ: Lawrence Erlbaum Associates. pp. 264-267.

DS
********
Speaking of collinearity, does anyone know of a reference that discusses centering as a means for controlling for collinearity? Thanks.
jb

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html



---------------------------------
Yahoo! FareChase - Search multiple travel sites in one click. -------------------------------------------------------------- To unsubscribe from SEMNET, send email to ***@bama.ua.edu with the body of the message as: SIGNOFF SEMNET Search the archives at http://bama.ua.edu/archives/semnet.html



---------------------------------
Yahoo! FareChase - Search multiple travel sites in one click. -------------------------------------------------------------- To unsubscribe from SEMNET, send email to ***@bama.ua.edu with the body of the message as: SIGNOFF SEMNET Search the archives at http://bama.ua.edu/archives/semnet.html



---------------------------------
Yahoo! FareChase - Search multiple travel sites in one click.

--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html

Grisaffe, Douglas B
2005-11-16 22:02:34 UTC
Permalink
There is a kind of collinearity that is good in SEM, and a kind that is
bad.



All else equal, collinearity is a good thing in SEM when you are
considering relationships among indicators of the same latent construct.
Theoretically, the latent variable is the underlying cause of
intercorrelation among indicators. The more intercorrelation, the more
reliably the latent factor is captured (presuming proper
conceptualization and specification).



Collinearity is a bad thing, particularly when it occurs among exogenous
latent variables. The same kinds of issues arise as one might see in
multiple regression (e.g., sign reversals, bad effects on standard
errors, suppression effects), often intensified in SEM because the
correlation among latent variables is disattenuated.



In the "bad" case of collinearity, it may be poor specification on the
part of the researcher - i.e., what the researcher has conceptualized as
two distinct constructs really are not two distinct constructs. If that
is true (e.g., a test of the correlation shows it not to be
significantly different from a value of 1.0), you may have a single
underlying factor, which could be indicated by all the indicators you
originally had indicating the two collinear constructs - or you could
select a subset of indicators from both former constructs and treat
those as the indicators of this new single latent construct.



Two other possibilities might be considered. First, you might specify a
second-order latent factor that explains the high correlation among the
two collinear lower-order factors. This can "solve" the problem by
capitalizing on the high correlation rather than being harmed by it.
However, there should be a good interpretive/theoretical basis for
considering the two collinear constructs to themselves be indicators of
whatever the second-order factor is.



Second, you might re-think the specification. One of the collinear
exogenous factors might actually be legitimately conceptualized as a
causal outcome of the other. In that case, one of the collinear
exogenous variables is re-specified as an endogenous latent variable
caused by the other originally collinear latent variable. Again you are
now capitalizing on what formerly was problematic, but again there must
be a sound conceptual/theoretical logic underlying such a decision.



Some theoretical constructs may well be highly correlated yet distinct.
That would then reflect some nomothetic reality. Other times, this
problem is due solely to the lack of clarity of specification (in
constructs, or in indicators, or in construct relationships) - a
researcher error rather than a statistical problem. For example, some
might take a previously unstructured set of measures, sub-optimally
employ exploratory factor work, forcing orthogonal rotation or more
factors than are called for, or refactoring a large factor on its own to
"break it up", then take some presumed discovered measurement structure
into an SEM model. That obviously is not best practice and can result
in problems like the one you describe. Higher levels of care in proper
conceptualization and specification of constructs, indicators, and
causal paths would likely eliminate many problems people run into when
estimating SEM models.



Doug Grisaffe

Department of Marketing

University of Texas at Arlington



________________________________

From: Structural Equation Modeling Discussion Group
[mailto:***@BAMA.UA.EDU] On Behalf Of P. Mallikarjun Rao
Sent: Wednesday, November 16, 2005 12:51 PM
To: ***@BAMA.UA.EDU
Subject: multicolliniearity



Dear all,

How to avoid multi-colliniearity in SEM models?.


Thanks in advance

Regards,
Mallik

________________________________

Yahoo! FareChase - Search multiple travel sites in one click.
<http://us.lrd.yahoo.com/_ylc=X3oDMTFqODRtdXQ4BF9TAzMyOTc1MDIEX3MDOTY2OD
gxNjkEcG9zAzEEc2VjA21haWwtZm9vdGVyBHNsawNmYw--/SIG=110oav78o/**http%3a/f
arechase.yahoo.com/>
-------------------------------------------------------------- To
unsubscribe from SEMNET, send email to ***@bama.ua.edu with the
body of the message as: SIGNOFF SEMNET Search the archives at
http://bama.ua.edu/archives/semnet.html


--------------------------------------------------------------
To unsubscribe from SEMNET, send email to ***@bama.ua.edu
with the body of the message as: SIGNOFF SEMNET
Search the archives at http://bama.ua.edu/archives/semnet.html
Loading...