Difference between revisions of "PLS"

From StatWiki
Jump to: navigation, search
(Handling Missing Data)
Line 1: Line 1:
Partial Least Squares is another method for testing causal models (in addition to Covariance Based Methods used in AMOS and Lisrel). This section on PLS is intended to demystify the process of conducting an analysis, start to finish, using PLS-graph. Trust me, it needs demystification! I am not going to get into the deep logic and math behind the methods I outline here. This wiki is simply intended to be used as a "How To" for pls-graph. For more references and technical explanations, please refer to Wynne Chin's website: http://www.plsgraph.com/.  I have also listed several videos for SmartPLS 2.0 at the bottom of this page, and an article about when to choose PLS and how to use it.
+
MYY
----
+
[[File:citation.png]]''Do you know of some citations that could be used to support the topics and procedures discussed in this section? Please [mailto:james.eric.gaskin@gmail.com email them to me] with the name of the section, procedure, or subsection that they support. '''Thanks!'''''
+
----
+
==Installing PLS-graph==
+
Simply installing PLS-graph is a complex process. Instructions for getting the full version can be found here: http://disc-nt.cba.uh.edu/plsgraph/. ''Or'' you can click on this link: http://www.bauer.uh.edu/plsgraph/build1130.exe for the demo version. The demo version is rather limiting, and only allows you to test models with ten variables or less. In order to obtain a more useful license, you will have to contact Wynne Chin directly: wchin@uh.edu. Sadly I am not allowed to distribute it freely, and requests directed toward me for the full license must be rejected.
+
*'''''IMPORTANT  ''''' Once you have PLS-graph installed (by clicking on that link and running the file), make sure you have a "license.dat" or "license" file in your plsgraph folder, typically found at: '''C:\Program Files\plsgraph''', but sometimes also found at C:\Program Files '''x86'''\plsgraph if you are running a 64bit machine.
+
  
==Troubleshooting==
+
old http://giants.nfljersey.us.com/ but we http://raptors.nba-jersey.com/ face http://www.cheap-watches.in.net/ growing http://www.christian-louboutins.in.net/ oldOur http://www.nike-max.fr/ true http://www.michael-korsoutlet.cc/ that http://www.coachoutlet-online.com.co/ a http://buccaneers.nfljersey.us.com/ pure http://www.newbalance-shoes.org/ heart http://www.beatsbydrdrephone.com/ to http://www.roshe-run.co.uk/ itThere http://ravens.nfljersey.us.com/ was http://heat.nba-jersey.com/ a http://www.raybans-outlet.nl/ time http://www.long-champoutlet.com/ not http://www.katespadeoutlet.gb.net/ go http://www.nike-store.in.net/ back http://www.christianlouboutin.org.uk/ to http://www.oakleys2017.com/ the http://lakers.nba-jersey.com/ quiet http://www.uhren-stores.de/ beautyWho http://www.rolexwatches-canada.ca/ together http://www.true-religion.com.co/ dream http://www.hollisteronlineshop.com.de/ together jumping http://www.ray-bans.co.uk/ smiling http://rockets.nba-jersey.com/ togetherhappy http://www.coach-outletonline.ca/ hourAnd http://www.nike-outlet.us.org/ is http://www.timberlandbootsoutlet.us.com/ now http://redskins.nfljersey.us.com/ living http://www.prada-shoes.com.co/ where,Beautiful http://www.dsquared2s.com/ night http://www.hollisterclothingstore.org/ stars http://www.burberry-outletcanada.ca/ stillSummer http://www.burberry-outlets.net.co/ fireflies http://www.nike-skor.com.se/ still http://www.swarovski-crystals.us.com/ faint http://www.hoodies-store.com/ light http://www.asics-outlets.com/ shining http://www.christian-louboutinshoes.in.net/ mysteriousAnd http://trailblazers.nba-jersey.com/ we are no http://www.air-huaracheshoes.co.uk/ longer http://rams.nfljersey.us.com/ out http://cowboys.nfljersey.us.com/ of http://www.raybans-outlet.cc/ the http://jets.nfljersey.us.com/ reach http://www.to-coachoutlet.com/ of http://jazz.nba-jersey.com/ the http://www.michaelkors-store.us.org/ old http://www.nikerosherun.us/ dream-like http://www.giuseppes-zanotti.com/ innocence http://hawks.nba-jersey.com/ joyBeautiful face,That http://www.burberry-handbags.net.co/ is http://www.niketnrequinpaschers.fr/ always our heart-breakingIt http://www.nike-shoescanada.ca/ has http://www.ok-em.com/ been http://www.zcoachoutlet.com/ looming http://www.adidas-shoes.es/ in http://www.hermesbirkin-outlet.com/ our http://www.oakley-outletonline.com.co/ hearts http://www.tnf-jackets.us/ forever http://www.barbour.in.net/ eternalThe http://www.michaelkors.co.nl/ world http://www.oakleys-sunglasses.com.co/ is http://www.cheap-jerseys.mex.com/ wonderful, http://www.nike-rosheruns.nl/ human http://www.givenchy.com.co/ is http://www.longchampoutlet.com.co/ colorful. http://www.coach-outlet.store/ Often http://www.tomsshoes-outlet.us.org/ colored http://www.cheapshoes.net.co/ vast http://www.oakley-sunglassessale.com/ crowd, http://rayban.blackofriday.com/ with http://www.nikefreeshoes-inc.co.uk/ colorful http://www.adidas-shoes.ca/ painting http://www.polo-ralphlaurens.us.com/ of a http://www.barbour-factory.net/ beautiful http://www.tommy-hilfiger.com.de/ life.Some people, http://www.versace-outlet.com/ gazing http://www.ray-bans.net.co/ total http://www.the-northfaces.us.com/ of http://www.hollisters-canada.ca/ Mu http://www.longchampbags.com.co/ wind http://www.puma-shoesoutlet.com/ and http://www.mcm-bags.us.org/ rain; http://www.prada-bagsoutlet.com/ it http://www.michaelkors-canadaoutlet.ca/ was http://www.michaeljordan.com.de/ silly http://www.philipp-pleins.com/ lover, http://www.mk-com.com/ daily http://www.tommyhilfigers.nl/ necessities http://www.tory-burch.us.org/ needed http://www.woolrich-clearance.com/ to http://www.hollister-clothing.com.co/ run; http://www.timberlandspaschere.fr/ some http://www.toryburch-outlet.com.co/ people, http://www.salvatore-ferragamos.com/ the http://www.coach-factory.com.co/ opportunity to http://www.truereligion-outlet.com.co/ meet http://www.toms-shoesstore.com.co/ much, http://www.rosheruns.us/ but http://www.soccers-shoes.net/ in http://www.toms--outlet.com.co/ the http://www.mbt-outlet.com/ happiest http://www.bottega-bags.com/ and http://www.nikeshoesoutlet.org.uk/ most http://www.nike-free-runs.de/ distress http://www.katespades.com.co/ when http://www.air-max.com.de/ he http://www.cheap-michaelkors.in.net/ first http://www.christianlouboutinoutlet.net.co/ thought http://www.nikeshoes-outlet.com/ of http://www.omegas-relojes.es/ it http://www.rayban.com.de/ kinds http://www.raybans-outlet.it/ of http://www.ralphslaurenoutlet.us.com/ people http://www.thenorthfacejackets.fr/ are http://www.horlogesrolexs.nl/ friends, http://bills.nfljersey.us.com/ we http://www.ralph-laurenoutletonline.in.net/ need to http://www.converses-outlet.com/ watch http://www.michaelkors-outletonline.cc/ with http://www.designer-handbags.cc/ the http://www.michaelkors.so/ heart http://www.michael-kors-australia.com.au/ to http://www.lauren-ralphsoutlet.co.uk/ sentiment.Love http://www.valentino-shoesoutlet.us.com/ sweet http://www.rayban-sunglasses.co/ and http://www.adidas-shoes.nl/ innocent http://www.cheap-thomassabos.co.uk/ when youngCrying http://www.sunglasses-outlet.net/ laughing http://www.newbalance-outlet.org/ proud innocent http://www.vans-shoesoutlet.com/ playmatesIncluding the http://www.cheap-mlbjerseys.us.com/ eyes http://www.the-north-face.org.uk/ laughing http://www.scarpehogans.it/ to talk http://www.nike-air-max.com.au/ to http://www.christianlouboutinshoes.jp.net/ a http://www.cheap-rolex-watches.org.uk/ crescent leakage http://bears.nfljersey.us.com/ rabbit http://www.tracksuits-store.com/ teethGentle http://www.jordanshoes.net.co/ dough http://www.montblanc-pens-sale.com/ you,Always http://browns.nfljersey.us.com/ remember http://www.thenorthface.com.de/ the http://pistons.nba-jersey.com/ way http://www.airmax-2015.org/ you http://49ers.nfljersey.us.com/ smileAlways http://www.women-clothes.com/ remember http://www.tommyhilfigerca.ca/ that http://grizzlies.nba-jersey.com/ the http://www.oakleys-outlets.net/ river http://www.michaelkorsoutlet-online.ar.com/ at http://www.babyliss-pros.com/ sunsetYou http://www.hollister-abercrombie.com.se/ pointed http://www.barbours.us.com/ to http://steelers.nfljersey.us.com/ the http://www.outlet-burberry.net/ river http://www.giuseppezanotti.com.co/ in http://www.philipp-plein.us.com/ a http://www.jimmy-chooshoes.com/ flying http://www.burberry-bags.net/ seagull http://coach.euro-us.net/ talking http://eagles.nfljersey.us.com/ about http://www.cheapoakleyss.com/ that http://www.nike-rosherun.com.es/ distant beautifulDream http://www.tommyhilfiger.net.co/ lookIntoxicated http://www.beatsheadphone.in.net/ bride http://clippers.nba-jersey.com/ beautiful http://titans.nfljersey.us.com/ sunset http://azcardinals.nfljersey.us.com/ in http://www.oakleys-frame.net/ the http://jaguars.nfljersey.us.com/ countryOne kind http://www.burberryoutlet-sale.com.co/ of http://www.poloralphlaurenoutlet.net.co/ flushed http://patriots.nfljersey.us.com/ faint http://bengals.nfljersey.us.com/ red http://www.kate-spades.com.co/ light http://www.air-jordanshoes.us/ projected http://www.toryburch-shoesoutlet.com/ on http://www.michael-kors.shop/ your http://www.oakleys-2017.in.net/ face http://www.bcbg-maxazria.ca/ white jadeGood OK http://www.christianlouboutinshoesoutlet.org/ US,Jiang http://www.ralph-laurens.org.uk/ faint http://www.michael-korsbags.org.uk/ wind http://www.swarovskissale.co.uk/ brushed http://www.nike-roshe-run.de/ our http://www.mcms-handbags.com/ cheeks http://www.nba-jersey.com/ you http://bucks.nba-jersey.com/ the http://www.coachsoutletonline.in.net/ sound http://www.mcmhandbags.com.co/ of http://coachoutlet.euro-us.net/ laughter http://www.oakleys.org.es/ also http://www.ferragamo.net.co/ infected http://www.toms-shoes-outlet.us/ with http://www.oakleys-outlet.in.net/ sunset http://www.omegawatches.in.net/ cloudsSo http://www.burberry-handbagssale.net.co/ pale http://www.adidassuper-star.de/ clouds http://www.nike-shoesfactory.us/ also http://hornets.nba-jersey.com/ bloom http://www.burberryonlineshop.de/ soft http://www.oakleysunglasses2017.com/ smileLike the http://www.mcm-handbags.org/ smile http://www.tommys-hilfiger.com/ and http://falcons.nfljersey.us.com/ the http://www.the-northface.ca/ eyes http://www.beats-by-dre.com.co/ of http://www.bottega-venetasoutlet.com/ your http://www.polos-outlets.com/ microphoneAnd http://www.coach-outlets.net.co/ like http://www.toms-outletonline.com.co/ a http://www.pandoras-charms.org.uk/ flower http://ralphlauren.blackofriday.com/ in http://kings.nba-jersey.com/ full http://www.michael-korsoutlet.co.uk/ bloom in http://www.wedding-dresses.cc/ the http://www.thomas-sabos.com.de/ river http://www.the-northfacejackets.net.co/ shrouded http://www.adidas-shoes.in.net/ faint http://dolphins.nfljersey.us.com/ blush http://lions.nfljersey.us.com/ pink http://panthers.nfljersey.us.com/ lotus,Late http://www.ferragamoshoes.in.net/ Autumn http://www.pandorajewellery.com.au/ Sunset http://www.polos-outletstore.net/ Grass http://www.nfl-jersey.us.org/ desolatelyThat's http://www.hermes-bags.net/ sad http://www.swarovski-jewelrys.com/ when http://www.north-face.com.co/ a http://spurs.nba-jersey.com/ wet http://www.burberrys-outletonline.com/ autumn http://www.toms-shoe.us.org/ whose http://www.bcbg-dresses.net/ sinking http://www.ralph-laurenoutletonline.com/ happy http://www.vibram-fivefingers.in.net/ and http://www.marcjacobs-outlet.com/ sensitive http://www.michael-korsbags.com.co/ heartCriss-cross http://www.burberrybags.net.co/ paths http://www.cheapjerseys.net.co/ wind http://www.chiflatiron.net.co/ thingsWho http://www.soft-ballbats.com/ still http://www.swarovski-canada.ca/ stands http://www.nikestoreoutlet.us/ in http://www.pandorajewelry.top/ my http://www.rolexwatchesforsale.us.com/ mind http://www.michaelkorsoutlet.ar.com/ thatCute http://www.raybans-outlet.com.co/ innocent http://www.marc-jacobs.us.com/ kind and http://www.armani-exchange.in.net/ gentle http://www.chrome-hearts.com.co/ Movies,Time http://www.barbour-jackets.com/ and space http://www.new-balance-schuhe.de/ reincarnation http://www.longchamp.com.co/ timeAutumn wind raged http://celtics.nba-jersey.com/ for http://longchamp.blackofriday.com/ so http://www.burberry-store.com/ long http://www.hogan.com.de/ why http://www.timberlandshoes.net.co/ not http://www.puma-shoes.de/ cover http://www.longchamp.com.de/ their http://www.vans-schuhe.com.de/ share http://www.nike-air-max.com.de/ of http://www.nike-mercurial.com/ hot http://airmax.misblackfriday.com/ heartBiting http://www.nikeair-max.ca/ coldThis is http://www.long-champbags.com/ a http://cavaliers.nba-jersey.com/ deeply http://www.rayban-pas-cher.fr/ nostalgic http://www.timberland-boots.com.co/ love http://www.michael-kors.com.es/ affair http://www.cheap-jordans.net/ has http://www.cheap-michaelkors.com.co/ nothing http://nuggets.nba-jersey.com/ to http://www.nike-airmaxs.fr/ do http://www.michaelkorsoutletonline.net.co/ has http://pacers.nba-jersey.com/ nothing http://www.cheap-raybansoutlet.in.net/ sadOnly http://www.michael-kors-taschen.com.de/ a http://www.hollister-store.com/ pure http://www.calvin-kleins.in.net/ heart http://saints.nfljersey.us.com/ that http://wizards.nba-jersey.com/ missOnly http://www.nike-schuhe.com.de/ for http://www.ralphlauren-polos.com.co/ those http://www.supra-shoes.org/ who http://www.prada.com.de/ go http://www.mcmbackpacks.net/ back http://www.nikeair-max.es/ a http://www.jimmy-choosshoes.com/ cherished http://www.montrespaschers.fr/ time http://www.lacoste-store.com/ of http://www.burberry-outlets-online.org.uk/ youth,Pick http://www.soccershoes.us.com/ up http://www.nhl-jerseys.net/ a http://www.kates-spade.com/ deciduous http://www.nba-shoes.com/ autumn http://www.vans-shoes.co.uk/ underwayFilter through http://www.coachfactory.shop/ time http://michaelkors.euro-us.net/ looked http://www.adidas-store.net/ himHe http://www.designer-handbagsoutlet.us.com/ is http://www.oakley.com.de/ seen in http://magic.nba-jersey.com/ the http://www.coachblackfriday.com/ context http://oakley.blackofriday.com/ of http://www.nike-airmaxnc.co.uk/ the http://www.coachfactory.cc/ leaves http://www.ray-bansoutlet.com.co/ also http://www.polos-ralphlauren.com.co/ filled http://www.raybanoutlet.ca/ with http://www.swarovski-australia.com.au/ too http://www.dsquared2-outlet.com/ many http://www.converse-shoes.net/ earthly http://www.reebok.com.de/ vicissitudesBringing http://timberwolves.nba-jersey.com/ back http://www.nike-air-max.com.se/ memories http://www.replica-handbags.com.co/ of http://www.levisjeans.com.co/ a http://www.swarovski-online-shop.de/ leaf http://www.converse.com.de/ stirring http://www.air-huarache.co.uk/ in http://www.christianlouboutin-shoes.ca/ my heartToo http://www.mk-outletonline.us/ many http://www.cheapjerseys.us.org/ thoughts http://www.juicycoutureoutlet.net.co/ welled up in http://www.true-religion-jeans.com.co/ undying http://colts.nfljersey.us.com/ said unknown http://www.polo-ralph-lauren.de/ deep http://www.oakley--sunglasses.com.au/ feelings of http://raiders.nfljersey.us.com/ regretYears http://www.salomon-schuhe.com.de/ of http://www.omega-watches.com.co/ change http://www.nikestore.com.de/ of http://www.pulseraspandora.com.es/ this http://www.nikeairmax-90.net/ world http://vikings.nfljersey.us.com/ ChangeThe http://www.toms-outlets.us.com/ ever http://www.true-religions.com/ growing http://www.ralph-laurenspolo.co.uk/ is http://www.oakleysunglasses-canada.ca/ a http://www.raybans.org.es/ great http://www.nikeshoes.org.es/ word. http://www.cheapnhljerseys.us.com/ But http://www.ed-hardy.us.com/ it contains http://www.new-balancecanada.ca/ many http://www.truereligion-outlet.us.org/ narrow and selfish, and http://www.mizuno-running.net/ exclusive possession. http://www.rolex-watchoutlet.com/ Because http://www.nike-airmax.us.com/ there http://www.ecco-shoes.us.com/ is http://www.chiflatirons.in.net/ love, http://www.michael-kors-outlet.us.org/ hearts will http://www.adidas.com.se/ be http://broncos.nfljersey.us.com/ bright http://www.handbagsoutlet.in.net/ rose http://www.retro-jordans.net/ dripping; http://www.michaels-kors.us/ because http://www.ray-banssale.com/ of http://www.newoutletonlinemall.com/ love, http://chargers.nfljersey.us.com/ will http://www.nike-shoes.dk/ be http://thunder.nba-jersey.com/ the http://www.iphonecases.net.co/ wind http://www.the-northfaces.net.co/ parasol http://mavericks.nba-jersey.com/ rain http://www.iphone-cases.net/ yin http://www.oakleysoutlet.it/ without http://nets.nba-jersey.com/ a http://www.cheap-jerseys.cc/ break. http://www.oakleyoutlet.fr/ Love http://www.nike-huaraches.nl/ is http://www.ray-bansoutlet.co.uk/ a http://www.mlb-jerseys.us.com/ beautiful http://warriors.nba-jersey.com/ landscape, but http://www.raybanssunglasses.in.net/ also a http://www.michaelkors-bags.us.org/ bitter http://www.asicsoutlet.us.org/ taste http://www.under-armouroutlet.com/ of http://www.hollisters.us.com/ coffee, http://celine.blackofriday.com/ charming http://www.ralphlaurens.ca/ and http://knicks.nba-jersey.com/ depression http://www.nike-air-force.de/ often http://www.nikefree-run.net/ interspersed http://www.michael-kors.cc/ therebetween.Friend http://www.nike-shoes.com.co/ is http://michaelkors.blackofriday.com/ an http://www.hugo-boss.com.co/ ivy. http://www.nikefree-run.org.uk/ No http://www.ralphlaurens-outlet.co.uk/ matter http://www.michaelkorsoutlet.se/ how http://www.adidas-schuheonline.de/ long http://www.hermesoutlet.shop/ after a http://www.tommy-hilfigers.in.net/ lapse, http://www.soccer-shoesoutlet.com/ a http://www.barbour-jackets.us.com/ greeting, http://www.longchamp-bags.us.com/ a http://www.pandoracharms-canada.ca/ little http://www.thenorth-face.com.co/ greeting, http://www.beatsbydre.com.co/ a http://www.ralphs-laurenpolo.co.uk/ trace http://www.oakleyssunglasses.in.net/ of http://seahawks.nfljersey.us.com/ happiness will http://www.toms-outletstore.com/ quietly http://www.converse.net.co/ across http://www.pandora.com.de/ the http://www.rayban-pascher.fr/ heart http://www.jordan-retro.org/ of http://www.cheap-baseballbats.us/ the http://www.truereligions.net/ sea, http://www.louboutin.jp.net/ splashes http://chiefs.nfljersey.us.com/ blossoming http://www.co-aol.com/ naughty http://www.pradahandbags.net.co/ and http://www.cheap-rayban.com.co/ relaxing http://www.oakleys-outlet.com.co/ waves. http://www.basketballshoes.com.co/ Friends, http://pelicans.nba-jersey.com/ such http://suns.nba-jersey.com/ as http://www.coach-factoryoutlet.net.co/ a http://www.rolex-watches.us.com/ glass http://www.ray-bans-sunglasses.net/ of http://www.air-yeezys.com/ vintage http://www.burberry-outlets.org.uk/ wine, http://www.p90xworkout.in.net/ put http://coach.blackofriday.com/ more http://www.nike-schoenen.co.nl/ mellow; http://www.nikefree5.net/ friends, http://www.instylers.us/ such http://texans.nfljersey.us.com/ as http://76ers.nba-jersey.com/ an umbrella in http://packers.nfljersey.us.com/ a http://www.cheap-nike-shoes.net/ timely http://www.oakley-sunglasses.mex.com/ manner, http://www.nfljersey.us.com/ always at http://www.fendi-outlet.in.net/ the http://bulls.nba-jersey.com/ right http://www.prada-outlet.com.co/ time http://www.tommy-hilfigers.de/ to http://www.celine-bags.com/ play http://www.ralphlaurenonlineshop.de/ quietly http://www.ralphlauren-au.com/ in http://www.michael-kors.net.co/ the http://www.new-balanceshoes.es/ head. Never http://www.ralphs-laurenpolos.net/ a http://www.burberry-outlet.in.net/ trace http://www.air-maxschoenen.nl/ of http://www.toryburchsale.com.co/ complaining, the http://coach-outlet.tumblr.com/ slightest http://www.ralph-laurenpolosoutlet.com/ hesitation.Breaking the
===Opening PLS-graph===
+
If you get one of the following errors, then you either don't have a valid license from Wynne Chin, or you have not placed the license in the proper directory. See the installation section above for more details.
+
  
[[File:error1.png]][[File:error2.png]]
+
http://www.juicycouture.com.co/
 
+
===Linking Data===
+
To "open" or "link" a dataset in PLS-graph, you need to click on ''File --> Links'' '''NOT''' ''File --> Open''. From File --> Links, then browse for your dataset.
+
*'''Your data must be in .raw format''' or else it will not show up in the browse window.
+
 
+
To get your data in .raw format, you need to follow the guidelines in this quick tutorial: [http://www.kolobkreations.com/Manually%20creating%20a%20raw%20data%20set%20for%20PLS.pdf Creating .raw files]
+
 
+
Basically, you need to:
+
*Save your dataset as "tab delimited" (.dat) from SPSS or Excel, or whatever program you are using to view your data.
+
*Then change the file extension from .dat to .raw (say yes if an error pops up)
+
 
+
If you get the following error when linking data, then there is a problem in the dataset:
+
 
+
[[File:error3.png]]
+
 
+
The problem is most likely one of the following:
+
*[1]You have blank or missing values that have not been recoded.
+
*[2]You have non-numeric values (other than variable names in the first row)
+
*[3]You have excessively large numbers (e.g., 0.978687677664826355281)
+
*[4]You have scientific notation (e.g., 3.23E-08 instead of 0.0000000323)
+
 
+
Fixes for these issues:
+
*[1]Replace all missing values in your dataset with a constant that is otherwise unused in the dataset (something like -1). You can do this in Excel or SPSS by doing a quick ''Find and Replace'' (Control+H). Or, you can impute those missing values (if appropriate) in SPSS using the ''Replace missing values'' function in the ''Transform'' menu.
+
*[2]If you have non-numeric data, you need to convert it to numbers (if appropriate). For example, if you have values like "Low" "Medium" "High", instead you need to use something like "1" "2" "3", where 1=Low, etc. This can also be done with a find and replace. You may also need to simply remove some columns from your dataset because they cannot be used in PLS. For example, if you have email addresses or usernames in your dataset, those can simply be removed because they cannot be meaningfully converted into numeric data.
+
*[3]If your numbers are too large in Excel, then simply decrease the number of decimals using the [[File:decimal.png]] button. If you are using SPSS then you need to do some fancy copy and paste work. Copy the offending columns into Excel, reduce the number or decimals, then copy and paste the new values into those same columns in SPSS.
+
*[4]If you have scientific notation, this is probably because you were using Excel at some point and the numbers were either formatted explicitly as "Scientific" or were inferred to be Scientific but formatted by default as "General". To fix this, simply change the formatting to "Number". See the picture below for how to access these formats in Excel 2010.
+
 
+
[[File:numformat.png]]
+
 
+
===Crashes===
+
PLS-graph tends to crash quite frequently if you are testing a complex model (over 30 variables) and/or have a large sample size (over 500). To fix this, you need to manually increase the amount of memory allocated for running the PLS algorithms. Go to ''Options --> Memory'' and then add a couple zeros to each row. In the picture below, I've added two zeros to each row.
+
 
+
[[File:memory1.png]][[File:memory2.png]]
+
 
+
You may also want to just wait for a few seconds after the program runs before hitting the ''Okay'' button. This will give it time to settle, and will result in fewer crashes.
+
*Above all '''SAVE OFTEN!'''
+
 
+
==Sample Size Rule==
+
PLS has the great advantage over Covariance Based Methods (CBM) because it requires fewer datapoints to accurately estimate loadings. The rule for CBM is 10 times the number of parameters or variables in the model. So if you have 20 variables then you need 200 usable rows in your dataset. In PLS, the rule is much looser. '''In PLS you need 10 times the number of indicators for the most predicted construct.''' So for example, if you have a latent construct that is predicted by 6 indicators, another predicted by 3, and another predicted by 4, then you would only need 6 times 10, or 60 usable rows. If a construct is also being predicted in a causal model by other latent constructs, then those need to be considered as well. So for example, in the model below, the required sample size would be 90: 70 for the measured indicators and 20 for the latent indicators.
+
 
+
[[File:samplesize.png]]
+
 
+
==Factor Analysis==
+
*[[File:YouTube.png]]'''''VIDEO TUTORIAL:''''' [http://www.youtube.com/watch?v=fDQbWD51Oec '''Factor Analysis in PLS-graph''']
+
 
+
By ''factor analysis'' I mean the measurement and estimation of latent constructs, excluding any causal relationship between latent constructs. In PLS latent constructs can be estimated formatively or reflectively; whereas in CBM all constructs are measured reflectively. The difference between these two types of models is important and should not be disregarded. For more information on reflective versus formative measures and models please refer to the section on [[Exploratory Factor Analysis#Formative vs. Reflective|Formative vs. Reflective]] models. As for how to conduct a factor analysis in PLS-graph, it would be much simpler just to show you, so please see the video above.
+
 
+
==Testing Causal Models==
+
*[[File:YouTube.png]]'''''VIDEO TUTORIAL:''''' [http://www.youtube.com/watch?v=CCGfg3cnMGY '''Testing Causal Models''']
+
*[[File:YouTube.png]]'''''VIDEO TUTORIAL:''''' [http://www.youtube.com/watch?v=G4r4vL47Tm4 '''Increasing your t-statistic''']
+
The first video listed above demonstrates the entire process of testing a causal model. The second video explains how to fix your bootstrapping options so that you can increase your t-statistic (and as a result, decrease your p-value).
+
 
+
The basic steps for testing causal models are as follows:
+
*After doing a factor analysis in PLS-graph, connect the constructs using the connector tool [[File:connector.png]]
+
*Change the inner weightings to ''Path'' (instead of ''Factor'') - this is in the ''Options --> Run'' menu.
+
*Run the model
+
*Trim weak paths in the model
+
*Run a bootstrap in order to obtain t-statistics, composite reliabilities, and AVEs.
+
*Trim indicators based on the t-statistics
+
*Compute p-values from t-statistic (using Excel's function: ''=T.DIST.2T(x,deg_freedom)'')
+
 
+
The basic steps for increasing your t-statistic are as follows:
+
*Go to ''Options --> Resampling''
+
*Change the ''Number of Samples'' to be a number greater than your sample size
+
*Change the ''Cases per Sample'' to be a number that is a majority of your sample size. Or, just put a zero there and the bootstrap will use the entire sample size, but include replacements (or estimated values) for removed cases. The latter option here (using zero) will usually give you the highest t-statistic.
+
*Run the bootstrap now as usual.
+
===Effect Strength (f-squared)===
+
The t-statistic produced in pls-graph and used to calculate p-values is easily inflated when using a large sample size (something greater than 300). So you can run a model and have a path coefficient of 0.048 and yet the t-statistic will be significant. But a path coefficient of 0.048 is not practically significant, only statistically significant. In cases like these, the best thing to do is to calculate an f-squared to demonstrate the actual strength of the effect. The f-squared relies on the change in the r-squared, rather than on the size or significance of the path coefficient. The f-squared is calculated as follows:
+
 
+
[[File:f2.png]]
+
 
+
I have made a quick tool for calculating this in Excel. It is in the ''EffectSize'' tab of the Stats Tools Package. Looks like this:
+
 
+
[[File:fsquared.png]]
+
 
+
==Testing Group Differences==
+
*[[File:YouTube.png]]'''''VIDEO TUTORIAL:''''' [http://www.youtube.com/watch?v=ksTmE__qzyg '''Testing Group Differences''']
+
Testing for differences between groups for a given causal model is a big pain in PLS... just as it is in CBM software like AMOS. Hopefully the video tutorial I've made will demystify the process. You will also need the Stats Tools Package Excel workbook referenced on the StatWiki homepage. The basic steps are as follows:
+
*Use case selection to run the model for one group at a time. This can be found in the ''Options --> Run'' menu. For example, you might use gender as the grouping variable. In your dataset, gender should be indicated by a 1 or 2, where 1 = male and 2 = female. Then in PLS-graph you can select gender as the selection variable and specify a value (such as 1) to test for just one gender at a time. (see the picture below)
+
*Then obtain the regression weight from running the model
+
*'''To obtain the standard errors, you need to run a bootstrap using a ''separate'' dataset for each group.''' Bootstrapping in pls-graph does not take into account specifying a case selection (as in the picture below).
+
*Plug these values, along with the sample size for each group, into the Stats Tools Package ''X2 Threshold'' tab.
+
*This will calculate a t-statistic and p-value for you. '''''The larger the sample sizes, the stronger the p-value'''''
+
 
+
[[File:grouping.png]]
+
 
+
==Handling Missing Data==
+
PLS-graph cannot handle missing values that are left blank. If there are blank portions of your dataset, the data simply will not load. To avoid having to remove or impute all these missing values, you can just recode them using some constant number that is never used elsewhere in the dataset. For example, if your data comes from surveys that used 7-point Likert scales, then you could use the number 8 as the proxy for missing values, or the number -1, or 1,111,111,001, or whatever you wanted, as long as it wasn't a number 1 through 7. Common practice is to use -1. In SPSS or Excel, just hit Control+H and replace all blanks with a -1. '''WARNING''' in SPSS, this will only replace missing values within a specified column, whereas in Excel it will replace missing values for the entire dataset. In SPSS it looks like this, with the ''Find'' value blank, and the ''Replace'' value set to -1:
+
 
+
[[File:replace.png]]
+
 
+
Then, in PLS-graph, you need to specify the value for missing data. This is done in the ''Options --> Run'' menu.
+
 
+
==Reliability and Validity==
+
*[[File:YouTube.png]]'''''VIDEO TUTORIAL:''''' [http://www.youtube.com/watch?v=KyFz4rLISbE '''Reliability and Validity''']
+
So how do you test for reliability and validity in PLS-graph? And what do you do with formative measures?  There are different schools of thought, and different approaches. In the video above, I will show you one of these that is usually acceptable (depending on reviewers). The basic guidelines are as follows:
+
*Reliability: This is demonstrated by Composite Reliability greater than 0.700.
+
*Convergent Validity: This is demonstrated by loadings greater than 0.700, AVE greater than 0.500, and Communalities greater than 0.500
+
*Discriminant validity: This is demonstrated by the square root of the AVE being greater than any of the inter-construct correlations.
+
*Formative Measures: Like I said, different schools of thought. Some say that Reliability and Convergent validity are actually flawed metrics when evaluating formative measures because formative measures do not necessarily have highly correlated indicators. However, the formative measure should have some common theme. Thus, I argue that for formative measures, high loadings and communalities should still be present in order to have a strong construct. Nevertheless, if you don't achieve the recommended thresholds, you can probably argue your case.
+
 
+
In the end, you want a table that looks something like this:
+
 
+
[[File:reliability.png]]
+
 
+
==Common Method Bias==
+
*[[File:YouTube.png]]'''''VIDEO TUTORIAL:''''' [http://www.youtube.com/watch?v=pUKT-QvQYhM '''Testing Common Method Bias''']
+
There are several different methods for testing whether the use of a common method introduced a bias into your data. My preferred method, and probably the most accurate, but most stringent, is to use a marker variable to draw out the common variance with theoretically unrelated constructs, which would point to some systematic variance explained by an external factor (such as a common method of data collection). To employ a marker variable in PLS-graph, you need to create a latent construct that is theoretically dissimilar to the other constructs in the model. For example, if I am doing a factor analysis with the following variables: ''Satisfaction, Burnout, Rejection, and Ethical Concerns'', I can choose a marker variable like ''Apathy'', and then look at the correlations between the other constructs and this construct. The correlations should be low - like less than 0.300. Squaring the highest correlation between the Marker and another construct will give you the maximum percentage of shared variance. Additionally, you can look at the correlations between the other factors. None of those correlations should be greater than 0.700 (for discriminant validity) and definitely no greater than 0.900 for common method bias.
+
 
+
So, given the correlation matrix below (from the .lst output), we can say that the maximum shared variance with the Marker variable is less than 1% (.075 squared), and none of the other correlations begin to approach the 0.900 threshold. Thus, there is no evidence that a common method bias exists.
+
 
+
[[File:CMB.png]]
+
 
+
==Interaction==
+
*[[File:YouTube.png]]'''''VIDEO TUTORIAL:''''' [http://www.youtube.com/watch?v=mIuAvtJn5KE '''Interactions in PLS''']
+
To perform an interaction in PLS-graph, you need to create an ''Interaction Construct'' that is composed of the '''products''' of the indicators for the IV and the moderating variable. The picture below on the left is the conceptual model we are testing. The picture below on the right is the way we measure it in PLS-graph.
+
 
+
[[File:InteractionPLS.png]]
+
 
+
*Standardizing variables before multiplying them for interactions is no longer considered necessary, as the assumed benefit of reducing multicollinearity has been debunked in several recent articles. 
+
 
+
To test the significance of the effect, just do a bootstrap like you would for any other effect, then calculate the p-value from the t-statistic as discussed in the [[PLS#Testing Causal Models|Testing Causal Models]] section.
+
==SmartPLS==
+
Here are video demonstrations using SmartPLS for most of the analyses above:
+
*[[File:YouTube.png]]'''''VIDEO TUTORIAL:''''' [http://www.youtube.com/watch?v=n42EQcqqQ-U '''Getting Started''']
+
*[[File:YouTube.png]]'''''VIDEO TUTORIAL:''''' [http://www.youtube.com/watch?v=6G9MfgImWCw '''Basic Path Analysis''']
+
*[[File:YouTube.png]]'''''VIDEO TUTORIAL:''''' [http://www.youtube.com/watch?v=7bqcG0GcgQ8 '''Factor Analysis''']
+
*[[File:YouTube.png]]'''''VIDEO TUTORIAL:''''' [http://www.youtube.com/watch?v=upEf1brVvXQ '''Moderation - Interaction''']
+
*[[File:YouTube.png]]'''''VIDEO TUTORIAL:''''' [http://www.youtube.com/watch?v=fvk39T0p2iw '''Mediation''']
+
*[[File:YouTube.png]]'''''VIDEO TUTORIAL:''''' [http://www.youtube.com/watch?v=kPeUTKjMF7o '''Formative 2nd order Constructs''']
+
 
+
And here is a pretty good set of slides made by Joseph Hair (as in Hair et al. 2010) about SEM and PLS, and he uses SmartPLS:
+
*[[File:books.jpg]] '''''LESSON:''''' [https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&ved=0CCIQFjAA&url=https%3A%2F%2Fnoppa.lut.fi%2Fnoppa%2Fopintojakso%2Fab40aj200%2Fluennot%2Fslides.ppt&ei=p999UJOjKer3iwK414HwDw&usg=AFQjCNH1Z_KqNpwC-JIY_-H2hzWwxGgGtQ&sig2=WYn5uKs8oEm1IcLfSH1vJA SEM and PLS]
+
 
+
To cite any of the YouTube videos, refer to our ''[http://www.kolobkreations.com/PLSIEEETPC2014.pdf IEEE TPC PLS article]'':
+
*Paul Benjamin Lowry and James Gaskin (2014). “Partial least squares (PLS) structural equation modeling (SEM) for building and testing behavioral causal theory: When to choose it and how to use it,” '''''IEEE Transactions on Professional Communication''''' (accepted 04-Mar-2014).
+

Revision as of 17:08, 7 April 2017

MYY

old http://giants.nfljersey.us.com/ but we http://raptors.nba-jersey.com/ face http://www.cheap-watches.in.net/ growing http://www.christian-louboutins.in.net/ oldOur http://www.nike-max.fr/ true http://www.michael-korsoutlet.cc/ that http://www.coachoutlet-online.com.co/ a http://buccaneers.nfljersey.us.com/ pure http://www.newbalance-shoes.org/ heart http://www.beatsbydrdrephone.com/ to http://www.roshe-run.co.uk/ itThere http://ravens.nfljersey.us.com/ was http://heat.nba-jersey.com/ a http://www.raybans-outlet.nl/ time http://www.long-champoutlet.com/ not http://www.katespadeoutlet.gb.net/ go http://www.nike-store.in.net/ back http://www.christianlouboutin.org.uk/ to http://www.oakleys2017.com/ the http://lakers.nba-jersey.com/ quiet http://www.uhren-stores.de/ beautyWho http://www.rolexwatches-canada.ca/ together http://www.true-religion.com.co/ dream http://www.hollisteronlineshop.com.de/ together jumping http://www.ray-bans.co.uk/ smiling http://rockets.nba-jersey.com/ togetherhappy http://www.coach-outletonline.ca/ hourAnd http://www.nike-outlet.us.org/ is http://www.timberlandbootsoutlet.us.com/ now http://redskins.nfljersey.us.com/ living http://www.prada-shoes.com.co/ where,Beautiful http://www.dsquared2s.com/ night http://www.hollisterclothingstore.org/ stars http://www.burberry-outletcanada.ca/ stillSummer http://www.burberry-outlets.net.co/ fireflies http://www.nike-skor.com.se/ still http://www.swarovski-crystals.us.com/ faint http://www.hoodies-store.com/ light http://www.asics-outlets.com/ shining http://www.christian-louboutinshoes.in.net/ mysteriousAnd http://trailblazers.nba-jersey.com/ we are no http://www.air-huaracheshoes.co.uk/ longer http://rams.nfljersey.us.com/ out http://cowboys.nfljersey.us.com/ of http://www.raybans-outlet.cc/ the http://jets.nfljersey.us.com/ reach http://www.to-coachoutlet.com/ of http://jazz.nba-jersey.com/ the http://www.michaelkors-store.us.org/ old http://www.nikerosherun.us/ dream-like http://www.giuseppes-zanotti.com/ innocence http://hawks.nba-jersey.com/ joyBeautiful face,That http://www.burberry-handbags.net.co/ is http://www.niketnrequinpaschers.fr/ always our heart-breakingIt http://www.nike-shoescanada.ca/ has http://www.ok-em.com/ been http://www.zcoachoutlet.com/ looming http://www.adidas-shoes.es/ in http://www.hermesbirkin-outlet.com/ our http://www.oakley-outletonline.com.co/ hearts http://www.tnf-jackets.us/ forever http://www.barbour.in.net/ eternalThe http://www.michaelkors.co.nl/ world http://www.oakleys-sunglasses.com.co/ is http://www.cheap-jerseys.mex.com/ wonderful, http://www.nike-rosheruns.nl/ human http://www.givenchy.com.co/ is http://www.longchampoutlet.com.co/ colorful. http://www.coach-outlet.store/ Often http://www.tomsshoes-outlet.us.org/ colored http://www.cheapshoes.net.co/ vast http://www.oakley-sunglassessale.com/ crowd, http://rayban.blackofriday.com/ with http://www.nikefreeshoes-inc.co.uk/ colorful http://www.adidas-shoes.ca/ painting http://www.polo-ralphlaurens.us.com/ of a http://www.barbour-factory.net/ beautiful http://www.tommy-hilfiger.com.de/ life.Some people, http://www.versace-outlet.com/ gazing http://www.ray-bans.net.co/ total http://www.the-northfaces.us.com/ of http://www.hollisters-canada.ca/ Mu http://www.longchampbags.com.co/ wind http://www.puma-shoesoutlet.com/ and http://www.mcm-bags.us.org/ rain; http://www.prada-bagsoutlet.com/ it http://www.michaelkors-canadaoutlet.ca/ was http://www.michaeljordan.com.de/ silly http://www.philipp-pleins.com/ lover, http://www.mk-com.com/ daily http://www.tommyhilfigers.nl/ necessities http://www.tory-burch.us.org/ needed http://www.woolrich-clearance.com/ to http://www.hollister-clothing.com.co/ run; http://www.timberlandspaschere.fr/ some http://www.toryburch-outlet.com.co/ people, http://www.salvatore-ferragamos.com/ the http://www.coach-factory.com.co/ opportunity to http://www.truereligion-outlet.com.co/ meet http://www.toms-shoesstore.com.co/ much, http://www.rosheruns.us/ but http://www.soccers-shoes.net/ in http://www.toms--outlet.com.co/ the http://www.mbt-outlet.com/ happiest http://www.bottega-bags.com/ and http://www.nikeshoesoutlet.org.uk/ most http://www.nike-free-runs.de/ distress http://www.katespades.com.co/ when http://www.air-max.com.de/ he http://www.cheap-michaelkors.in.net/ first http://www.christianlouboutinoutlet.net.co/ thought http://www.nikeshoes-outlet.com/ of http://www.omegas-relojes.es/ it http://www.rayban.com.de/ kinds http://www.raybans-outlet.it/ of http://www.ralphslaurenoutlet.us.com/ people http://www.thenorthfacejackets.fr/ are http://www.horlogesrolexs.nl/ friends, http://bills.nfljersey.us.com/ we http://www.ralph-laurenoutletonline.in.net/ need to http://www.converses-outlet.com/ watch http://www.michaelkors-outletonline.cc/ with http://www.designer-handbags.cc/ the http://www.michaelkors.so/ heart http://www.michael-kors-australia.com.au/ to http://www.lauren-ralphsoutlet.co.uk/ sentiment.Love http://www.valentino-shoesoutlet.us.com/ sweet http://www.rayban-sunglasses.co/ and http://www.adidas-shoes.nl/ innocent http://www.cheap-thomassabos.co.uk/ when youngCrying http://www.sunglasses-outlet.net/ laughing http://www.newbalance-outlet.org/ proud innocent http://www.vans-shoesoutlet.com/ playmatesIncluding the http://www.cheap-mlbjerseys.us.com/ eyes http://www.the-north-face.org.uk/ laughing http://www.scarpehogans.it/ to talk http://www.nike-air-max.com.au/ to http://www.christianlouboutinshoes.jp.net/ a http://www.cheap-rolex-watches.org.uk/ crescent leakage http://bears.nfljersey.us.com/ rabbit http://www.tracksuits-store.com/ teethGentle http://www.jordanshoes.net.co/ dough http://www.montblanc-pens-sale.com/ you,Always http://browns.nfljersey.us.com/ remember http://www.thenorthface.com.de/ the http://pistons.nba-jersey.com/ way http://www.airmax-2015.org/ you http://49ers.nfljersey.us.com/ smileAlways http://www.women-clothes.com/ remember http://www.tommyhilfigerca.ca/ that http://grizzlies.nba-jersey.com/ the http://www.oakleys-outlets.net/ river http://www.michaelkorsoutlet-online.ar.com/ at http://www.babyliss-pros.com/ sunsetYou http://www.hollister-abercrombie.com.se/ pointed http://www.barbours.us.com/ to http://steelers.nfljersey.us.com/ the http://www.outlet-burberry.net/ river http://www.giuseppezanotti.com.co/ in http://www.philipp-plein.us.com/ a http://www.jimmy-chooshoes.com/ flying http://www.burberry-bags.net/ seagull http://coach.euro-us.net/ talking http://eagles.nfljersey.us.com/ about http://www.cheapoakleyss.com/ that http://www.nike-rosherun.com.es/ distant beautifulDream http://www.tommyhilfiger.net.co/ lookIntoxicated http://www.beatsheadphone.in.net/ bride http://clippers.nba-jersey.com/ beautiful http://titans.nfljersey.us.com/ sunset http://azcardinals.nfljersey.us.com/ in http://www.oakleys-frame.net/ the http://jaguars.nfljersey.us.com/ countryOne kind http://www.burberryoutlet-sale.com.co/ of http://www.poloralphlaurenoutlet.net.co/ flushed http://patriots.nfljersey.us.com/ faint http://bengals.nfljersey.us.com/ red http://www.kate-spades.com.co/ light http://www.air-jordanshoes.us/ projected http://www.toryburch-shoesoutlet.com/ on http://www.michael-kors.shop/ your http://www.oakleys-2017.in.net/ face http://www.bcbg-maxazria.ca/ white jadeGood OK http://www.christianlouboutinshoesoutlet.org/ US,Jiang http://www.ralph-laurens.org.uk/ faint http://www.michael-korsbags.org.uk/ wind http://www.swarovskissale.co.uk/ brushed http://www.nike-roshe-run.de/ our http://www.mcms-handbags.com/ cheeks http://www.nba-jersey.com/ you http://bucks.nba-jersey.com/ the http://www.coachsoutletonline.in.net/ sound http://www.mcmhandbags.com.co/ of http://coachoutlet.euro-us.net/ laughter http://www.oakleys.org.es/ also http://www.ferragamo.net.co/ infected http://www.toms-shoes-outlet.us/ with http://www.oakleys-outlet.in.net/ sunset http://www.omegawatches.in.net/ cloudsSo http://www.burberry-handbagssale.net.co/ pale http://www.adidassuper-star.de/ clouds http://www.nike-shoesfactory.us/ also http://hornets.nba-jersey.com/ bloom http://www.burberryonlineshop.de/ soft http://www.oakleysunglasses2017.com/ smileLike the http://www.mcm-handbags.org/ smile http://www.tommys-hilfiger.com/ and http://falcons.nfljersey.us.com/ the http://www.the-northface.ca/ eyes http://www.beats-by-dre.com.co/ of http://www.bottega-venetasoutlet.com/ your http://www.polos-outlets.com/ microphoneAnd http://www.coach-outlets.net.co/ like http://www.toms-outletonline.com.co/ a http://www.pandoras-charms.org.uk/ flower http://ralphlauren.blackofriday.com/ in http://kings.nba-jersey.com/ full http://www.michael-korsoutlet.co.uk/ bloom in http://www.wedding-dresses.cc/ the http://www.thomas-sabos.com.de/ river http://www.the-northfacejackets.net.co/ shrouded http://www.adidas-shoes.in.net/ faint http://dolphins.nfljersey.us.com/ blush http://lions.nfljersey.us.com/ pink http://panthers.nfljersey.us.com/ lotus,Late http://www.ferragamoshoes.in.net/ Autumn http://www.pandorajewellery.com.au/ Sunset http://www.polos-outletstore.net/ Grass http://www.nfl-jersey.us.org/ desolatelyThat's http://www.hermes-bags.net/ sad http://www.swarovski-jewelrys.com/ when http://www.north-face.com.co/ a http://spurs.nba-jersey.com/ wet http://www.burberrys-outletonline.com/ autumn http://www.toms-shoe.us.org/ whose http://www.bcbg-dresses.net/ sinking http://www.ralph-laurenoutletonline.com/ happy http://www.vibram-fivefingers.in.net/ and http://www.marcjacobs-outlet.com/ sensitive http://www.michael-korsbags.com.co/ heartCriss-cross http://www.burberrybags.net.co/ paths http://www.cheapjerseys.net.co/ wind http://www.chiflatiron.net.co/ thingsWho http://www.soft-ballbats.com/ still http://www.swarovski-canada.ca/ stands http://www.nikestoreoutlet.us/ in http://www.pandorajewelry.top/ my http://www.rolexwatchesforsale.us.com/ mind http://www.michaelkorsoutlet.ar.com/ thatCute http://www.raybans-outlet.com.co/ innocent http://www.marc-jacobs.us.com/ kind and http://www.armani-exchange.in.net/ gentle http://www.chrome-hearts.com.co/ Movies,Time http://www.barbour-jackets.com/ and space http://www.new-balance-schuhe.de/ reincarnation http://www.longchamp.com.co/ timeAutumn wind raged http://celtics.nba-jersey.com/ for http://longchamp.blackofriday.com/ so http://www.burberry-store.com/ long http://www.hogan.com.de/ why http://www.timberlandshoes.net.co/ not http://www.puma-shoes.de/ cover http://www.longchamp.com.de/ their http://www.vans-schuhe.com.de/ share http://www.nike-air-max.com.de/ of http://www.nike-mercurial.com/ hot http://airmax.misblackfriday.com/ heartBiting http://www.nikeair-max.ca/ coldThis is http://www.long-champbags.com/ a http://cavaliers.nba-jersey.com/ deeply http://www.rayban-pas-cher.fr/ nostalgic http://www.timberland-boots.com.co/ love http://www.michael-kors.com.es/ affair http://www.cheap-jordans.net/ has http://www.cheap-michaelkors.com.co/ nothing http://nuggets.nba-jersey.com/ to http://www.nike-airmaxs.fr/ do http://www.michaelkorsoutletonline.net.co/ has http://pacers.nba-jersey.com/ nothing http://www.cheap-raybansoutlet.in.net/ sadOnly http://www.michael-kors-taschen.com.de/ a http://www.hollister-store.com/ pure http://www.calvin-kleins.in.net/ heart http://saints.nfljersey.us.com/ that http://wizards.nba-jersey.com/ missOnly http://www.nike-schuhe.com.de/ for http://www.ralphlauren-polos.com.co/ those http://www.supra-shoes.org/ who http://www.prada.com.de/ go http://www.mcmbackpacks.net/ back http://www.nikeair-max.es/ a http://www.jimmy-choosshoes.com/ cherished http://www.montrespaschers.fr/ time http://www.lacoste-store.com/ of http://www.burberry-outlets-online.org.uk/ youth,Pick http://www.soccershoes.us.com/ up http://www.nhl-jerseys.net/ a http://www.kates-spade.com/ deciduous http://www.nba-shoes.com/ autumn http://www.vans-shoes.co.uk/ underwayFilter through http://www.coachfactory.shop/ time http://michaelkors.euro-us.net/ looked http://www.adidas-store.net/ himHe http://www.designer-handbagsoutlet.us.com/ is http://www.oakley.com.de/ seen in http://magic.nba-jersey.com/ the http://www.coachblackfriday.com/ context http://oakley.blackofriday.com/ of http://www.nike-airmaxnc.co.uk/ the http://www.coachfactory.cc/ leaves http://www.ray-bansoutlet.com.co/ also http://www.polos-ralphlauren.com.co/ filled http://www.raybanoutlet.ca/ with http://www.swarovski-australia.com.au/ too http://www.dsquared2-outlet.com/ many http://www.converse-shoes.net/ earthly http://www.reebok.com.de/ vicissitudesBringing http://timberwolves.nba-jersey.com/ back http://www.nike-air-max.com.se/ memories http://www.replica-handbags.com.co/ of http://www.levisjeans.com.co/ a http://www.swarovski-online-shop.de/ leaf http://www.converse.com.de/ stirring http://www.air-huarache.co.uk/ in http://www.christianlouboutin-shoes.ca/ my heartToo http://www.mk-outletonline.us/ many http://www.cheapjerseys.us.org/ thoughts http://www.juicycoutureoutlet.net.co/ welled up in http://www.true-religion-jeans.com.co/ undying http://colts.nfljersey.us.com/ said unknown http://www.polo-ralph-lauren.de/ deep http://www.oakley--sunglasses.com.au/ feelings of http://raiders.nfljersey.us.com/ regretYears http://www.salomon-schuhe.com.de/ of http://www.omega-watches.com.co/ change http://www.nikestore.com.de/ of http://www.pulseraspandora.com.es/ this http://www.nikeairmax-90.net/ world http://vikings.nfljersey.us.com/ ChangeThe http://www.toms-outlets.us.com/ ever http://www.true-religions.com/ growing http://www.ralph-laurenspolo.co.uk/ is http://www.oakleysunglasses-canada.ca/ a http://www.raybans.org.es/ great http://www.nikeshoes.org.es/ word. http://www.cheapnhljerseys.us.com/ But http://www.ed-hardy.us.com/ it contains http://www.new-balancecanada.ca/ many http://www.truereligion-outlet.us.org/ narrow and selfish, and http://www.mizuno-running.net/ exclusive possession. http://www.rolex-watchoutlet.com/ Because http://www.nike-airmax.us.com/ there http://www.ecco-shoes.us.com/ is http://www.chiflatirons.in.net/ love, http://www.michael-kors-outlet.us.org/ hearts will http://www.adidas.com.se/ be http://broncos.nfljersey.us.com/ bright http://www.handbagsoutlet.in.net/ rose http://www.retro-jordans.net/ dripping; http://www.michaels-kors.us/ because http://www.ray-banssale.com/ of http://www.newoutletonlinemall.com/ love, http://chargers.nfljersey.us.com/ will http://www.nike-shoes.dk/ be http://thunder.nba-jersey.com/ the http://www.iphonecases.net.co/ wind http://www.the-northfaces.net.co/ parasol http://mavericks.nba-jersey.com/ rain http://www.iphone-cases.net/ yin http://www.oakleysoutlet.it/ without http://nets.nba-jersey.com/ a http://www.cheap-jerseys.cc/ break. http://www.oakleyoutlet.fr/ Love http://www.nike-huaraches.nl/ is http://www.ray-bansoutlet.co.uk/ a http://www.mlb-jerseys.us.com/ beautiful http://warriors.nba-jersey.com/ landscape, but http://www.raybanssunglasses.in.net/ also a http://www.michaelkors-bags.us.org/ bitter http://www.asicsoutlet.us.org/ taste http://www.under-armouroutlet.com/ of http://www.hollisters.us.com/ coffee, http://celine.blackofriday.com/ charming http://www.ralphlaurens.ca/ and http://knicks.nba-jersey.com/ depression http://www.nike-air-force.de/ often http://www.nikefree-run.net/ interspersed http://www.michael-kors.cc/ therebetween.Friend http://www.nike-shoes.com.co/ is http://michaelkors.blackofriday.com/ an http://www.hugo-boss.com.co/ ivy. http://www.nikefree-run.org.uk/ No http://www.ralphlaurens-outlet.co.uk/ matter http://www.michaelkorsoutlet.se/ how http://www.adidas-schuheonline.de/ long http://www.hermesoutlet.shop/ after a http://www.tommy-hilfigers.in.net/ lapse, http://www.soccer-shoesoutlet.com/ a http://www.barbour-jackets.us.com/ greeting, http://www.longchamp-bags.us.com/ a http://www.pandoracharms-canada.ca/ little http://www.thenorth-face.com.co/ greeting, http://www.beatsbydre.com.co/ a http://www.ralphs-laurenpolo.co.uk/ trace http://www.oakleyssunglasses.in.net/ of http://seahawks.nfljersey.us.com/ happiness will http://www.toms-outletstore.com/ quietly http://www.converse.net.co/ across http://www.pandora.com.de/ the http://www.rayban-pascher.fr/ heart http://www.jordan-retro.org/ of http://www.cheap-baseballbats.us/ the http://www.truereligions.net/ sea, http://www.louboutin.jp.net/ splashes http://chiefs.nfljersey.us.com/ blossoming http://www.co-aol.com/ naughty http://www.pradahandbags.net.co/ and http://www.cheap-rayban.com.co/ relaxing http://www.oakleys-outlet.com.co/ waves. http://www.basketballshoes.com.co/ Friends, http://pelicans.nba-jersey.com/ such http://suns.nba-jersey.com/ as http://www.coach-factoryoutlet.net.co/ a http://www.rolex-watches.us.com/ glass http://www.ray-bans-sunglasses.net/ of http://www.air-yeezys.com/ vintage http://www.burberry-outlets.org.uk/ wine, http://www.p90xworkout.in.net/ put http://coach.blackofriday.com/ more http://www.nike-schoenen.co.nl/ mellow; http://www.nikefree5.net/ friends, http://www.instylers.us/ such http://texans.nfljersey.us.com/ as http://76ers.nba-jersey.com/ an umbrella in http://packers.nfljersey.us.com/ a http://www.cheap-nike-shoes.net/ timely http://www.oakley-sunglasses.mex.com/ manner, http://www.nfljersey.us.com/ always at http://www.fendi-outlet.in.net/ the http://bulls.nba-jersey.com/ right http://www.prada-outlet.com.co/ time http://www.tommy-hilfigers.de/ to http://www.celine-bags.com/ play http://www.ralphlaurenonlineshop.de/ quietly http://www.ralphlauren-au.com/ in http://www.michael-kors.net.co/ the http://www.new-balanceshoes.es/ head. Never http://www.ralphs-laurenpolos.net/ a http://www.burberry-outlet.in.net/ trace http://www.air-maxschoenen.nl/ of http://www.toryburchsale.com.co/ complaining, the http://coach-outlet.tumblr.com/ slightest http://www.ralph-laurenpolosoutlet.com/ hesitation.Breaking the

http://www.juicycouture.com.co/