User Tools

Site Tools


en:forward_sel

This is an old revision of the document!


Section: Ordination analysis

Variable selection (constrained ordination)

Theory R functions Examples Exercise

Variable selection is a procedure for selecting a subset of explanatory variables from the set of all variables available for constrained ordination (RDA, CCA, db-RDA). The goal is to reduce the number of explanatory variables entering the analysis while keeping the variation explained by them to the maximum. Variable selection is suitable mostly in case of observational studies, where many (often highly intercorrelated) environmental variables are recorded, to reduce their number (and to simplify the story); it is usually not useful for experimental studies with the balanced design of treatment application.

The standard method is forward selection, which is adding explanatory variables one by one; backward selection, in contrary, starts from the full model (with all variables) and deletes variables which the least decreases the total explained variation. Combination of both approaches is stepwise (forward-backward) selection, in which in every step the analysis checks whether some of the already included variables cannot be removed to improve the model.

The simplified sequence of steps in the case of forward selection is the following:

  1. first, test the significance of the global test with all explanatory variables included; if it is significant, you may proceed to forward selection, while if it is not, it is better not to (remember that even with randomly generated explanatory variables you have rather good chance to select some of them as significant during forward selection).
  2. use each variable one by one as explanatory in constrained ordination, and record the explained variation (this variation represents a simple (or marginal) effect of each variable);
  3. sort variables according to variation explained by them with the highest values at the top;
  4. check whether the variation explained by the best variable is significant using Monte Carlo permutation test - if yes, include it to the model, if not, stop the selection;
  5. use each of remaining explanatory variables and check how much variation they (each separately) explain if put as explanatory (with the already selected variable acting as covariable);
  6. sort again the variables according to the decreasing variation explained by them (now this variation represents the partial effect of this variable) and choose the one explaining the most; test whether the variation is significant, and if yes, select it into the model; if not, stop the selection;
  7. continue by step 5 until the variation explained by the best variable is not significant.

The significance of the variables is one of the possible stopping rules (once the best variable is not significant, the selection is stopped). Alternative stopping rule is reaching the adjusted R2 of the global model (Blanchet et al. 2008): first, calculate adjusted variation explained by all explanatory variables (global model); if during the forward selection the adjusted variation explained by selected variables reaches the R2adj of the global model (with some given precision threshold), the selection will be stopped (available in function ordiR2step in library (vegan) and forward.sel in library (adespatial)).

en/forward_sel.1554431338.txt.gz · Last modified: 2019/04/05 10:28 by David Zelený