If you think about it in a fractal way, then the environment is merely another character attacking you, so the toughness applies to the attack, as long as the catch isn't met.
A toughness power means you are generally tougher, the armor and additional stress is the mechanical representation, just as the environmental attack is the mechanical representation of the danger of the environment, it doesn't (usually) have a mind of its own to actually be an attack.