The importance of the cosmic web and halo substructure for power spectra