The Growth Rate of Cosmic Structure from Peculiar Velocities at Low and High Redshifts