Disentangling star formation and merger growth in the evolution of luminous red galaxies