"Downsizing" from the fossil record: Ages and metallicities of red galaxies and their dependence on mass and on environment