Geometrical Frustration and Static Correlations in a Simple Glass Former