Non-local energy transfers in rotating turbulence at intermediate Rossby number