Testing classical and quantum theory with single photons