Polynomial bounds on geometric Ramsey numbers of ladder graphs