Use MSYS with mingw and the Mingw-DTK package. It will give you bison and yacc.
Actually mingw does not have mktemp and the reason it was finding mktemp is that the cygwin directory was in my path. Removing the cygwin path fixes this problem, but then I don't have access to bison and yacc, so configure fails