For whatever reason, there's an 0x1000 error when gdb frontend computes addresses from debug info in PE files -it gets it right for ELFs.
Adding 0x1000 to BaseOfImage for PE files in packet_query_libraries_cb makes it correct and you get complete backtraces and accurate breakpoints... Now, I just need to figure out why.