[PATCH 4/5] server: Track unbound input signaled state based on its original console.