[PATCH v2 4/5] server: Track unbound input signaled state based on its original console.