[PATCH v3 2/9] server: Move object grab/release out of (add|remove)_queue.