[PATCH v4 1/5] server: Move object grab/release out of (add|remove)_queue.