[PATCH v9 2/6] server: Move object grab/release out of (add|remove)_queue.