[PATCH v10 2/6] server: Move object grab/release out of (add|remove)_queue.