I had this happen for me on all versions of the bluesky tutorial docker image that I tested. The fix was to create a new docker file that correctly updated jupyter lab.
`
FROM nsls2/tutorials:latest
RUN pip install -U "jupyter-server<2.0.0"
`
Then build the image and run it.
docker build -f bluesky.dockerfile -t fixed-bluesky .
docker run -p 8888:8888 fixed-bluesky:latest