Using this thread for some general notes on the subject as XFormers is critical for SD in production:
Have to use the binary provided by the library which was just added.
As the developer notes:
"conda install xformers -c xformers/label/dev “, but they are only available for Python 3.9 or 3.10, CUDA 11.3 or 11.6, and PyTorch 1.12.1”