2x Speed Up: Lower VRam usage via XFormers

Just landed in DIffusers: