Sagemaker inference on a single A100

[pietrobolcato]

Hey there! I am handling some big models like Stable Diffusion, and I would like to perform inference on them using a single A100 as it's much faster than using a V100. The problem is, I can only find the ml.p4d.24xlarge instance, which has 8x A100.

Is there a way to use a single A100 instead of 8?

Thank you so much in advance! Really appreciate your help!