I would highly recommend reading through the Neuron Wiki at https://awsdocs-neuron.readthedocs-hosted.com/en/latest/index.html
One experiment that's pending on my plate is to use Amazon Q Developer to migrate code from using CUDA to Neuron. If you've done it, I'd love to hear about it.
Select an Amazon EC2 Trn2 instance, which is powered by AWS Trainium chips. These instances are purpose-built for high-performance deep learning training of generative AI models.