aws-neuron/torch-neuronx-model-support
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Hugging Face launches a Trainium model compatibility lookup
Hugging Face introduced the torch-neuronx model support Space to check whether popular models on the Hub run unmodified on AWS Trainium. It provides compatibility results, tested Neuron and Transformers versions, execution scripts, and the public aws-neuron/torch-neuronx-model-support dataset. Current tests cover text-generation and image-text-to-text Transformers models that fit on four Trainium2 devices, while a PASS does not establish throughput or longer-generation behavior.
Hugging Face · 🔥 0
Experience and discussion from the community
Share my aws-neuron/torch-neuronx-model-support experienceAsk about aws-neuron/torch-neuronx-model-support
Nobody has shared their experience with aws-neuron/torch-neuronx-model-support yet.