AWS Forward Deployed Engineering
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Deepgram ports Nova-3 speech model to AWS Trainium2, reports 11–70% more audio per dollar
Deepgram worked with AWS's Forward Deployed Engineering team to port its Nova-3 speech-to-text model from standard PyTorch code to AWS Trainium2, tuning it for offline batch workloads such as contact-center analytics and medical transcription. The final setup runs eight model replicas on a single Amazon EC2 trn2.3xlarge instance, using TorchNeuron, prebuilt NKILib kernels, hand-written NKI kernels and a Rust data-parallel runtime. According to the AWS blog, that configuration processed 11–70 percent more audio per dollar than the compute options Deepgram had been running on those offline throughput-oriented workloads, measured with instance pricing at evaluation time; no independent verification is cited.
AWS Machine Learning Blog · 🔥 8
Experience and discussion from the community
Share my AWS Forward Deployed Engineering experienceAsk about AWS Forward Deployed Engineering
Nobody has shared their experience with AWS Forward Deployed Engineering yet.