TorchServe
ml-serving server
PyTorch model serving framework developed by AWS and Meta
Pros and Cons
Ventajas
- + Native for PyTorch
- + Easy to use
- + RESTful and gRPC API
- + Model management included
Desventajas
- - PyTorch only
- - Less optimized than Triton
Casos de Uso
- PyTorch model serving
- Inference APIs
- Production deployment