Bento ML

BentoML is a flexible, high-performance framework for serving, managing, and deploying machine learning models.

  • Supports Multiple ML frameworks, including Tensorflow, PyTorch, Keras, XGBoost and more

  • Cloud native deployment with Docker, Kubernetes, AWS, Azure and many more

  • High-Performance online API serving and offline batch serving

  • Web dashboards and APIs for model registry and deployment management

Link