kserve (Infrastructure)

[Infrastructure] kserve/kserve — 5.2k⭐

KServe is a standardized distributed generative and predictive AI inference platform for scalable, multi-framework deployment on Kubernetes. Language: Go | Stars: 5.2k | Category: Infrastructure Repository: https://github.com/kserve/kserve