WSO2 API managers manage AI APIs

WSO2 has upgraded WSO2 API Manager and WSO2 API Platform for Kubernetes (APK), equipping these open-source API management platforms with capabilities for managing generative AI and large language model (LLM) APIs. The updates also expand support for Kubernetes-native API management and enhance security and access controls.

The enhancements were announced on November 5. Added to both products was an Egress API Management capability, enabling AI APIs to benefit from life cycle API management and governance with support for service providers including OpenAI, Mistral AI, and Microsoft Azure OpenAI. Egress API Management offers an enhanced egress (outbound) gateway experience for managing and routing API requests specifically for AI services, including enforcement of policies, to ensure secure and efficient access to AI models, WSO2 said.

WSO2 said it was also extending support for growth of microservices and APIs running on Kubernetes with three product developments:

Enhancements for WSO2 API Microgateway, a cloud-native, developer-centric decentralized gateway for microservices. The newest version has been updated to align with the latest WSO2 API Manager release for enhanced scalability while maintaining governance, security, and reliability, WSO2 said.

gRPC API support for WSO2 API Platform for Kubernetes Gateway, providing capabilities for developers and engineers building microservices architectures with gRPC. By aligning with the Kubernetes Gateway API specification, the support improves integration with Kubernetes environments and offers greater control over gRPC services, WSO2 said.

New traffic filters for HTTP routes, available with the newest WSO2 WSO2 API Platform for Kubernetes Gateway release. These offer flexibility in routing and transforming HTTP traffic.

WSO2 added that the newest WSO2 API Platform for Kubernetes release now includes support for subscription rate limit policies, already available in WSO2 API Manager. API providers can define and enforce usage quotas for API consumers.

WSO2 also said the unified control plane in WSO2 API Manager introduces an ability to search for APIs using content from API definition files such as Swagger, GraphQL, and WSDL, directly from the Developer Portal and Publisher Portal, to improve API discovery and usability. WSO2 API Manager also adds personal access token support, enabling secure, time-limited authentication access to WSO2 API Manager system APIs without exposing a user name and password.

WSO2 API Manager 4.4, WSO2 API Platform for Kubernetes 1.2, and WSO2 API Microgateway 3.2 are generally available now as open source products.