- Print
- PDF
Version 1.95
14 October, 2024
Please use the following stable AI modules for the v1.95 update!
- sentence-embedding (v14)
- text-normalization (v22)
- text-classification-mlp (v19)
- question-answering (v8)
- text-sentiment (v10)
- text-clustering (v22)
- text-language (v9)
- text-summarization (v5) -- Requires Vllm for operation, cannot function independently.
Enhancements
- AI Module Timeout and Pod Management
We have implemented a pod management system to reduce unnecessary resource consumption for AI modules. Pods associated with AI modules that receive no requests for a specified period are now automatically terminated via a timeout mechanism (excluding text-clustering module). This applies to both published AI modules via external APIs and those added via the interface.
For terminated AI modules, pods will be automatically restarted when requests are made to specific services, such as generative-question-answering, text-sentiment, or text-language. For modules added via the interface, restarting must be initiated through the UI.
For on-prem installations where timeouts are not required, a PodTimeoutEnabled
flag, defaulted to True, has been added under the Serving configuration to allow customization by DevOps.
- Tenant Creation API
The Tenant Management API has been developed to automate tenant creation processes. Using these methods, other services with related permissions can now create and edit tenants in Knovvu ML. This development has ensured standardization across all Knovvu products by enabling the tenant management process to be run from a single source.
Improvements
ABP Framework Migration to 8.2.3
We have successfully migrated the platform to ABP Framework version 8.2.3. This update includes enhanced stability, improved performance, and bug fixes.Testing Text Summarization Module v5
Text Summarization Module v5 has been successfully tested. Currently, this module exclusively supports integration with the private LLM and cannot function independently.Minor UI Improvements:
Several minor improvements have been made to the user interface to enhance user experience and usability.Minor Bug Fixes:
Various minor bugs have been addressed to improve overall system stability and performance.