- Print
- PDF
Version 2.0.0
3 January, 2025
VA
Enhancements
GenQ&A Semantic Caching:
The Gen Q&A node now supports Semantic Caching, allowing previously generated responses to be reused for similar or identical queries (questions coming from customers), significantly reducing LLM costs and response times. This feature includes:- A toggle for Semantic Caching in advanced settings, enabled by default for new projects.
- Customizable Similarity Threshold (default: 0.97), adjustable between 0.90 and 1, to fine-tune matching sensitivity.
Streaming Mode for Generative Coding Assistant:
The Generative Coding Assistant now offers real-time streaming responses, providing faster feedback and improving the efficiency of the design process. By enabling streaming mode through the stream=True parameter, users can receive responses in a seamless, server-sent events format. This enhancement allows designers to monitor the code generation process in real-time and make adjustments on the go.New Context Type for Binary Data:
The new "Binary" context type enables storing user-provided attachments in Base64 format for seamless use in successor processes such as HTTP requests. Easily create and manage "Binary" contexts, now displayed prominently as "Binary Base64" in variable lists in red color. The Ask Attachment Node has been updated with an output field titled "Received File," allowing efficient conversion of the data. Binary contexts are compatible with various nodes, except the Code node, and are fully supported in import/export operations.
Improvements
Custom Error Handling for HTTP Node
A new "Custom Error Handling" section has been added to the advanced settings of the HTTP Node. This feature allows users to specify HTTP status codes, such as 404 Not Found or 403 Forbidden, to be treated as successful outcomes. This eliminates the need for additional status checks and reduces node proliferation by enabling streamlined flows even when certain client-side errors occur.Minor UI Improvements:
Several minor improvements have been made to the user interface to enhance user experience and usability.Minor Bug Fixes:
Various minor bugs have been addressed to improve overall system stability and performance.