Analyzes conversation speech. This node detects:
- The level of tension between the parties involved
- Interruptions in each other's speech
- Speaking rates (number of words per second)
- Periods of silence when both parties remain quiet
- Hesitations
- Sentiment of the speech text
- Speech overlaps
Inputs
Events
| name | description |
|---|---|
| SR Milestone | Most of the fields examined by the Conversation Analyzer are provided by this event. Features such as silence durations, speech rates, interrupts, and other characteristics are obtained by compiling channel-based events from the sr-milestone |
| Emotion | The information from the emotion service is compiled to be displayed in the output based on segment and channel. For example, it can be provided that the agent channel exhibits "angry" sentiment between 4-8 seconds. |
| Sentiment | The results from the sentiment service are analyzed on an agent-customer basis, and the sentiment information of each segment is reflected in the outcome. |
Audio
none
Outputs
Event
| name | description |
|---|---|
| Conversation Analyzer Result | A complete acoustic and text based analysis of the conversation. |
Audio
none
Remarks
To obtain data from the Conversation Analyzer, it is necessary to configure it along with the events listed in the "Input" field.
Project Structure
Conversation Analyzer is one of the most complex nodes that requires the output from several nodes working together. The project structure can be seen in the default project ca-offline. The node requires the agent and customer to be separated into two channels. If a mono audio input is given, Speaker Diarizer Nodeis utilized to do the separation. Then, the appropriate audio segments are filtered and used for Gender, Emotion, Sentiment analysis.
Audio Segment Picker and Flush Barrier are utilized, so that the most appropriate segment (5000-10000 milliseconds) is picked for Language Identification before the transcripts are generated in the SR Http node.
Supported flow types
Batch