Contact Center AI Solution with GPT

This solution demonstrates the application of Microsoft AI and GPT to help solve challenges common to contact center scenarios

Author: Jixin Jia (Gin)
Created: 2023/03/01
Version: 2.0

---

Key Features

1. Transcribe conversations in real-time
2. Simultaneously translate into multiple languages
3. Identify speaker by diarizing the conversation
4. Analyze speech sentiment in real-time
5. Summarizeconversation and get a list of key topics discussed using Azure OpenAI

About

• This WSGI demo app runs on single instance of Gunicorn for production workload. It is recommended to build it on a docker orchestration service if you target a more scalable workload.

• All transaction runs within browser (client end). There are no data transmitted to or stored at the backend server in this demo.

• To run the demo following Azure services must be provisioned and provided at run time:

Azure resource	Purpose	Required information
Azure AI Service	For performing live speech-to-text, speaker diarization, translation and sentiment analysis	Azure AI key, Azure AI endpoint, Azure AI region, Speech language, Translate langage
Azure OpenAI Service	For generating a conversation summary, identify key entities mentioned and categorize conversation into a main topic	Azure OpenAI key, Azure OpenAI endpoint, Deployed chatgpt model name

See it in action

Setup Guide

0. Install

Install dependencies. This solution has been tested on Python 3.7~3.10

pip install -r requirements.txt

1. Run the app

For Unix:

./run.sh

For Windows:

waitress-serve --listen=0.0.0.0:80 wsgi:app

2. Open your favorite browser

Type following in address bar:
localhost:80

3. Add keys into Setup page

4. Press mic button and start talking to it

Enjoy the demo !

Credit

Special thanks to Nobu Tanahashi for his ingenious Conversation Transcription source code and idea used in this demo.