How

How does this work?
ThereĀ areĀ fourĀ components to this.Ā They each communicate slightly differently.Ā Ā
- ServiceNow Instance
- Sends REST Request via ecc_queue
- Midserver
- Executes REST call to the AI InĀ A Box Server
- AI In A Box Server
- Handles RESTĀ by hitting OpenAI Compliant API endpoint
- Handles Streaming Response from OpenAI Compliant API, and passes them along to ServiceNowĀ
- Large Language Model ServerĀ
- Handles REST calls from AI In A Box Server
