Azure Open Enterprise End-End Chat Reference
Reference Architecture:Enterprise chat applications can empower employees through conversational interaction. This is especially true due to the continuous advancement of large language models such as OpenAI’s GPT models and Meta’s LLaMA models. These chat applications consist of a user interface for chatting, data repositories containing domain-specific information pertinent to the user’s queries, large language models (LLMs) that reason over the domain-specific data to produce a relevant response, and an orchestrator that oversees the interaction between these components.
Solution Components:Azure Machine Learning, Managed online endpoints, Azure Storage, Azure Container Registry, Azure OpenAI, Azure AI Search and LLM Models.