Intended audience: analysts developers administrators
AO Platform: 4.3
Generative AI Configurations
These configuration settings determine the default selection of which Large Language Model (LLM) and Embedding Model will be used if enabled for different sub-systems in the AO Platform as well as which Vector Store has been integrated as the default.
If a commercial LLM is enabled (compared to an Open Source LLM), then each transaction (API request) will incur a transaction fee.
Properties
|
Label |
Defaults |
Description |
|---|---|---|
|
Default LLM Model |
Open AI Chat GPT 4.0 Turbo 1106 |
Use the dropdown to select from available Large Language Model (LLM) configurations. This selection will become the default for any LLM-enabled functionality, including Text2SQL transformations, and Quick Insights Summarizations.
|
|
Default Embedding Model |
Text Embedding ADA 2 |
An LLM Embedding Model transforms words into numerical vectors, capturing the semantic meaning and relationships, enabling LLMs to understand and process information more effectively. Use the dropdown to select an Embedding Model from the available configurations. This selection will be used as the default for interpreting questions in Easy Answers and Chatbot if LLM is enabled on the Text2SQL page.
|
|
Default Repository Embedding Model |
BGE Large English |
An LLM Embedding Model transforms words and sentences into numerical vectors, capturing the semantic meaning and relationships, enabling LLMs to understand and process information more effectively. Use the dropdown to select an Embedding Model from the available configurations. This selection will be used as the default for interpreting questions in Easy Answers against a Content Repository.
|
|
Default Vector Store |
Weaviate DB |
Select a Vector Store to use. This selection will be considered the default Vector Store used to provide alternative question suggestions in Easy Answers if the question the user is asking isn’t fully understood. The use of a Vector Store will need to be enabled on the Text2SQL page in the Vector Store Settings section. Options include:
|
|
Default Data Summarization Model |
Open AI Chat GPT 4.1 |
Use the dropdown to select from available Large Language Model (LLM) configurations. This selection will become the default for any LLM-enabled functionality, including Text2SQL transformations, and Quick Insights Summarizations.
|
Contact App Orchid | Disclaimer