Intended audience: analysts developers administrators
AO Platform: 4.5
LLM Modes
This section includes the configuration settings for the LLM Modes, which determine how an Easy Answers Question will be interpreted and validated to form responses. There are three LLM Modes, including:
-
Controlled - enforces strict validation against the enterprise semantic layer, ensuring responses align precisely with defined data structures. Unknown or ambiguous words or phrases are shown to the user. Questions will fail if they cannot be validated, and the user will have to rephrase the question.
-
Balanced - provides guided flexibility, prompting clarification when needed while maintaining alignment to enterprise definitions. Users will be asked to clarify unknown or ambiguous words before a response can be generated.
-
Freeform - allows more exploratory reasoning, enabling the LLM to interpret the user questions with a greater degree of freedom. The LLM interpretation of questions will make assumptions where necessary to auto-resolve unknown or ambiguous words to produce a response; However, the user will also be able to provide additional clarifications where needed, which will further refine the results already provided.
The ability to view and select the LLM Modes at runtime in Easy Answers will be determined by Role Permissions. Without adequate permissions, the Default LLM Mode configured in the Ontology Composer > Settings > LLM Mode will be applied to the user’s questions.
Ambiguity Settings
Properties
|
Label |
UI Widget |
Defaults for Controlled Mode |
Defaults for Balanced Mode |
Defaults for Freeform Mode |
Description |
|---|---|---|---|---|---|
|
ON/OFF Toggle |
ON |
ON |
ON |
If enabled, ambiguity detection will take place during question interpretation using the current ontology schema.
|
|
Dropdown |
Error |
Clarify |
Continue |
When ambiguity detection is enabled, select the desired action from the dropdown. Dropdown includes: Error, Clarify, Continue.
|
Token Identification Settings
Properties
|
Label |
UI Widget |
Defaults for Controlled Mode |
Defaults for Balanced Mode |
Defaults for Freeform Mode |
Description |
|---|---|---|---|---|---|
|
Dropdown |
|
|
|
Select one or more Named Entities from the dropdown. These entities will be used to match question tokens to mitigate unknown tokens when interpreting questions. Here’s a list of some/all Named Entities available in the dropdown with their tooltips:
|
|
ON/OFF Toggle |
ON |
ON |
ON |
If enabled, the LLM will be using the LLM Descriptions of the MSOs and Properties to identify the tokens in addition to the identified Named Entities. |
|
Number Field |
Very Strong |
Strong |
Moderate |
If the Use LLM to Identify Tokens property is enabled, a Confidence Level will be used to accept tokens. Dropdown includes: Very Strong, Strong, Moderate, and None.
|
|
Dropdown |
Error |
Clarify |
Continue |
Select the desired action from the dropdown when neither the Named Entities nor the LLM tokens have been recognized. Dropdown includes: Error, Clarify, and Continue.
|
LLM Settings
Properties
|
Label |
UI Widget |
Defaults for Controlled Mode |
Defaults for Balanced Mode |
Defaults for Freeform Mode |
Description |
|---|---|---|---|---|---|
|
ON/OFF Toggle |
OFF |
OFF |
OFF |
If enabled, a separate call to the LLM is made to request an assessment of the generated semantic SQL against the original user's intent. |
Contact App Orchid | Disclaimer