Ontology - LLM Questions

Intended audience: ANALYSTS DEVELOPERS ADMINISTRATORS

AO Platform: 4.3

Overview

The LLM Questions page in the Ontology Composer allows questions to be pre-generated by an LLM for use in Easy Answers. This is a way for the solution developer to bootstrap an Easy Answers solution with questions for different personas, thereby featuring an Easy Answers solution with ready-to-go questions for new users to use and learn from.

Generated LLM Questions

• Start by going to the Ontology Composer > LLM Questions page. The initial page will have no questions generated, but likely some Categories configured.

• Once questions have been generated and added to the page, the user will be able to test each question to ensure that they can be interpreted by Easy Answers and successfully generate Results. Generated and successfully tested questions will immediately become available in the Easy Answers solutions that make use of this Ontology.

Properties

User Actions

• In Header

  • Search - search field - enter a search term to find matching questions.

  • Generate Categories - button - click the Generate Categories button, takes input from the Ontology to auto-generate ontology-specific Categories, then shows them in a Generated Categories dialog. See the Generate Categories section below.

  • Generate LLM Questions - button - click the Generate LLM Questions button to open a dialog allowing users to configure several options as context for the questions to be generated. See the Generate LLM Questions section below.

  • Filters - select a subset of imported questions by selecting values from the dropdown in the following filters.

    • Main MSO - dropdown - select from Main MSOs available in the imported questions.

    • User - dropdown - select from Users who have imported questions.

    • Persona - dropdown - select from Personas selected for imported questions.

    • Status - dropdown - select from the Status for imported questions (Not Tested, Executed OK, Test Failed).

    • Category - dropdown - select from available Categories from imported questions.

• Per Question Entry

  • Test - button - click the Test button to validate the question. The Status will indicate the result of the testing. Only questions with the Executed OK status will be available to use in Easy Answers.

  • Delete - icon - deletes a question in case it’s not required, or does not test successfully.

• In the Categories panel

  • + (Add) - icon - click to open the right side of the screen with a few configuration properties to enter the Name and a short Description of the new Category. This is the manual option for creating Categories.

Generate Categories

• Clicking the Generate Categories button will take input from the Ontology to auto-generate ontology-specific Categories, then show them in a Generated Categories dialog.

• Once generated, select any suitable Categories from the list and click the Import button. If all Categories are OK, click the Import All button. These imported Categories will be added to the Categories list on the main LLM Questions page.

Properties

User Actions

• Select a Category - checkbox - enable the checkbox for any categories that are deemed relevant for import into the Categories list on the main LLM-generated Questions page.

• Cancel - button - click to Cancel, thereby rejecting the categories generated.

• Import - button - click to Import the selected categories, which will then be imported into the Categories list on the main LLM-generated Questions page.

• Import All - button - click to Import All the categories in the dialog, whether selected or not.

Generate LLM Questions

• Clicking the Generate LLM Questions button will open a dialog allowing users to configure a number of options as context for the questions to be generated.

Properties

Labels	UI Widget	Default	Description
Main MSO	Search Field		Select the Main MSO for which the questions will be generated. All direct MSOs will also be available as part of the prompt instructions.
MSO Properties	Dropdown Repeater		Select one or more specific MSO Properties from the Main MSO to guide the question generation. If no MSO Properties are selected, all MSO Properties from the Main MSO will be included.
Other MSOs	Search Field Repeater		Select any other non-direct MSOs to be included in the prompt instructions.
Include Properties by LLM Priority	Dropdown	Default	The priority of properties to be sent to LLM for Question Generation. Default means that Properties with Priority “None” or “Never” will not be included. Other options include: Low, Medium, and High. This property is disabled if MSO Properties are configured above.
Prompt Instruction	Multi-Line Text Field w/Search		Provide additional detailed domain instructions for the LLM question generation.
Persona	Dropdown		Select the Persona for which the questions will be generated.
Categories	Tags		Select one or more Categories, or add new Categories, for which Questions will be generated.
Number of Questions to Generate	Number Field	10	Enter a value for the number of questions to be generated. The maximum questions to be generated in one process is 25.

User Actions

• Cancel - button - click to Cancel, thereby rejecting the question generation process.

• Generate Questions - button - click to start the question generation process. Once generated, a dialog will open with the generated questions.

Generated LLM Questions and Import

• The questions generated from the Generate LLM Questions process will be shown in a dialog, allowing the user to do a quick sanity check and select any or all questions to be imported into the main LLM-generated Questions page.

Properties

User Actions

• Select a Question - checkbox - enable the checkbox for any questions that are deemed relevant for import into the main LLM-generated Questions page.

• Cancel - button - click to Cancel, thereby rejecting the questions generated.

• Import - button - click to Import the selected questions, which will then be imported into the main LLM-generated Questions page.

• Import All - button - click to Import All the questions in the dialog, whether selected or not.

Contact App Orchid | Disclaimer