Use of Generative AI
Intended audience: ADMINISTRATORS SECURITY DATA GOVERNANCE
AO Platform: 4.3
Overview
This topic describes how the AO Platform supports the use of Generative AI technologies either as optional or required integration for certain functionality to work. The AO Platform is designed with open frameworks in mind, allowing different types of Generative AI technologies to be integrated, providing the greatest flexibility and value for our customers. That said, the AO Platform does provide a default integration that will allow our customers to immediately get started using Generative AI in different parts of the AO Platform and solutions simply by enabling the functionality.
What is Generative AI?
Generative AI is a type of artificial intelligence technology that enables users to generate new content based on a variety of inputs. The generated content can come in various types, including text, imagery, audio, and synthetic data. The AO Platform focuses on the generation of “text” for its Generative AI integration - see Where is Generative AI Used section below. This involves using Large Language Models (LLMs) from various vendors and their services that are pre-trained on a vast amount of data.
Which Generative AI Technologies and Platforms are Supported
The AO Platform integrates the following Generative AI Technologies as of August 2025. Other vendors and technologies will be supported in future releases.
Certified for Production Use
Not Yet Certified for Production Use
Where is Generative AI Used?
Component | Functionality Description | Optional or Mandatory | Availability |
|---|---|---|---|
Text2SQL in Easy Answers | When enabled, a Natural Language Question (NLQ) asked in Easy Answers will be converted to the database language, SQL, as used internally by the AO Platform to request the data to respond to the question.
| Optional | From 3.5 release |
GenAI Insights in Easy Answers | This area allows a user to retrieve an articulated response from the Generative AI in response to an App on the Easy Answers Results page. The AO Platform will provide the data in an anonymized/encrypted format to the Generative AI platform, and a response will be shown as GenAI Insights, where key data points, trends, and indicators are typically extracted from the data in the visualization and expressed as bulleted statements to help the user better understand. See Adding Data Summaries.  | Optional | From 3.5 release |
Configuration of Content Repositories for Unstructured Data Documents, including PDFs, Word and PowerPoint Files. | The Easy Answers ChatBot can provide responses to questions from one or more Content Repositories. Each Content Repository is associated with a Large Language Model (LLM) and its associated Embedding Model. The choice of LLM and Embedding Model depends on the customer’s choice of the LLMs integrated with the AO Platform, and which Embedding Model can yield the best output for the type of documents stored in the Content Repository. Configuration of Content Repositories  | Mandatory | From 4.0 release |
Text2SQL in ChatBot Conversations | When asking questions in the Easy Answers ChatBot relative to Content Repositories of unstructured documents, the results are provided as GenerativeAI responses.  | Mandatory | From 4.0 release |
… |
How to Integrate with Generative AI Platforms
There are multiple places where Generative AI functionality will require configuration to be enabled/used:
in Admin solution > Configurations > Configuration Properties - see section below.
in Ontology Composer > Settings. See Ontology - Settings
in Ontology Composer > Content Repositories. See Ontology - Content Repositories.
Admin > Configurations > Configuration Properties
The below configuration entries are available supporting the default configuration for the Generative AI technology/platform required.
For OpenAI, an Access Token is required for the OpenAI API. Each request to the OpenAI API has a transaction cost. See the OpenAI API Pricing model.
