Reference Guides
Reference Guides
Breadcrumbs

Use of Generative AI

Intended audience: administrators security data governance

AO Platform: 5.0

Overview

This topic describes how the AO Platform supports the use of Generative AI technologies either as an optional or required integration for certain functionality to work. The AO Platform is designed with open frameworks in mind, allowing different types of Generative AI technologies to be integrated, providing the greatest flexibility and value for our customers. That said, the AO Platform does provide a default integration that will allow our customers to immediately get started using Generative AI in different parts of the AO Platform and solutions simply by enabling the functionality.


What is Generative AI?

Generative AI is a type of artificial intelligence technology that enables users to generate new content based on a variety of inputs. The generated content can come in various types, including text, imagery, audio, and synthetic data. The AO Platform focuses on the generation of “text” for its Generative AI integration - see Where is Generative AI Used section below. This involves using Large Language Models (LLMs) from various vendors and their services that are pre-trained on a vast amount of data.


Which Generative AI Technologies and Platforms are Supported

The AO Platform integrates the following Generative AI Technologies. Other vendors and technologies will be supported in future releases.

Certified for Production Use

Not Yet Certified for Production Use


Large Language Models Available in the AO Platform Master Data Configuration

red = retired, amber = deprecated, white = current

OpenAI

Anthropic Claude

Google Gemini

ChatGPT 4.0

  • 4.0 Omni for Vision

  • 4.0 Omni-2024-08-06

  • 4.0 Turbo 1106

ChatGPT 5

  • 5

  • 5 Mini

  • 5 Nano

ChatGPT 5.1

  • 5.1 Medium Reasoning

  • 5.1 Low Reasoning

  • 5.1 High Reasoning

  • 5.1 Extra High Reasoning

  • 5.1 No Reasoning

ChatGPT 5.2

  • 5.2 Medium Reasoning

  • 5.2 Low Reasoning

  • 5.2 High Reasoning

  • 5.2 Extra High Reasoning

  • 5.2 No Reasoning

  • 5.2 Pro

ChatGPT 5.4

  • 5.4 Medium Reasoning

  • 5.4 Low Reasoning

  • 5.4 High Reasoning

  • 5.4 Extra High Reasoning

  • 5.4 No Reasoning

  • 5.4 Mini Medium Reasoning

  • 5.4 Mini Low Reasoning

  • 5.4 Mini High Reasoning

  • 5.4 Mini Extra High Reasoning

  • 5.4 Mini No Reasoning

  • 5.4 Nano Medium Reasoning

  • 5.4 Nano Low Reasoning

  • 5.4 Nano High Reasoning

  • 5.4 Nano Extra High Reasoning

  • 5.4 Nano No Reasoning

  • 5.4 Pro

ChatGPT 5.5

  • 5.5 Medium Reasoning

  • 5.5 Low Reasoning

  • 5.5 High Reasoning

  • 5.5 Extra High Reasoning

  • 5.5 No Reasoning

  • 5.5 Pro

ChatGPT 5.6

  • 5.6 Luna Medium Reasoning

  • 5.6 Luna Low Reasoning

  • 5.6 Luna High Reasoning

  • 5.6 Luna Extra High Reasoning

  • 5.6 Luna Max Reasoning

  • 5.6 Luna No Reasoning

  • 5.6 Luna for Vision

  • 5.6 Luna - Azure

  • 5.6 Sol Medium Reasoning

  • 5.6 Sol Low Reasoning

  • 5.6 Sol High Reasoning

  • 5.6 Sol Extra High Reasoning

  • 5.6 Sol Max Reasoning

  • 5.6 Sol No Reasoning

  • 5.6 Terra Medium Reasoning

  • 5.6 Terra Low Reasoning

  • 5.6 Terra High Reasoning

  • 5.6 Terra Extra High Reasoning

  • 5.6 Terra Max Reasoning

  • 5.6 Terra No Reasoning

ChatGPT 6

  • 6 Astra Low High Reasoning

  • 6 Astra Medium High Reasoning

  • 6 Astra High Reasoning

  • 6 Astra Extra High Reasoning

  • 6 Astra Max Reasoning

  • 6 Luna Low High Reasoning

  • 6 Luna Medium High Reasoning

  • 6 Luna High Reasoning

  • 6 Luna Extra High Reasoning

  • 6 Luna Max Reasoning

  • 6 Luna No Reasoning

  • 6 Luna for Vision

  • 6 Sol Low High Reasoning

  • 6 Sol Medium High Reasoning

  • 6 Sol High Reasoning

  • 6 Sol Extra High Reasoning

  • 6 Sol Max Reasoning

  • 6 Luna No Reasoning

Claude 4

  • 4 Sonnet - Amazon Bedrock

Claude 4.5

  • 4.5 Sonnet

  • 4.5 Haiku

  • 4.5 Opus

  • 4.5 Sonnet - Amazon Bedrock

Claude 4.6

  • 4.6 Sonnet

  • 4.6 Opus

Claude 4.7

  • 4.7 Opus

Claude 4.8

  • 4.8 Opus

Claude 5

  • 5 Sonnet

  • 5 Opus

Claude 5.1

  • 5.1 Fable

Gemini 2.5

  • 2.5 Flash

  • 2.5 Flash Fast

  • 2.5 Flash Lite

  • 2.5 Flash Lite Fast

  • 2.5 Pro

Gemini 3.5

  • 3.5 Flash

  • 3.5 Flash Lite

Gemini 3.6

  • 3.6 Flash

Gemini 3.7

  • 3.7 Flash

Gemini 3.8

  • 3.8 Flash

Meta Llama

Mistral

DeepSeek

Amazon Bedrock

  • Meta Llama 13B

  • Meta Llama 3 70B Instruct

  • Meta Llama 3 70B Instruct Run Pod Version

  • Meta Llama 3 8B Instruct

  • Meta Llama 70B

  • Mistral 7B Instruct v0.2

  • Mistral 8x7B Instruct v0.1

  • Mistral 8x7B v0.1

  • DeepSeek Chat

  • DeepSeek R1 14B

  • DeepSeek R1 7B

  • DeepSeek R1 8B

  • Amazon Bedrock Nova Lite

  • Amazon Bedrock Nova Pro


Embedding Models Available in the AO Platform

LLM Embedding Models

  • All Minilm L6 V2

  • All Mpnet Base V2

  • BGE Large English

  • bge-m3

  • clip-vit-large-patch14-336

  • stella_en_1.5B_v5

  • Text Embedding 3 Large (1014)

  • Text Embedding 3 Large (256)

  • Text Embedding 3 Large (3072)

  • Text Embedding 3 Small (1536)

  • Text Embedding 3 Small (512)

  • Text Embedding ADA 2

  • Universal Sentence Encoder 4


Where is Generative AI Used?

Component

Functionality Description

Optional or Mandatory

Availability

Text2SQL in Easy Answers

When enabled, a Natural Language Question (NLQ) asked in Easy Answers will be converted to the database language, SQL, as used internally by the AO Platform to request the data to respond to the question.

  • NLQ : show all bronze meter issues by Neptune

    image-20231214-124805.png

  • Text2SQL from GenAI : select distinct t0.* from MeterIssues t0 inner join Meter t1 on t0.meter.id = t1.id where (t1.material = 'Bronze' and t1.manufacturer = 'Neptune')

Optional

From the 3.5 release

GenAI Insights in Easy Answers

This area allows a user to retrieve an articulated response from the Generative AI in response to an App on the Easy Answers Results page. The AO Platform will provide the data in an anonymized/encrypted format to the Generative AI platform, and a response will be shown as GenAI Insights, where key data points, trends, and indicators are typically extracted from the data in the visualization and expressed as bulleted statements to help the user better understand. See https://docs-easyanswers.apporchid.com/easy-answers-data-summaries-page/?contextKey=adding-data-summaries&version=latest.

image-20231214-125135.png

Optional

From the 3.5 release

Configuration of Content Repositories for Unstructured Data Documents, including PDFs, Word, and PowerPoint Files.

The Easy Answers ChatBot can respond to questions from one or more Content Repositories. Each Content Repository is associated with a Large Language Model (LLM) and its associated Embedding Model. The choice of LLM and Embedding Model depends on the customer’s choice of the LLMs integrated with the AO Platform, and which Embedding Model can yield the best output for the type of documents stored in the Content Repository.

Configuration of Content Repositories

image-20240109-195112.png

Mandatory

From the 4.0 release

Text2SQL in ChatBot Conversations

When asking questions in the Easy Answers ChatBot relative to Content Repositories of unstructured documents, the results are provided as GenerativeAI responses.

image-20240116-144015.png

Mandatory

From the 4.0 release

…





How to Integrate with Generative AI Platforms

There are multiple places where Generative AI functionality will require configuration to be enabled/used:

Admin > Configurations > Configuration Properties

The below configuration entries are available supporting the default configuration for the Generative AI technology/platform required.

For OpenAI, an Access Token is required for the OpenAI API. Each request to the OpenAI API has a transaction cost. See the OpenAI API Pricing model.

image-20231214-131942.png
image-20231214-131703.png





Contact App Orchid | Disclaimer