MSO - Linguistics
Intended audience: ANALYSTS DEVELOPERS ADMINISTRATORS
AO Platform: 4.3
Overview
This section contains the configuration of words (terms) that are being used by the Natural Language Processing (NLP) component in the AO Platform. Users can provide unique terminology to use in addition to the database properties. The linguistic properties are also used by other sub-systems in the AO Platform, such as when configuring Strategies in the Entity Extraction section.
User Actions
Add New (+) - adds a new property that Words or Value Based Synonyms can be associated with.
Delete - deletes individual or all properties from the existing Linguistics.
The following configurations are possible
For MSOs
Words, Word Provider and/or Rules for each respective Word bucket – see Words sections below.
Rule-Based Synonyms - see Rule Based Synonyms section below.
Words and Rule Words statistics indicate how many Words and Rule Words have been added - including an Alert icon if too many added.
For individual MSO Field Properties
Words, Word Provider and/or Rules for each Word bucket – see Words sections below.
Value-Based Synonyms – see Value Based Synonyms section below.
Words and Value Words statistics indicate how many Words and Value Words have been added - including an Alert icon if too many added.
For Curations
Words, Word Provider and/or Rules for each respective Word bucket – see Words sections below. This is used to either include (Bag of Words) or exclude (Negative Bag of Words) a Curation on the Easy Answers Results page.
For Traits
Words, Word Provider and/or Rules for each respective Word bucket – see Words sections below. This is used to either include (using Bag of Words) or exclude (using Negative Bag of Words) a Trait-based visualization on the Easy Answers Results page.
Word buckets
Label | Description |
|---|---|
Stop Words | The Stop Words are used in NLP to eliminate commonly used words eg. “a”, “the”, “is”, “are” etc. |
Bag Of Words | The Bag Of Words is a representation used in NLP and information retrieval of text that describes the occurrence of words within a database records. |
Negative BoW | The Negative Bag of Words are used … |
Prompt BoW | The Prompt Bag of Words are used … |
Search Synonyms | The Search Synonyms are used … |
Words
Label | Description |
|---|---|
Word | The Word is used in Bag of Words. |
Abbreviation | Add an Abbreviation if required/available for Word. |
Plural | Add the Plural form of the Word being configured. |
Plural Abbreviation | Add an Plural Abbreviation for the Word if required/available. |
Ontology | Select the Ontology that all additional Words shall be associated with. |
Weight | Add a Weight for this Word in case multiple Words are added relating to the MSO selected. This can set priority of which Words are assessed with higher importance over others. |
Synonyms | Add Synonyms for Word from a Thesaurus dictionary (if available). This provides an easy lookup of additional words that could be added as Synonyms for the Word being configured. |
Word Provider
Label | Description |
|---|---|
Word Provider | The Word Provider is used to get a group of Bag of Words. |
Rules
Label | Description |
|---|---|
Name | Add a Name the display name of the Rule. |
Description | Add a Description field as a brief description of the Rules. |
Rules | Add a Word Rule for the Word being configured. A Word Rule makes use of the Using Query Builder to allow user to establish one or more criteria being considered when the Word is used. |
Words | The Words are used in Bag of Word. |
Value-Based Synonyms
The Value-Based Synonyms tab allows users to add individual Synonyms, or import values from the data source property as Synonyms (Sourcing of the MSO is required). The latter will quickly enable the “dictionary” used by Easy Answers and allow a better understanding of user questions. Additional Synonyms can be added for each entry found in the data source as well as Word Rules that are more complex configurations based on criteria.
Example: A property "Premise Type", which has values, "Residential", "Commercial", "Industrial" in the data source, can be configured with the following synonyms:
Residential: "Home” and “House”.
Commercial:“ Store” and “Office”.
Industrial: “Factory".
Once Value Based Synonyms have been added, the user can search for specific Synonyms or filter the list of Synonyms based on the following options:
Show All - view all Value-Based Synonyms created manually or imported from values in the Data Source (default).
Show only entries with Synonyms - view entries with additional Synonyms added.
Show only entries with Word Rules - view entries with additional Word Rule(s) added.
Label | Description |
|---|---|
Import values | Import values from MSO’s data source as Value-Based Synonyms. This option only works if Sourcing has been configured for MSO. |
Import values by Criteria | Opens the Query Builder to allow users to create criteria for the import of the Value-Based Synonyms. |
+ | Opens a dialog allowing users to add a number of new Words relating to the Value for the MSO Property selected. |
For each Word added… | |
Word | Shows the Word added in the previous dialog. |
Abbreviation | Add an Abbreviation if required/available for Word. |
Plural | Add the Plural form of the Word being configured. |
Plural Abbreviation | Add a Plural Abbreviation for the Word if required/available. |
Alternate Values | Add one or more Alternate Values/Words, eg. if the Word USA is added as a Value-Based Synonym, then Alternate Words could be entered as US, United States, United States of America, and America. |
Ontology | Select the Ontology that all additional Words shall be associated with. |
Weight | Add a Weight for this Word in case multiple Words are added relating to the MSO Property Value selected. This can set the priority of which Words are assessed with higher importance over others. |
Word Rule | Add a Word Rule for the Word being configured. A Word Rule makes use of the Using Query Builder to allow the user to establish one or more criteria being considered when the Word is used, eg. if a Word “alloy” is configured relating to the “Material” MSO Property, the criteria could be configured as Material = Cobber and Material = Brass, ie only those Meters which Material equals Cobber or Brass will be shown if the user asked the question: “Show all alloy meters”. |
Synonyms | Add Synonyms for Word from a Thesaurus dictionary (if available). This provides an easy lookup of additional words that could be added as Synonyms for the Word being configured. |
Rule-Based Synonyms
The Rule-Based Synonyms tab allows users to add individual Synonyms that require one or more criteria to be defined (Rules).
Example: A property called "Age" which has number values in the data source, Rule-Based Synonyms can be configured using criteria, such as:
“Infant”: Age < 2
“Toddler”: Age >= 2 and Age < 6
“Minor Child”: Age > 6 and Age < 13
“Teenager”: Age >= 13 and Age < 18", - and so on. Instead of specifying the Age the user can use the Synonyms in their Easy Answers questions.
Once Rule Based Synonyms have been added, the user can search for specific Synonyms or filter the list of Synonyms based on the following options:
Show All - view all Rule-Based Synonyms (default).
Show only entries with Synonyms - view entries with additional Synonyms added.
Show only entries with Word Rules - view entries with additional Word Rule(s) added.
Label | Description |
|---|---|
+ | Opens a dialog allowing the user to add a number of new Words relating to the MSO selected. |
For each Word added… | |
Word | Shows the Word added in the previous dialog. |
Abbreviation | Add an Abbreviation if required/available for Word. |
Plural | Add the Plural form of the Word being configured. |
Plural Abbreviation | Add a Plural Abbreviation for the Word if required/available. |
Ontology | Select the Ontology that all additional Words shall be associated with. |
Weight | Add a Weight for this Word in case multiple Words are added relating to the MSO selected. This can set the priority of which Words are assessed with higher importance over others. |
Word Rule | Add a Word Rule for the Word being configured. A Word Rule makes use of the Using Query Builder to allow users to establish one or more criteria being considered when the Word is used, eg. if a Word “risky” is configured relating to the “meter” MSO, the criteria could be configured to relate to a specific “Manufacturer” and “Material”, ie only those Meters from a specific Manufacturer and made of a specific Material will be shown if user asked the question: “Show all risky meters”. |
Synonyms | Add Synonyms for Word from a Thesaurus dictionary (if available). This provides an easy lookup of additional words that could be added as Synonyms for the Word being configured. |