Class: AiEval
An AI Evaluation, e.g. a metric, benchmark, unitxt card evaluation, a question or a combination of such entities.
URI: dqv:Metric
classDiagram
class AiEval
click AiEval href "../AiEval/"
Entity <|-- AiEval
click Entity href "../Entity/"
AiEval <|-- Question
click Question href "../Question/"
AiEval <|-- Questionnaire
click Questionnaire href "../Questionnaire/"
AiEval : bestValue
AiEval : broad_mappings
AiEval --> "*" Any : broad_mappings
click Any href "../Any/"
AiEval : close_mappings
AiEval --> "*" Any : close_mappings
click Any href "../Any/"
AiEval : dateCreated
AiEval : dateModified
AiEval : description
AiEval : exact_mappings
AiEval --> "*" Any : exact_mappings
click Any href "../Any/"
AiEval : hasBenchmarkMetadata
AiEval --> "*" BenchmarkMetadataCard : hasBenchmarkMetadata
click BenchmarkMetadataCard href "../BenchmarkMetadataCard/"
AiEval : hasDataset
AiEval --> "*" Dataset : hasDataset
click Dataset href "../Dataset/"
AiEval : hasDocumentation
AiEval --> "*" Documentation : hasDocumentation
click Documentation href "../Documentation/"
AiEval : hasImplementation
AiEval : hasLicense
AiEval --> "0..1" License : hasLicense
click License href "../License/"
AiEval : hasRelatedRisk
AiEval --> "*" Risk : hasRelatedRisk
click Risk href "../Risk/"
AiEval : hasTasks
AiEval : hasUnitxtCard
AiEval : id
AiEval : isCategorizedAs
AiEval --> "*" Any : isCategorizedAs
click Any href "../Any/"
AiEval : name
AiEval : narrow_mappings
AiEval --> "*" Any : narrow_mappings
click Any href "../Any/"
AiEval : related_mappings
AiEval --> "*" Any : related_mappings
click Any href "../Any/"
AiEval : url
Inheritance
- Entity
- AiEval
Slots
| Name | Cardinality and Range | Description | Inheritance |
|---|---|---|---|
| hasDocumentation | * Documentation |
Indicates documentation associated with an entity | direct |
| hasDataset | * Dataset |
A relationship to datasets that are used | direct |
| hasTasks | * String |
The tasks or evaluations the benchmark is intended to assess | direct |
| hasImplementation | * Uri |
A relationship to a implementation defining the risk evaluation | direct |
| hasUnitxtCard | * Uri |
A relationship to a Unitxt card defining the risk evaluation | direct |
| hasLicense | 0..1 License |
Indicates licenses associated with a resource | direct |
| hasRelatedRisk | * Risk or RiskConcept or Term |
A relationship where an entity relates to a risk | direct |
| bestValue | 0..1 String |
Annotation of the best possible result of the evaluation | direct |
| hasBenchmarkMetadata | * BenchmarkMetadataCard |
A relationship to a Benchmark Metadata Card which contains metadata about the... | direct |
| id | 1 String |
A unique identifier to this instance of the model element | Entity |
| name | 0..1 String |
A text name of this instance | Entity |
| description | 0..1 String |
The description of an entity | Entity |
| url | 0..1 Uri |
An optional URL associated with this instance | Entity |
| dateCreated | 0..1 Date |
The date on which the entity was created | Entity |
| dateModified | 0..1 Date |
The date on which the entity was most recently modified | Entity |
| exact_mappings | * Any |
The property is used to link two concepts, indicating a high degree of confid... | Entity |
| close_mappings | * Any |
The property is used to link two concepts that are sufficiently similar that ... | Entity |
| related_mappings | * Any |
The property skos:relatedMatch is used to state an associative mapping link b... | Entity |
| narrow_mappings | * Any |
The property is used to state a hierarchical mapping link between two concept... | Entity |
| broad_mappings | * Any |
The property is used to state a hierarchical mapping link between two concept... | Entity |
| isCategorizedAs | * Any |
A relationship where an entity has been deemed to be categorized | Entity |
Usages
| used by | used in | type | used |
|---|---|---|---|
| Container | evaluations | range | AiEval |
| AiEval | hasBenchmarkMetadata | domain | AiEval |
| AiEvalResult | isResultOf | range | AiEval |
| BenchmarkMetadataCard | describesAiEval | range | AiEval |
| Question | hasBenchmarkMetadata | domain | AiEval |
| Questionnaire | hasBenchmarkMetadata | domain | AiEval |
Identifier and Mapping Information
Schema Source
- from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
Mappings
| Mapping Type | Mapped Value |
|---|---|
| self | dqv:Metric |
| native | nexus:AiEval |
LinkML Source
Direct
```yaml
name: AiEval
description: An AI Evaluation, e.g. a metric, benchmark, unitxt card evaluation, a
question or a combination of such entities.
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
is_a: Entity
slots:
- hasDocumentation
- hasDataset
- hasTasks
- hasImplementation
- hasUnitxtCard
- hasLicense
- hasRelatedRisk
- bestValue
- hasBenchmarkMetadata
slot_usage:
isComposedOf:
name: isComposedOf
description: A relationship indicating that an AI evaluation maybe composed of
other AI evaluations (e.g. it's an overall average of other scores).
range: AiEval
class_uri: dqv:Metric
````
Induced
```yaml
name: AiEval
description: An AI Evaluation, e.g. a metric, benchmark, unitxt card evaluation, a
question or a combination of such entities.
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
is_a: Entity
slot_usage:
isComposedOf:
name: isComposedOf
description: A relationship indicating that an AI evaluation maybe composed of
other AI evaluations (e.g. it's an overall average of other scores).
range: AiEval
attributes:
hasDocumentation:
name: hasDocumentation
description: Indicates documentation associated with an entity.
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: airo:hasDocumentation
alias: hasDocumentation
owner: AiEval
domain_of:
- Dataset
- Vocabulary
- Taxonomy
- Concept
- Group
- Entry
- Term
- Principle
- RiskTaxonomy
- RiskControlGroupTaxonomy
- Action
- BaseAi
- LargeLanguageModelFamily
- AiEval
- BenchmarkMetadataCard
- Adapter
- LLMIntrinsic
range: Documentation
multivalued: true
inlined: false
hasDataset:
name: hasDataset
description: A relationship to datasets that are used.
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
alias: hasDataset
owner: AiEval
domain_of:
- AiEval
range: Dataset
multivalued: true
inlined: false
hasTasks:
name: hasTasks
description: The tasks or evaluations the benchmark is intended to assess.
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
alias: hasTasks
owner: AiEval
domain_of:
- AiEval
- BenchmarkMetadataCard
range: string
multivalued: true
inlined: false
hasImplementation:
name: hasImplementation
description: A relationship to a implementation defining the risk evaluation
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: schema:url
alias: hasImplementation
owner: AiEval
domain_of:
- AiEval
range: uri
multivalued: true
inlined: false
hasUnitxtCard:
name: hasUnitxtCard
description: A relationship to a Unitxt card defining the risk evaluation
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: schema:url
alias: hasUnitxtCard
owner: AiEval
domain_of:
- AiEval
range: uri
multivalued: true
inlined: false
hasLicense:
name: hasLicense
description: Indicates licenses associated with a resource
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: airo:hasLicense
alias: hasLicense
owner: AiEval
domain_of:
- Dataset
- Documentation
- Vocabulary
- Taxonomy
- RiskTaxonomy
- RiskControlGroupTaxonomy
- BaseAi
- AiEval
- BenchmarkMetadataCard
- Adapter
range: License
hasRelatedRisk:
name: hasRelatedRisk
description: A relationship where an entity relates to a risk
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
domain: Any
alias: hasRelatedRisk
owner: AiEval
domain_of:
- Term
- LLMQuestionPolicy
- Action
- AiSystem
- AiEval
- BenchmarkMetadataCard
- Adapter
- LLMIntrinsic
range: Risk
multivalued: true
inlined: false
any_of:
- range: RiskConcept
- range: Term
bestValue:
name: bestValue
description: Annotation of the best possible result of the evaluation
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
alias: bestValue
owner: AiEval
domain_of:
- AiEval
range: string
hasBenchmarkMetadata:
name: hasBenchmarkMetadata
description: A relationship to a Benchmark Metadata Card which contains metadata
about the benchmark.
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
domain: AiEval
alias: hasBenchmarkMetadata
owner: AiEval
domain_of:
- AiEval
inverse: describesAiEval
range: BenchmarkMetadataCard
multivalued: true
inlined: false
id:
name: id
description: A unique identifier to this instance of the model element. Example
identifiers include UUID, URI, URN, etc.
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: schema:identifier
identifier: true
alias: id
owner: AiEval
domain_of:
- Entity
range: string
required: true
name:
name: name
description: A text name of this instance.
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: schema:name
alias: name
owner: AiEval
domain_of:
- Entity
- BenchmarkMetadataCard
range: string
description:
name: description
description: The description of an entity
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: schema:description
alias: description
owner: AiEval
domain_of:
- Entity
range: string
url:
name: url
description: An optional URL associated with this instance.
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: schema:url
alias: url
owner: AiEval
domain_of:
- Entity
range: uri
dateCreated:
name: dateCreated
description: The date on which the entity was created.
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: schema:dateCreated
alias: dateCreated
owner: AiEval
domain_of:
- Entity
range: date
required: false
dateModified:
name: dateModified
description: The date on which the entity was most recently modified.
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: schema:dateModified
alias: dateModified
owner: AiEval
domain_of:
- Entity
range: date
required: false
exact_mappings:
name: exact_mappings
description: The property is used to link two concepts, indicating a high degree
of confidence that the concepts can be used interchangeably across a wide range
of information retrieval applications
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: skos:exactMatch
alias: exact_mappings
owner: AiEval
domain_of:
- Entity
range: Any
multivalued: true
inlined: false
close_mappings:
name: close_mappings
description: The property is used to link two concepts that are sufficiently similar
that they can be used interchangeably in some information retrieval applications.
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: skos:closeMatch
alias: close_mappings
owner: AiEval
domain_of:
- Entity
range: Any
multivalued: true
inlined: false
related_mappings:
name: related_mappings
description: The property skos:relatedMatch is used to state an associative mapping
link between two concepts.
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: skos:relatedMatch
alias: related_mappings
owner: AiEval
domain_of:
- Entity
range: Any
multivalued: true
inlined: false
narrow_mappings:
name: narrow_mappings
description: The property is used to state a hierarchical mapping link between
two concepts, indicating that the concept linked to, is a narrower concept than
the originating concept.
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: skos:narrowMatch
alias: narrow_mappings
owner: AiEval
domain_of:
- Entity
range: Any
multivalued: true
inlined: false
broad_mappings:
name: broad_mappings
description: The property is used to state a hierarchical mapping link between
two concepts, indicating that the concept linked to, is a broader concept than
the originating concept.
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: skos:broadMatch
alias: broad_mappings
owner: AiEval
domain_of:
- Entity
range: Any
multivalued: true
inlined: false
isCategorizedAs:
name: isCategorizedAs
description: A relationship where an entity has been deemed to be categorized
from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology
rank: 1000
slot_uri: nexus:isCategorizedAs
alias: isCategorizedAs
owner: AiEval
domain_of:
- Entity
range: Any
multivalued: true
inlined: false
class_uri: dqv:Metric
````