Skip to content

Class: AiEval

An AI Evaluation, e.g. a metric, benchmark, unitxt card evaluation, a question or a combination of such entities.

URI: [dqv:Metric](https://www.w3.org/TR/vocab-dqv/Metric) 
 classDiagram
    class AiEval
    click AiEval href "../AiEval/"
      Entity <|-- AiEval
        click Entity href "../Entity/"


      AiEval <|-- Question
        click Question href "../Question/"
      AiEval <|-- Questionnaire
        click Questionnaire href "../Questionnaire/"


      AiEval : bestValue

      AiEval : broad_mappings





        AiEval --> "*" Any : broad_mappings
        click Any href "../Any/"



      AiEval : close_mappings





        AiEval --> "*" Any : close_mappings
        click Any href "../Any/"



      AiEval : dateCreated

      AiEval : dateModified

      AiEval : description

      AiEval : exact_mappings





        AiEval --> "*" Any : exact_mappings
        click Any href "../Any/"



      AiEval : hasBenchmarkMetadata





        AiEval --> "*" BenchmarkMetadataCard : hasBenchmarkMetadata
        click BenchmarkMetadataCard href "../BenchmarkMetadataCard/"



      AiEval : hasDataset





        AiEval --> "*" Dataset : hasDataset
        click Dataset href "../Dataset/"



      AiEval : hasDocumentation





        AiEval --> "*" Documentation : hasDocumentation
        click Documentation href "../Documentation/"



      AiEval : hasImplementation

      AiEval : hasLicense





        AiEval --> "0..1" License : hasLicense
        click License href "../License/"



      AiEval : hasRelatedRisk





        AiEval --> "*" Risk : hasRelatedRisk
        click Risk href "../Risk/"



      AiEval : hasTasks

      AiEval : hasUnitxtCard

      AiEval : id

      AiEval : isCategorizedAs





        AiEval --> "*" Any : isCategorizedAs
        click Any href "../Any/"



      AiEval : isComposedOf





        AiEval --> "*" AiEval : isComposedOf
        click AiEval href "../AiEval/"



      AiEval : name

      AiEval : narrow_mappings





        AiEval --> "*" Any : narrow_mappings
        click Any href "../Any/"



      AiEval : related_mappings





        AiEval --> "*" Any : related_mappings
        click Any href "../Any/"



      AiEval : url
## Inheritance - [Entity](Entity.md) - **AiEval** - [Question](Question.md) - [Questionnaire](Questionnaire.md) ## Class Properties | Property | Value | | --------- | ---------------------------------------------------- | | Class URI | [dqv:Metric](https://www.w3.org/TR/vocab-dqv/Metric) | ## Slots | Name | Cardinality and Range | Description | Inheritance | | ----------------------------------------------- | ---------------------------------------------------------- | -------------------------------------------------------------------------------- | ------------------- | | [hasDocumentation](hasDocumentation.md) | \*
[Documentation](Documentation.md) | Indicates documentation associated with an entity | direct | | [hasDataset](hasDataset.md) | \*
[Dataset](Dataset.md) | A relationship to datasets that are used | direct | | [hasTasks](hasTasks.md) | \*
[String](String.md) | The tasks or evaluations the benchmark is intended to assess | direct | | [hasImplementation](hasImplementation.md) | \*
[Uri](Uri.md) | A relationship to a implementation defining the risk evaluation | direct | | [hasUnitxtCard](hasUnitxtCard.md) | \*
[Uri](Uri.md) | A relationship to a Unitxt card defining the risk evaluation | direct | | [hasLicense](hasLicense.md) | 0..1
[License](License.md) | Indicates licenses associated with a resource | direct | | [hasRelatedRisk](hasRelatedRisk.md) | \*
[Risk](Risk.md) | A relationship where an entity relates to a risk | direct | | [bestValue](bestValue.md) | 0..1
[String](String.md) | Annotation of the best possible result of the evaluation | direct | | [hasBenchmarkMetadata](hasBenchmarkMetadata.md) | \*
[BenchmarkMetadataCard](BenchmarkMetadataCard.md) | A relationship to a Benchmark Metadata Card which contains metadata about the... | direct | | [isComposedOf](isComposedOf.md) | \*
[AiEval](AiEval.md) | A relationship indicating that an AI evaluation maybe composed of other AI ev... | direct | | [id](id.md) | 1
[String](String.md) | A unique identifier to this instance of the model element | [Entity](Entity.md) | | [name](name.md) | 0..1
[String](String.md) | A text name of this instance | [Entity](Entity.md) | | [description](description.md) | 0..1
[String](String.md) | The description of an entity | [Entity](Entity.md) | | [url](url.md) | 0..1
[Uri](Uri.md) | An optional URL associated with this instance | [Entity](Entity.md) | | [dateCreated](dateCreated.md) | 0..1
[Date](Date.md) | The date on which the entity was created | [Entity](Entity.md) | | [dateModified](dateModified.md) | 0..1
[Date](Date.md) | The date on which the entity was most recently modified | [Entity](Entity.md) | | [exact_mappings](exact_mappings.md) | \*
[Any](Any.md) | The property is used to link two concepts, indicating a high degree of confid... | [Entity](Entity.md) | | [close_mappings](close_mappings.md) | \*
[Any](Any.md) | The property is used to link two concepts that are sufficiently similar that ... | [Entity](Entity.md) | | [related_mappings](related_mappings.md) | \*
[Any](Any.md) | The property skos:relatedMatch is used to state an associative mapping link b... | [Entity](Entity.md) | | [narrow_mappings](narrow_mappings.md) | \*
[Any](Any.md) | The property is used to state a hierarchical mapping link between two concept... | [Entity](Entity.md) | | [broad_mappings](broad_mappings.md) | \*
[Any](Any.md) | The property is used to state a hierarchical mapping link between two concept... | [Entity](Entity.md) | | [isCategorizedAs](isCategorizedAs.md) | \*
[Any](Any.md) | A relationship where an entity has been deemed to be categorized | [Entity](Entity.md) | ## Usages | used by | used in | type | used | | ------------------------------------------------- | ----------------------------------------------- | ------ | ------------------- | | [Container](Container.md) | [evaluations](evaluations.md) | range | [AiEval](AiEval.md) | | [AiEval](AiEval.md) | [hasRelatedRisk](hasRelatedRisk.md) | domain | [AiEval](AiEval.md) | | [AiEval](AiEval.md) | [hasBenchmarkMetadata](hasBenchmarkMetadata.md) | domain | [AiEval](AiEval.md) | | [AiEval](AiEval.md) | [isComposedOf](isComposedOf.md) | range | [AiEval](AiEval.md) | | [AiEvalResult](AiEvalResult.md) | [isResultOf](isResultOf.md) | range | [AiEval](AiEval.md) | | [EveryEvalAIResult](EveryEvalAIResult.md) | [isResultOf](isResultOf.md) | range | [AiEval](AiEval.md) | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | [describesAiEval](describesAiEval.md) | range | [AiEval](AiEval.md) | | [Question](Question.md) | [hasRelatedRisk](hasRelatedRisk.md) | domain | [AiEval](AiEval.md) | | [Question](Question.md) | [hasBenchmarkMetadata](hasBenchmarkMetadata.md) | domain | [AiEval](AiEval.md) | | [Question](Question.md) | [isComposedOf](isComposedOf.md) | range | [AiEval](AiEval.md) | | [Questionnaire](Questionnaire.md) | [hasRelatedRisk](hasRelatedRisk.md) | domain | [AiEval](AiEval.md) | | [Questionnaire](Questionnaire.md) | [hasBenchmarkMetadata](hasBenchmarkMetadata.md) | domain | [AiEval](AiEval.md) | ## Identifier and Mapping Information ### Schema Source - from schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology ## Mappings | Mapping Type | Mapped Value | | ------------ | ------------ | | self | dqv:Metric | | native | nexus:AiEval | ## LinkML Source ### Direct
```yaml name: AiEval description: An AI Evaluation, e.g. a metric, benchmark, unitxt card evaluation, a question or a combination of such entities. from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology is_a: Entity slots: - hasDocumentation - hasDataset - hasTasks - hasImplementation - hasUnitxtCard - hasLicense - hasRelatedRisk - bestValue - hasBenchmarkMetadata - isComposedOf slot_usage: isComposedOf: name: isComposedOf description: A relationship indicating that an AI evaluation maybe composed of other AI evaluations (e.g. it's an overall average of other scores). range: AiEval hasRelatedRisk: name: hasRelatedRisk domain: AiEval range: Risk class_uri: dqv:Metric ````
### Induced
```yaml name: AiEval description: An AI Evaluation, e.g. a metric, benchmark, unitxt card evaluation, a question or a combination of such entities. from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology is_a: Entity slot_usage: isComposedOf: name: isComposedOf description: A relationship indicating that an AI evaluation maybe composed of other AI evaluations (e.g. it's an overall average of other scores). range: AiEval hasRelatedRisk: name: hasRelatedRisk domain: AiEval range: Risk attributes: hasDocumentation: name: hasDocumentation description: Indicates documentation associated with an entity. from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: airo:hasDocumentation alias: hasDocumentation owner: AiEval domain_of: - Dataset - Vocabulary - Taxonomy - Concept - Group - Entry - Term - Principle - RiskTaxonomy - RiskControlGroupTaxonomy - Action - BaseAi - LargeLanguageModelFamily - AiTaskTaxonomy - AiEval - EveryEvalAIResult - BenchmarkMetadataCard - Adapter - LLMIntrinsic range: Documentation multivalued: true inlined: false hasDataset: name: hasDataset description: A relationship to datasets that are used. from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 alias: hasDataset owner: AiEval domain_of: - AiEval range: Dataset multivalued: true inlined: false hasTasks: name: hasTasks description: The tasks or evaluations the benchmark is intended to assess. from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 alias: hasTasks owner: AiEval domain_of: - AiEval - EveryEvalAIResult - BenchmarkMetadataCard range: string multivalued: true inlined: false hasImplementation: name: hasImplementation description: A relationship to a implementation defining the risk evaluation from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: schema:url alias: hasImplementation owner: AiEval domain_of: - AiEval range: uri multivalued: true inlined: false hasUnitxtCard: name: hasUnitxtCard description: A relationship to a Unitxt card defining the risk evaluation from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: schema:url alias: hasUnitxtCard owner: AiEval domain_of: - AiEval range: uri multivalued: true inlined: false hasLicense: name: hasLicense description: Indicates licenses associated with a resource from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: airo:hasLicense alias: hasLicense owner: AiEval domain_of: - Dataset - Documentation - Vocabulary - Taxonomy - RiskTaxonomy - RiskControlGroupTaxonomy - BaseAi - AiTaskTaxonomy - AiEval - BenchmarkMetadataCard - Adapter range: License hasRelatedRisk: name: hasRelatedRisk description: A relationship where an entity relates to a risk from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 domain: AiEval alias: hasRelatedRisk owner: AiEval domain_of: - Term - LLMQuestionPolicy - Action - AiSystem - AiEval - EveryEvalAIResult - BenchmarkMetadataCard - Adapter - LLMIntrinsic range: Risk multivalued: true inlined: false bestValue: name: bestValue description: Annotation of the best possible result of the evaluation from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 alias: bestValue owner: AiEval domain_of: - AiEval range: string hasBenchmarkMetadata: name: hasBenchmarkMetadata description: A relationship to a Benchmark Metadata Card which contains metadata about the benchmark. from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 domain: AiEval alias: hasBenchmarkMetadata owner: AiEval domain_of: - AiEval inverse: describesAiEval range: BenchmarkMetadataCard multivalued: true inlined: false isComposedOf: name: isComposedOf description: A relationship indicating that an AI evaluation maybe composed of other AI evaluations (e.g. it's an overall average of other scores). from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 alias: isComposedOf owner: AiEval domain_of: - AiSystem - AiEval range: AiEval multivalued: true inlined: false id: name: id description: A unique identifier to this instance of the model element. Example identifiers include UUID, URI, URN, etc. from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: schema:identifier identifier: true alias: id owner: AiEval domain_of: - Entity range: string required: true name: name: name description: A text name of this instance. from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: schema:name alias: name owner: AiEval domain_of: - Entity - BenchmarkMetadataCard range: string description: name: description description: The description of an entity from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: schema:description alias: description owner: AiEval domain_of: - Entity range: string url: name: url description: An optional URL associated with this instance. from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: schema:url alias: url owner: AiEval domain_of: - Entity range: uri dateCreated: name: dateCreated description: The date on which the entity was created. from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: schema:dateCreated alias: dateCreated owner: AiEval domain_of: - Entity range: date required: false dateModified: name: dateModified description: The date on which the entity was most recently modified. from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: schema:dateModified alias: dateModified owner: AiEval domain_of: - Entity range: date required: false exact_mappings: name: exact_mappings description: The property is used to link two concepts, indicating a high degree of confidence that the concepts can be used interchangeably across a wide range of information retrieval applications from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: skos:exactMatch alias: exact_mappings owner: AiEval domain_of: - Entity range: Any multivalued: true inlined: false close_mappings: name: close_mappings description: The property is used to link two concepts that are sufficiently similar that they can be used interchangeably in some information retrieval applications. from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: skos:closeMatch alias: close_mappings owner: AiEval domain_of: - Entity range: Any multivalued: true inlined: false related_mappings: name: related_mappings description: The property skos:relatedMatch is used to state an associative mapping link between two concepts. from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: skos:relatedMatch alias: related_mappings owner: AiEval domain_of: - Entity range: Any multivalued: true inlined: false narrow_mappings: name: narrow_mappings description: The property is used to state a hierarchical mapping link between two concepts, indicating that the concept linked to, is a narrower concept than the originating concept. from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: skos:narrowMatch alias: narrow_mappings owner: AiEval domain_of: - Entity range: Any multivalued: true inlined: false broad_mappings: name: broad_mappings description: The property is used to state a hierarchical mapping link between two concepts, indicating that the concept linked to, is a broader concept than the originating concept. from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: skos:broadMatch alias: broad_mappings owner: AiEval domain_of: - Entity range: Any multivalued: true inlined: false isCategorizedAs: name: isCategorizedAs description: A relationship where an entity has been deemed to be categorized from_schema: https://w3id.org/ai-atlas-nexus/ai-risk-ontology rank: 1000 slot_uri: nexus:isCategorizedAs alias: isCategorizedAs owner: AiEval domain_of: - Entity range: Any multivalued: true inlined: false class_uri: dqv:Metric ````