Transcript Export experiments in WebODE I W D

Interoperability
Working Days
October 10th-11th, 2005
Export experiments in WebODE
Raúl García-Castro
<[email protected]>
October 10th, 2005
Export experiments in WebODE. October 10th 2005
1
© Raúl García-Castro
Index
•
•
•
•
WebODE at a glance
Execution of the benchmark suite
Comments on how WebODE exports
Comments on the experimentation
Export experiments in WebODE. October 10th 2005
2
© Raúl García-Castro
WebODE
• Java based Ontological Engineering Workbench
that gives support to Methontology.
• Provides a very expressive knowledge model.
• Covers and gives support to most of the activities
involved in the ontology development process with
different types of ontology-related services.
• Developed by the Ontology Engineering Group at
UPM.
http://delicias.dia.fi.upm.es/webode
Export experiments in WebODE. October 10th 2005
3
© Raúl García-Castro
WebODE Architecture
Ontology Editor
ODEMapster
ODEDesigner
ODEMerge
ODELinger
OntoTagger
OKBC
Prolog
XML
FLogic
XCARIN
UML
Java
OWL
Jess
OIL
XCARIN
XML
Other
languages
RDF(S)
Ontology languages
DAML+OIL
Ontology languages
DAML+OIL
Export services
UML
Other
languages
Inference
engine
WebPicker
Import services
RDF(S)
OWL
ODEval
ODE Evolution Manager
ODE Ontology Management API
Cache
Consistency
Axiom
Application Server
Export experiments in WebODE. October 10th 2005
4
DB Server
© Raúl García-Castro
WebODE Knowledge Model
• Concepts
– Class attributes
– Instance attributes
• Groups of concepts
• Relations
– Taxonomical
• Between concepts (subclass-of, not-subclass-of)
• Between concepts and groups (disjoint-subclass-partition, exhaustive-subclass-partition)
– Mereological (transitive-part-of, intransitive-part-of)
– Ad-hoc
• Properties of relations
– Built-in properties (reflexive, irreflexive, symmetric, asymmetric, antisymmetric, transitive)
– Ad-hoc properties
• Imported terms
• Constants
• Synonyms
• Abbreviations
• Formulae (axioms, rules, procedures)
• References
• Instance sets
• Instances (of concepts or of relations)
Export experiments in WebODE. October 10th 2005
5
© Raúl García-Castro
Index
•
•
•
•
WebODE at a glance
Execution of the benchmark suite
Comments on how WebODE exports
Comments on the experimentation
Export experiments in WebODE. October 10th 2005
6
© Raúl García-Castro
Execution of the benchmark suite
The version of WebODE used was: WebODE 2.0 Build 101.
No modifications were needed in the tool for performing the experimentation.
We decided to automate the execution of the benchmark suite and
developed a Java program for running every benchmark in the benchmark
suite in order to:
• Diminish the experimentation effort, as the benchmark suite
had to be run several times to check improvements after
modifications.
• Facilitate the use of the benchmark suite to all the WebODE
developers.
Export experiments in WebODE. October 10th 2005
7
© Raúl García-Castro
Process followed in the experimentation
•
•
•
To define the expected RDF(S) ontologies that should be obtained when
exporting the WebODE ontologies. The expected ontologies were defined in the
RDF/XML syntax of RDF(S).
To run the Java program. It performs the following actions for each benchmark:
– To insert into WebODE the ontology defined in the benchmark using
WebODE's ontology management API methods.
– To export the WebODE ontology to RDF(S).
To compare the exported RDF(S) ontologies with the expected RDF(S)
ontologies. This comparison was performed manually.
Export experiments in WebODE. October 10th 2005
8
© Raúl García-Castro
Experimentation results
Id
Description
Knowledge Added
Knowledge Lost
Result
Class benchmarks
E01
One class
-
-
OK
E02
Several classes
-
-
OK
Metaclass benchmarks
E03
One class instance of another class that is instance of
a third one
-
-
-
E04
One class instance of several classes
-
-
-
E05
Several classes instance of the same class
-
-
-
E06
One class instance of another class and viceversa
-
-
-
E07
One class that is instance of itself
-
-
-
Subclass benchmarks
E08
One class subclass of another class that is subclass of
a third one
-
-
OK
E09
One class subclass of several classes
-
-
OK
E10
Several classes subclass of the same class
-
-
OK
E11
One class subclass of another class and viceversa
-
-
-
E12
One class that is subclass of itself
-
-
-
Export experiments in WebODE. October 10th 2005
9
© Raúl García-Castro
Experimentation results 2
Id
Description
Added
Lost
Class and object property benchmarks
E13
One class that has an object property with another
-
-
-
E14
One class that has the same object property with several classes
-
-
-
E15
Several classes that have the same object property with the same class
-
-
-
E16
One class that has an object property with itself
-
-
-
Class and datatype property benchmarks
E17
One class that has a datatype property with a literal
-
-
-
E18
One class that has the same datatype property with several literals
-
-
-
Datatype property benchmarks
E19
One datatype property
-
-
-
E20
Several datatype properties
-
-
-
E21
One datatype property that has as domain a class
-
-
-
E22
One datatype property that has as domain several classes
-
-
-
E23
Several datatype properties that have as domain the same class
-
-
-
E24
One datatype property that has as range “string”
-
-
-
E25
Several datatype properties that have as range “string”
-
-
-
E26
One datatype property that has as domain a class and as range “string”
-
-
OK
10
experiments
in WebODE.
October
10thhas
2005as domain several classes
E27Export One
datatype
property
that
and as range
“string”
-
© Raúl
- García-Castro
-
Experimentation results 3
Id
Description
Added
Lost
Object property benchmarks
E28
One object property
-
-
-
E29
Several object properties
-
-
-
E30
One object property that has as domain a class
-
-
-
E31
One object property that has as domain several classes
-
-
-
E32
Several object properties that have as domain the same class
-
-
-
E33
One object property that has as range a class
-
-
-
E34
One object property that has as range several classes
-
-
-
E35
Several object properties that have as range the same class
-
-
-
E36
One object property that has as domain a class and as range another class
-
-
OK
E37
One object property that has as domain a class and as range several
classes
-
-
-
E38
One object property that has as domain several classes and as range a
class
-
-
-
E39
One object property that has as domain several classes and as range
several classes
-
-
-
E40
One object property that has as domain and as range the same class
-
-
OK
Export experiments in WebODE. October 10th 2005
11
© Raúl García-Castro
Experimentation results 4
Id
Description
Added
Lost
Instance benchmarks
E41
One instance of a class
-
-
OK
E42
One instance of several classes
-
-
-
E43
Several instances of a class
-
-
OK
Instance and object property benchmarks
E44
One instance that has an object property with another instance of the same
class
-
-
OK
E45
One instance that has the same object property with several instances of the
same class
-
-
OK
E46
Several instances that have the same object property with the same instance of
the same class
-
-
OK
E47
One instance that has an object property with himself
-
-
OK
E48
One instance that has an object property with another instance of another class
-
-
OK
E49
One instance that has the same object property with several instances of
another class
-
-
OK
E50
Several instances that have the same object property with the same instance of
another class
-
-
OK
-
OK
-
OK
Instance and datatype property benchmarks
E51
One instance that has a datatype property with a literal
12
-
E52
One instance that has the same datatype property with several literals
-
Export experiments in WebODE. October 10th 2005
© Raúl García-Castro
Index
•
•
•
•
WebODE at a glance
Execution of the benchmark suite
Comments on how WebODE exports
Comments on the experimentation
Export experiments in WebODE. October 10th 2005
13
© Raúl García-Castro
Comments on WebODE’s RDF(S) export
Export of concepts
Benchmarks: E01-E02, E08-E10, E13, E16-E18, E41, E43-E52
Example:
Export concept: concept1:
...
<rdfs:Class rdf:about="http://nothing.org/ontology#concept1">
<rdfs:label>concept1</rdfs:label>
</rdfs:Class>
...
When WebODE exports an ontology containing concepts, it inserts a
rdfs:label property into the class with the name of the concept.
Export experiments in WebODE. October 10th 2005
14
© Raúl García-Castro
Comments on WebODE’s RDF(S) export
Export of relations
Benchmarks: E13, E16-E18, E44-E52
Example:
Export relation: relation1:
...
<rdf: Property rdf:about="http://nothing.org/ontology#relation1">
<rdfs:label>termRelation1</rdfs:label>
<rdfs:domain rdf:resource="http://nothing.org/ontology#concept1"/>
<rdfs:range rdf:resource="http://nothing.org/ontology#concept2"/>
</rdf:Property>
...
When WebODE exports an ontology containing relations, it inserts a
rdfs:label property into the property with the name of the relation.
Export experiments in WebODE. October 10th 2005
15
© Raúl García-Castro
Comments on WebODE’s RDF(S) export
Concepts with instance attributes
Benchmarks: E17, E18, E51, E52
Example:
Export concept: concept1, with instance attribute instanceAttr1:
...
<rdfs:Class rdf:about="http://nothing.org/ontology#concept1">
<rdfs:label>concept1</rdfs:label>
</rdfs:Class>
<rdf:Property rdf:about="http://nothing.org/ontology#instanceAttr1">
<rdfs:label>instanceAttr1</rdfs:label>
<rdfs:domain rdf:resource="http://nothing.org/ontology#concept1"/>
<rdfs:range rdf:resource="&rdfs;Literal"/>
</rdf:Property>
...
When WebODE exports an ontology containing concepts with instance
attributes:
• It inserts a rdfs:label property into the property with the name of the attribute.
• It exports all its own datatypes as rdfs:Literal.
• It does not export the values of the instance attribute.
Export experiments in WebODE. October 10th 2005
16
© Raúl García-Castro
Comments on WebODE’s RDF(S) export
Export of instances
Benchmarks: E41, E43-E52
Example:
Export instance: instance1 of concept concept1:
...
<rdf:Description rdf:about="http://nothing.org/ontology#instance1">
<rdfs:label>instance1</rdfs:label>
<rdf:type resource="http://nothing.org/ontology#concept1">
</rdf:Description>
...
When WebODE exports an ontology containing instances, it inserts a
rdfs:label property into the instance with the name of the instance.
Export experiments in WebODE. October 10th 2005
17
© Raúl García-Castro
Comments on WebODE’s RDF(S) export
Export of instance sets
Benchmarks: E41, E43-E52
WebODE does not export instance sets in ontologies.
Export experiments in WebODE. October 10th 2005
18
© Raúl García-Castro
Index
•
•
•
•
WebODE at a glance
Execution of the benchmark suite
Comments on how WebODE exports
Comments on the experimentation
Export experiments in WebODE. October 10th 2005
19
© Raúl García-Castro
Comments on improvements on the tools
• There are no comments on improvements of WebODE, as it has already been
improved to pass all the benchmarks.
Export experiments in WebODE. October 10th 2005
20
© Raúl García-Castro
Comments on modifications performed on the tool
Some errors in WebODE were fixed:
• In E17 and E18, WebODE exported instance attribute values in concepts as
properties of the class, what was incorrect. Now, WebODE doesn't export instance
attribute values in concepts.
• In E52, WebODE exported multiple values in an instance as a rdf:Bag containing
the values, but the property that represented the instance attribute had a range of
rdfs:Literal. Now, WebODE inserts an instance-property-value triple for each
instance value.
Export experiments in WebODE. October 10th 2005
21
© Raúl García-Castro
Comments on the benchmark suites
There were some benchmarks whose ontologies could not be modelled in
WebODE. This is because WebODE cannot represent:
• Metaclasses (E03-E07).
• Cycles in class hierarchies (E11, E12).
• Relations between concepts with an arity greater than two (E14, E15).
• Instances of several classes (E42).
• Instance attributes and concept relations (datatype properties and object properties
respectively) not attached to a concept (E19-E40).
Because of this last one, the different combinations of instance attributes and
concept relations in WebODE could not be tested. The benchmark suite should be
modified to include benchmarks that test datatype and object properties attached
to classes in order to be able to test this in WebODE.
Export experiments in WebODE. October 10th 2005
22
© Raúl García-Castro
Interoperability
Working Days
October 10th-11th, 2005
Export experiments in WebODE
Raúl García-Castro
<[email protected]>
October 10th, 2005
Export experiments in WebODE. October 10th 2005
23
© Raúl García-Castro