OKE2018 Challenge – Tasks

Task 1: Focused Named Entity Identification and Linking

The task comprises the identification of named entities in sentences and the disambiguation of the identified entities to the DBpedia knowledge base.
This task is limited to three DBpedia ontology classes (Person, Place, Organisation) and their associated sub classes.

A competing system is expected to identify elements in a given text by its start and end index, further to generate an RDF formalizing the linking of the identified entities to the DBpedia knowledge base.

Example

Florence May Harding studied at a school in Sydney, and with Douglas Robert Dundas, but in effect had no formal training in either botany or art.

identified named entity	generated URI	indices
Florence May Harding	dbr:Florence_May_Harding	0,20
Sydney	dbr:Sydney	44,50
Douglas Robert Dundas	oke:Douglas_Robert_Dundas	61,82

Request data

In the example above, the benchmarked system would receive the following UTF-8 encoded String.

@prefix xsd: <http://www.w3.org/2001/XMLSchema#> .
@prefix nif: <http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#> .
@prefix dbpedia: <http://dbpedia.org/resource/> .
@prefix itsrdf: <http://www.w3.org/2005/11/its/rdf#> .

<http://example.com/example-task1#char=0,146>
        a                     nif:RFC5147String , nif:String , nif:Context ;
        nif:beginIndex        "0"^^xsd:nonNegativeInteger ;
        nif:endIndex          "146"^^xsd:nonNegativeInteger ;
        nif:isString          "Florence May Harding studied at a school in Sydney, and with Douglas Robert Dundas , but in effect had no formal training in either botany or art."@en .

Response data

The expected response of a participating system for the example above would be the following UTF-8 encoded String.

@prefix xsd: <http://www.w3.org/2001/XMLSchema#> .
@prefix nif: <http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#> .
@prefix dbpedia: <http://dbpedia.org/resource/> .
@prefix itsrdf: <http://www.w3.org/2005/11/its/rdf#> .

<http://example.com/example-task1#char=0,146>
        a                     nif:RFC5147String , nif:String , nif:Context ;
        nif:beginIndex        "0"^^xsd:nonNegativeInteger ;
        nif:endIndex          "146"^^xsd:nonNegativeInteger ;
        nif:isString          "Florence May Harding studied at a school in Sydney, and with Douglas Robert Dundas , but in effect had no formal training in either botany or art."@en .

<http://example.com/example-task1#char=0,20>
        a                     nif:RFC5147String , nif:String ;
        nif:anchorOf          "Florence May Harding"@en ;
        nif:beginIndex        "0"^^xsd:nonNegativeInteger ;
        nif:endIndex          "20"^^xsd:nonNegativeInteger ;
        nif:referenceContext  <http://example.com/example-task1#char=0,146> ;
        itsrdf:taIdentRef     dbpedia:Florence_May_Harding .

<http://example.com/example-task1#char=44,50>
        a                     nif:RFC5147String , nif:String ;
        nif:anchorOf          "Sydney"@en ;
        nif:beginIndex        "44"^^xsd:nonNegativeInteger ;
        nif:endIndex          "50"^^xsd:nonNegativeInteger ;
        nif:referenceContext  <http://example.com/example-task1#char=0,146> ;
        itsrdf:taIdentRef     dbpedia:Sydney .

<http://example.com/example-task1#char=61,82>
        a                     nif:RFC5147String , nif:String ;
        nif:anchorOf          "Douglas Robert Dundas"@en ;
        nif:beginIndex        "61"^^xsd:nonNegativeInteger ;
        nif:endIndex          "82"^^xsd:nonNegativeInteger ;
        nif:referenceContext  <http://example.com/example-task1#char=0,146> ;
        itsrdf:taIdentRef     <http://aksw.org/notInWiki/Douglas_Robert_Dundas> .

Task 2: Broader Named Entity Identification and Linking

This task extends the first task towards the entity classes in DBpedia. Beside the three types in the first task, a competing system might have to identify other types of entities.
The following table provides in the first column a complete list of the super classes that are considered. The column in the middle contains an incomplite list of sub classes if any and the last example instances.

super class	sub class examples	instance examples
Activity	Game, Sport	Chess, Baseball
Agent	Employer, Organisation, Person	Leipzig_University, Angela_Merkel
Award	Decoration, NobelPrize	Humanitas_Prize
Disease		Diabetes_mellitus_type_2
EthnicGroup		Javanese_people
Event	Competition, PersonalEvent	Extended_Semantic_Web_Conference
Language	ProgrammingLanguage	English_language, Scala_(programming_language)
MeanOfTransportation	Aircraft, Train	Airbus_A300
PersonFunction	PoliticalFunction, Profession
Place		Leipzig
Species	Animal	Cat
Work	Artwork	Debian

The request and response look like the example request and response of task 1.

Task 3: Relation Extraction

Given documents with sentences, the DBpedia knowledge base, a target entity type hierarchy and a target relation type hierarchy. Furthermore, annotations of the sentences in a document are given, i.e., entity mentions with positions, the linking of each entity and its type.

The aim of this task is to find binary relations in sentences.

Entity and Relation Type Hierarchy

Property	Domain	Range
affiliation	Organisation	Organisation
almaMater	Person	EducationalInstitution
bandMember	Band	Person
birthPlace	Person	Place
ceo	Organisation	Person
child	Person	Person
club	Athlete	SportsTeam
country	Organisation, Person,Place	Country
deathPlace	Person	Place
debutTeam	Athlete	SportsTeam
department	PopulatedPlace	PopulatedPlace
district	Place	PopulatedPlace
doctoralAdvisor	Scientist	Person
doctoralStudent	Scientist	Person
employer	Person	Organisation
formerBandMember	Band	Person
formerTeam	Athlete	SportsTeam
foundationPlace	Organisation	City
headquarter	Organisation	PopulatedPlace
hometown	Organisation, Person	Settlement
leaderName	PopulatedPlace	Person
locatedInArea	Place	Place
location	Organisation,Person,Place	Place
nationality	Person	Country
parent	Person	Person
president	Organisation	Person
relative	Person	Person
spouse	Person	Person
subsidiary	Company	Company
tenant	ArchitecturalStructure	Organisation
trainer	Athlete	Person

Request data

The request data consists of a document that could contain more than one sentence. In a document the entities are annotated with the super classes, i.e., Person,Place,Organisation and are linked to DBpedia or, in case of emerging entities, a URI is given for them.

@prefix rdf:  <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix xsd:  <http://www.w3.org/2001/XMLSchema#> .
@prefix itsrdf: <http://www.w3.org/2005/11/its/rdf#> .
@prefix nif:  <http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#> .
@prefix rdfs:  <http://www.w3.org/2000/01/rdf-schema#> .
@prefix dbr: <http://dbpedia.org/resource/> .
@prefix dbo: <http://dbpedia.org/ontology/> .
@prefix aksw: <http://aksw.org/notInWiki/> . 
@prefix oa: <http://www.w3.org/ns/oa#> .

<http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78>
  a  nif:RFC5147String , nif:String , nif:Context ;
  nif:beginIndex  "0"^^xsd:nonNegativeInteger ;
  nif:endIndex  "78"^^xsd:nonNegativeInteger ;
  nif:isString  "Conor McGregor's longtime trainer, John Kavanagh, is ready to shock the world."^^xsd:string .

<http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,22>
  a  nif:RFC5147String , nif:String , nif:Phrase ;
  nif:anchorOf  "Conor McGregor's"^^xsd:string ;
  nif:beginIndex  "0"^^xsd:nonNegativeInteger ;
  nif:endIndex  "22"^^xsd:nonNegativeInteger ;
  nif:referenceContext  <http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78> ;
  its:taClassRef  dbo:Person ;
  itsrdf:taIdentRef  dbr:Conor_McGregor .
  
<http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=35,48>
  a  nif:RFC5147String , nif:String , nif:Phrase ;
  nif:anchorOf  "John Kavanagh"^^xsd:string ;
  nif:beginIndex  "35"^^xsd:nonNegativeInteger ;
  nif:endIndex  "48"^^xsd:nonNegativeInteger ;
  nif:referenceContext  <http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78> ;
  its:taClassRef  dbo:Person ;
  itsrdf:taIdentRef  aksw:John_Kavanagh .

Response data

@prefix rdf:  <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix xsd:  <http://www.w3.org/2001/XMLSchema#> .
@prefix itsrdf: <http://www.w3.org/2005/11/its/rdf#> .
@prefix nif:  <http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#> .
@prefix rdfs:  <http://www.w3.org/2000/01/rdf-schema#> .
@prefix dbr: <http://dbpedia.org/resource/> .
@prefix dbo: <http://dbpedia.org/ontology/> .
@prefix aksw: <http://aksw.org/notInWiki/> . 
@prefix oa: <http://www.w3.org/ns/oa#> .

[]
  a  rdf:Statement , oa:Annotation ;
  rdf:object  dbr:Conor_McGregor ;
  rdf:predicate  dbo:trainer ;
  rdf:subject  aksw:John_Kavanagh ;
  oa:hasTarget [
    a oa:SpecificResource;
    oa:hasSource <http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78> ] .

Task 4: Knowledge Extraction

This task is a combination of Task 1 (Focused Named Entity Identification and Linking) and Task 3 (Relation Extraction).

The request data consists of documents with sentences. A participating system is expected to respond with named entities found in the documents, with the linking to DBpedia as well as with relations between the entities.

Request data

@prefix rdf:  <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix xsd:  <http://www.w3.org/2001/XMLSchema#> .
@prefix itsrdf: <http://www.w3.org/2005/11/its/rdf#> .
@prefix nif:  <http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#> .
@prefix rdfs:  <http://www.w3.org/2000/01/rdf-schema#> .
@prefix dbr: <http://dbpedia.org/resource/> .
@prefix dbo: <http://dbpedia.org/ontology/> .
@prefix aksw: <http://aksw.org/notInWiki/> . 
@prefix oa: <http://www.w3.org/ns/oa#> .

<http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78>
  a  nif:RFC5147String , nif:String , nif:Context ;
  nif:beginIndex  "0"^^xsd:nonNegativeInteger ;
  nif:endIndex  "78"^^xsd:nonNegativeInteger ;
  nif:isString  "Conor McGregor's longtime trainer, John Kavanagh, is ready to shock the world."^^xsd:string .

Response data

@prefix rdf:  <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix xsd:  <http://www.w3.org/2001/XMLSchema#> .
@prefix itsrdf: <http://www.w3.org/2005/11/its/rdf#> .
@prefix nif:  <http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#> .
@prefix rdfs:  <http://www.w3.org/2000/01/rdf-schema#> .
@prefix dbr: <http://dbpedia.org/resource/> .
@prefix dbo: <http://dbpedia.org/ontology/> .
@prefix aksw: <http://aksw.org/notInWiki/> . 
@prefix oa: <http://www.w3.org/ns/oa#> .

<http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,22>
  a  nif:RFC5147String , nif:String , nif:Phrase ;
  nif:anchorOf  "Conor McGregor's"^^xsd:string ;
  nif:beginIndex  "0"^^xsd:nonNegativeInteger ;
  nif:endIndex  "22"^^xsd:nonNegativeInteger ;
  nif:referenceContext  <http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78> ;
  itsrdf:taIdentRef  dbr:Conor_McGregor .
  
<http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=35,48>
  a  nif:RFC5147String , nif:String , nif:Phrase ;
  nif:anchorOf  "John Kavanagh"^^xsd:string ;
  nif:beginIndex  "35"^^xsd:nonNegativeInteger ;
  nif:endIndex  "48"^^xsd:nonNegativeInteger ;
  nif:referenceContext  <http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78> ;
  itsrdf:taIdentRef  aksw:John_Kavanagh . 

[]
  a  rdf:Statement , oa:Annotation ;
  rdf:object  dbr:Conor_McGregor ;
  rdf:predicate  dbo:trainer ;
  rdf:subject  aksw:John_Kavanagh ;
  oa:hasTarget [
    a oa:SpecificResource;
    oa:hasSource <http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78> ] .