OKE2018 Challenge – Tasks

Task 1: Focused Named Entity Identification and Linking

The task comprises the identification of named entities in sentences and the disambiguation of the identified entities to the DBpedia knowledge base.
This task is limited to three DBpedia ontology classes (Person, Place, Organisation) and their associated sub classes.

A competing system is expected to identify elements in a given text by its start and end index, further to generate an RDF formalizing the linking of the identified entities to the DBpedia knowledge base.

Example

Florence May Harding studied at a school in Sydney, and with Douglas Robert Dundas, but in effect had no formal training in either botany or art.

identified named entity generated URI indices
Florence May Harding dbr:Florence_May_Harding 0,20
Sydney dbr:Sydney 44,50
Douglas Robert Dundas oke:Douglas_Robert_Dundas 61,82

Request data

In the example above, the benchmarked system would receive the following UTF-8 encoded String.

@prefix xsd: <http://www.w3.org/2001/XMLSchema#> .
@prefix nif: <http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#> .
@prefix dbpedia: <http://dbpedia.org/resource/> .
@prefix itsrdf: <http://www.w3.org/2005/11/its/rdf#> .
<http://example.com/example-task1#char=0,146>
        a                     nif:RFC5147String , nif:String , nif:Context ;
        nif:beginIndex        "0"^^xsd:nonNegativeInteger ;
        nif:endIndex          "146"^^xsd:nonNegativeInteger ;
        nif:isString          "Florence May Harding studied at a school in Sydney, and with Douglas Robert Dundas , but in effect had no formal training in either botany or art."@en .

Response data

The expected response of a participating system for the example above would be the following UTF-8 encoded String.

@prefix xsd: <http://www.w3.org/2001/XMLSchema#> .
@prefix nif: <http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#> .
@prefix dbpedia: <http://dbpedia.org/resource/> .
@prefix itsrdf: <http://www.w3.org/2005/11/its/rdf#> .
<http://example.com/example-task1#char=0,146>
        a                     nif:RFC5147String , nif:String , nif:Context ;
        nif:beginIndex        "0"^^xsd:nonNegativeInteger ;
        nif:endIndex          "146"^^xsd:nonNegativeInteger ;
        nif:isString          "Florence May Harding studied at a school in Sydney, and with Douglas Robert Dundas , but in effect had no formal training in either botany or art."@en .
<http://example.com/example-task1#char=0,20>
        a                     nif:RFC5147String , nif:String ;
        nif:anchorOf          "Florence May Harding"@en ;
        nif:beginIndex        "0"^^xsd:nonNegativeInteger ;
        nif:endIndex          "20"^^xsd:nonNegativeInteger ;
        nif:referenceContext  <http://example.com/example-task1#char=0,146> ;
        itsrdf:taIdentRef     dbpedia:Florence_May_Harding .
<http://example.com/example-task1#char=44,50>
        a                     nif:RFC5147String , nif:String ;
        nif:anchorOf          "Sydney"@en ;
        nif:beginIndex        "44"^^xsd:nonNegativeInteger ;
        nif:endIndex          "50"^^xsd:nonNegativeInteger ;
        nif:referenceContext  <http://example.com/example-task1#char=0,146> ;
        itsrdf:taIdentRef     dbpedia:Sydney .
<http://example.com/example-task1#char=61,82>
        a                     nif:RFC5147String , nif:String ;
        nif:anchorOf          "Douglas Robert Dundas"@en ;
        nif:beginIndex        "61"^^xsd:nonNegativeInteger ;
        nif:endIndex          "82"^^xsd:nonNegativeInteger ;
        nif:referenceContext  <http://example.com/example-task1#char=0,146> ;
        itsrdf:taIdentRef     <http://aksw.org/notInWiki/Douglas_Robert_Dundas> .

Task 2: Broader Named Entity Identification and Linking

This task extends the first task towards the entity classes in DBpedia. Beside the three types in the first task, a competing system might have to identify other types of entities.
The following table provides in the first column a complete list of the super classes that are considered. The column in the middle contains an incomplite list of sub classes if any and the last example instances.

super class sub class examples instance examples
Activity Game, Sport Chess, Baseball
Agent Employer, Organisation, Person Leipzig_University, Angela_Merkel
Award Decoration, NobelPrize Humanitas_Prize
Disease Diabetes_mellitus_type_2
EthnicGroup Javanese_people
Event Competition, PersonalEvent Extended_Semantic_Web_Conference
Language ProgrammingLanguage English_language, Scala_(programming_language)
MeanOfTransportation Aircraft, Train Airbus_A300
PersonFunction PoliticalFunction, Profession
Place Leipzig
Species Animal Cat
Work Artwork Debian

The request and response look like the example request and response of task 1.

Task 3: Relation Extraction

Given documents with sentences, the DBpedia knowledge base, a target entity type hierarchy and a target relation type hierarchy. Furthermore, annotations of the sentences in a document are given, i.e., entity mentions with positions, the linking of each entity and its type.

The aim of this task is to find binary relations in sentences.

Entity and Relation Type Hierarchy

Property Domain Range
affiliation Organisation Organisation
almaMater Person EducationalInstitution
bandMember Band Person
birthPlace Person Place
ceo Organisation Person
child Person Person
club Athlete SportsTeam
country Organisation, Person,Place Country
deathPlace Person Place
debutTeam Athlete SportsTeam
department PopulatedPlace PopulatedPlace
district Place PopulatedPlace
doctoralAdvisor Scientist Person
doctoralStudent Scientist Person
employer Person Organisation
formerBandMember Band Person
formerTeam Athlete SportsTeam
foundationPlace Organisation City
headquarter Organisation PopulatedPlace
hometown Organisation, Person Settlement
leaderName PopulatedPlace Person
locatedInArea Place Place
location Organisation,Person,Place Place
nationality Person Country
parent Person Person
president Organisation Person
relative Person Person
spouse Person Person
subsidiary Company Company
tenant ArchitecturalStructure Organisation
trainer Athlete Person

Request data

The request data consists of a document that could contain more than one sentence. In a document the entities are annotated with the super classes, i.e., Person,Place,Organisation and are linked to DBpedia or, in case of emerging entities, a URI is given for them.

@prefix rdf:  <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix xsd:  <http://www.w3.org/2001/XMLSchema#> .
@prefix itsrdf: <http://www.w3.org/2005/11/its/rdf#> .
@prefix nif:  <http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#> .
@prefix rdfs:  <http://www.w3.org/2000/01/rdf-schema#> .
@prefix dbr: <http://dbpedia.org/resource/> .
@prefix dbo: <http://dbpedia.org/ontology/> .
@prefix aksw: <http://aksw.org/notInWiki/> . 
@prefix oa: <http://www.w3.org/ns/oa#> .

<http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78>
  a  nif:RFC5147String , nif:String , nif:Context ;
  nif:beginIndex  "0"^^xsd:nonNegativeInteger ;
  nif:endIndex  "78"^^xsd:nonNegativeInteger ;
  nif:isString  "Conor McGregor's longtime trainer, John Kavanagh, is ready to shock the world."^^xsd:string .

<http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,22>
  a  nif:RFC5147String , nif:String , nif:Phrase ;
  nif:anchorOf  "Conor McGregor's"^^xsd:string ;
  nif:beginIndex  "0"^^xsd:nonNegativeInteger ;
  nif:endIndex  "22"^^xsd:nonNegativeInteger ;
  nif:referenceContext  <http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78> ;
  its:taClassRef  dbo:Person ;
  itsrdf:taIdentRef  dbr:Conor_McGregor .
  
<http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=35,48>
  a  nif:RFC5147String , nif:String , nif:Phrase ;
  nif:anchorOf  "John Kavanagh"^^xsd:string ;
  nif:beginIndex  "35"^^xsd:nonNegativeInteger ;
  nif:endIndex  "48"^^xsd:nonNegativeInteger ;
  nif:referenceContext  <http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78> ;
  its:taClassRef  dbo:Person ;
  itsrdf:taIdentRef  aksw:John_Kavanagh . 

Response data

@prefix rdf:  <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix xsd:  <http://www.w3.org/2001/XMLSchema#> .
@prefix itsrdf: <http://www.w3.org/2005/11/its/rdf#> .
@prefix nif:  <http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#> .
@prefix rdfs:  <http://www.w3.org/2000/01/rdf-schema#> .
@prefix dbr: <http://dbpedia.org/resource/> .
@prefix dbo: <http://dbpedia.org/ontology/> .
@prefix aksw: <http://aksw.org/notInWiki/> . 
@prefix oa: <http://www.w3.org/ns/oa#> .

[]
  a  rdf:Statement , oa:Annotation ;
  rdf:object  dbr:Conor_McGregor ;
  rdf:predicate  dbo:trainer ;
  rdf:subject  aksw:John_Kavanagh ;
  oa:hasTarget [
    a oa:SpecificResource;
    oa:hasSource <http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78> ] .

Task 4: Knowledge Extraction

This task is a combination of Task 1 (Focused Named Entity Identification and Linking) and Task 3 (Relation Extraction).

The request data consists of documents with sentences. A participating system is expected to respond with named entities found in the documents, with the linking to DBpedia as well as with relations between the entities.

Request data

@prefix rdf:  <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix xsd:  <http://www.w3.org/2001/XMLSchema#> .
@prefix itsrdf: <http://www.w3.org/2005/11/its/rdf#> .
@prefix nif:  <http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#> .
@prefix rdfs:  <http://www.w3.org/2000/01/rdf-schema#> .
@prefix dbr: <http://dbpedia.org/resource/> .
@prefix dbo: <http://dbpedia.org/ontology/> .
@prefix aksw: <http://aksw.org/notInWiki/> . 
@prefix oa: <http://www.w3.org/ns/oa#> .

<http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78>
  a  nif:RFC5147String , nif:String , nif:Context ;
  nif:beginIndex  "0"^^xsd:nonNegativeInteger ;
  nif:endIndex  "78"^^xsd:nonNegativeInteger ;
  nif:isString  "Conor McGregor's longtime trainer, John Kavanagh, is ready to shock the world."^^xsd:string .

Response data

@prefix rdf:  <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix xsd:  <http://www.w3.org/2001/XMLSchema#> .
@prefix itsrdf: <http://www.w3.org/2005/11/its/rdf#> .
@prefix nif:  <http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#> .
@prefix rdfs:  <http://www.w3.org/2000/01/rdf-schema#> .
@prefix dbr: <http://dbpedia.org/resource/> .
@prefix dbo: <http://dbpedia.org/ontology/> .
@prefix aksw: <http://aksw.org/notInWiki/> . 
@prefix oa: <http://www.w3.org/ns/oa#> .

<http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,22>
  a  nif:RFC5147String , nif:String , nif:Phrase ;
  nif:anchorOf  "Conor McGregor's"^^xsd:string ;
  nif:beginIndex  "0"^^xsd:nonNegativeInteger ;
  nif:endIndex  "22"^^xsd:nonNegativeInteger ;
  nif:referenceContext  <http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78> ;
  itsrdf:taIdentRef  dbr:Conor_McGregor .
  
<http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=35,48>
  a  nif:RFC5147String , nif:String , nif:Phrase ;
  nif:anchorOf  "John Kavanagh"^^xsd:string ;
  nif:beginIndex  "35"^^xsd:nonNegativeInteger ;
  nif:endIndex  "48"^^xsd:nonNegativeInteger ;
  nif:referenceContext  <http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78> ;
  itsrdf:taIdentRef  aksw:John_Kavanagh . 

[]
  a  rdf:Statement , oa:Annotation ;
  rdf:object  dbr:Conor_McGregor ;
  rdf:predicate  dbo:trainer ;
  rdf:subject  aksw:John_Kavanagh ;
  oa:hasTarget [
    a oa:SpecificResource;
    oa:hasSource <http://www.ontologydesignpatterns.org/data/oke-challenge-2018/task-3/sentence-1#char=0,78> ] .