We are very pleased to announce that HOBBIT members presented 7 papers and organized a workshop at ISWC 2018, which was held on 8-12 October, 2018 in Monterey, USA. The International Semantic Web Conference (ISWC) is the premier international forum where Semantic Web / Linked Data researchers, practitioners, and industry specialists come together to discuss, advance, and shape the future of semantic technologies on the web, within enterprises and in the context of the public institution.
Muhammad Saleem (InfAI) presented LargeRDFBench, a billion-triple benchmark for SPARQL query federation which encompasses real data as well as real queries pertaining to real bio-medical use cases. State-of-the-art SPARQL endpoint federation approaches are evaluated using this benchmark with respect to different performance measures. He also presented a demo of the SQCFrameWork, a SPARQL query containment benchmark generation framework. SQCFrameWork is able to generate customized SPARQL containment benchmarks from real SPARQL query logs. The framework is flexible enough to generate benchmarks of varying sizes and complexities according to user-defined criteria on important SPARQL features for query containment benchmarking. Finally, he also presented the extension of LargeRDFBench which pinpoint some of the limitations of LargeRDFBench and propose an extension with 8 additional queries. The evaluation results of the state-of-the-art federation engines revealed interesting insights, when tested on these additional queries. This paper was presented at the Scalable Semantic Web Knowledge Base Systems (SSWS) and was also selected as one of the best workshop’s papers to be published at an ISWC satellite event.
Tzanina Saveta (FORTH) presented the Ontology Alignment Evaluation Initiative 2017.5 pre-campaign at the OAEI 2018 workshop. Like in 2012, when OAEI transitioned the evaluation to the SEALS platform, a pre-campaign was organized to assess the feasibility of moving from SEALS to the HOBBIT platform. Tzanina presented the feedback from the developers who integrated their systems and benchmarks in the HOBBIT platform. During the presentation the future steps for the use of the HOBBIT Platform for the OAEI challenge(s) were also discussed. Tzanina also presented the Spatial Benchmark Generator SPgen at the ISWC Research Track that can be used to test the performance of link discovery systems which deal with topological relations as proposed in the state of the art DE-9IM (Dimensionally Extended nine-Intersection Model). SPgen implements all topological relations of DE-9IM between LineStrings and Polygons in the two-dimensional space.
Dubey Mohnish (IAIS) presented a framework called EARL, which performs entity linking and relation linking as a joint task at the ISWC Research Track. The framework relies on three base features and re-ranking steps in order to predict entities and relations.
Irini Fundulaki (FORTH) presented in detail the Semantic Publishing Versioning Benchmark (SPVB) at the 12th International Workshop on Scalable Semantic Web Knowledge Base Systems (SSWS 2018). SPVB aims to test the ability of versioning systems to efficiently manage versioned Linked Data datasets and queries evaluated on top of these datasets. The paper also appeared in “Emerging Topics in Semantic Technologies. ISWC 2018 Satellite Events” with AKA Verlag, since had been selected as one of the best papers of SSWS 2018.
InfAI was a co-organizer of the 4th Natural Language Interface for the Web of Data (NLIWOD) workshop and 9th Question Answering over Linked Data challenge (QALD-9). The workshop is a joint event of two active communities in the area of interaction paradigms to Linked Data: NLIWOD4 and QALD-9. NLIWOD, a workshop for discussions on the advancement of natural language interfaces to the Web of Data. QALD is a benchmarking campaign powered by HOBBIT (project-hobbit.eu) .
Finally, Irini Fundulaki (FORTH) gave a keynote talk on the use of benchmarks for Health-Care solutions at the First International Workshop on Semantic Web Technologies for Health Data Management where she talked about benchmarking principles and methodology.