In a former blog post, we presented the predecessor of the HOBBIT platform, the General Entity Annotator Benchmarking Framework (GERBIL) [1]. This framework has been adopted by two evaluation campaigns as described in this post. These campaigns focus on tasks such as entity recognition, entity typing and question answering. Open Knowledge Extraction Challenge The OKE […]
The idea of creating a platform to host different benchmarking tools for the Big Linked Data lifecycle was born with the creation of the General Entity Annotator Benchmarking Framework [1](GERBIL). GERBIL is designed to facilitate the benchmarking of named entity recognition (NER), named entity disambiguation (NED) and other semantic tagging approaches. GERBIL’s objective is to […]
Graph-TA, organised by the DAMA-UPC (Data Management) group of Universitat Politècnica de Catalunya – BarcelonaTech, aims at encouraging researchers to present their current work and interact in an informal set up in order to foster collaboration with other colleagues. Thus, the workshop provides a forum for presenting and discussing research results and applications in the […]
We opened up a short survey to question the industry and other potential partners on how they are evaluating their software. The goal of this survey is to determine industry-relevant key performance indicators (KPI’s) for building benchmarks that measure these factors. With this survey, we aim to raise awareness about the HOBBIT project and lay a foundation for […]
Linked Data technologies are proving their efficiency in creating interoperable IT systems that integrate disparate data sources. However, it is still unclear which solutions scale up the needs of modern business applications. Benchmarks have been created to support decisions on choosing the best software solution. However, they commonly fail to reflect business requirements in terms […]
The HOBBIT Kickoff meeting took in Luxembourg on the 18 and 19 January 2016. All 10 partners were present and showed the firsts results of the first month of the project. These, corresponde to creating a online presence, description of the datasets in the consortium and collecting events where the partners are to disseminate and […]
HOBBIT has officially started on 1 December 2015. The EU H2020 funded project (GA No 688227) has a runtime of 36 months. The consortium has 10 partners from 6 different countries. Within the next 36 moths we will deliver 6 milestones and an open source holistic benchmarking platform for Big Linked Data. The HOBBIT partners […]
