Holistic Benchmarking of Big Linked Data

HOBBIT aims at abolishing the barriers in the adoption and deployment of Big Linked Data by European companies, by means of open benchmarking reports that allow them to assess the fitness of existing solutions for their purposes. These benchmarks are based on data that reflects reality and measures industry-relevant Key Performance Indicators (KPIs) with comparable results using standardized hardware.

Technology Users

Solution Providers

You provide a solution for Linked Data, and you want to assess how good it is.

Read More

Technology Users

Technology Users

Need a Linked Data solutions that fits the best for your requirements?

Read More

Scientific Community

Scientific Community

Working on innovation the Linked Data Lifecycle, you can test your approach.

Read More

Versioning for Big Linked Data: approaches and benchmarks

As LOD datasets are constantly evolving, both at schema and instance level, there is a need for systems that support efficiently storing and querying such evolving data. Such archiving systems must support various types of queries on data, including queries that access multiple versions (cross-version queries), queries that access the evolution history (delta) itself, as well as […]

Read More

Hobbit at ACL 2016

The annual meeting of the Association for Computational Linguistics (ACL) is the premier conference of the field of computational linguistics, covering a broad spectrum of diverse research areas that are concerned with computational approaches to natural language. ACL took place in Germany and was held at the Humboldt University, in the heart of Berlin, August […]

Read More

Special issue on Benchmarking Linked Data at Semantic Web – Interoperability, Usability, Applicability an IOS Press Journal

Special issue on Benchmarking Linked Data More information at http://www.semantic-web-journal.net/blog/special-issue-benchmarking-linked-data Call for papers: Special issue on Benchmarking Linked Data The provision of high-quality benchmarks and benchmarking results yields the potential of pushing the development of better approaches and solutions. This holds in particular in the Semantic Web and Linked Data domain. Big Linked Data is gradually […]

Read More

HOBBIT @ EDF 2016

EDF 2016 is now over and HOBBIT was present in several functions. We disseminated the idea of a universal benchmarking platform to the many European organizations and research projects that were present at the forum. Potential collaborations were established with data-driven projects pertaining to geo-spatial data and societal challenges, which will be followed through. Beware […]

Read More

Preliminary Survey Results

In this post, we will present some preliminary results of the survey we ran for the past few months. At the time of writing, there were 61 survey participants. These were evenly divided among the different profiles, namely solution providers, technology users and scientific community. Most of the participants have two or more of these profiles. All […]

Read More

HOBBIT at ESWC

ESWC is one of the major hubs for academia and industry interested in Linked Data and the Semantic Web. Accordingly, the HOBBIT project was present and gave an overview of its goals to the Semantic Web community. Two major events were at the center of HOBBIT’s attendance to ESWC. On June 1st, the first HOBBIT […]

Read More

Initial Data Management Plan Drafted!

In one of its key tasks, HOBBIT will continuously collect various datasets (i.e., not limited to specific domains) as the base for benchmarks. Those data will initially be provided by the project industrial partners, and later on by members of the HOBBIT community. A data management plan will be used as a guideline when handling […]

Read More

Upcoming Evaluation Campaigns powered by HOBBIT technologies, almost.

In a former blog post, we presented the predecessor of the HOBBIT platform, the General Entity Annotator Benchmarking Framework (GERBIL) [1]. This framework has been adopted by two evaluation campaigns as described in this post. These campaigns focus on tasks such as entity recognition, entity typing and question answering. Open Knowledge Extraction Challenge The OKE […]

Read More

The roots of HOBBIT: GERBIL

The idea of creating a platform to host different benchmarking tools for the Big Linked Data lifecycle was born with the creation of the General Entity Annotator Benchmarking Framework [1](GERBIL). GERBIL is designed to facilitate the benchmarking of named entity recognition (NER), named entity disambiguation (NED) and other semantic tagging approaches. GERBIL’s objective is to […]

Read More