HOBBIT opted for a survey method to analyze benchmarking needs from the Big Linked Data community. During the first year of the project we developed and distributed a survey to gather the requirements for the HOBBIT platform and benchmarks. The aim of the fully anonymized survey was for the HOBBIT consortium to determine how a […]
The project HOBBIT aims to provide a platform for technology users, solution providers, and scientific community to assess the fitness of existing solutions for their purposes based on industrial data. The challenge here is to provide a tool to reproducible generate an arbitrary amount of these data for different benchmarks. The solution within HOBBIT is […]
We are happy to announce the release of the second version of the HOBBIT Benchmarking Platform. During the last months, we improved the stability of the platform as well as the set of features it supports. The full list of the features implemented in version 2 are listed below. Improved the usability of the platform […]
The second version of the Structured Machine Learning Benchmark is available online. The benchmark is created for the upcoming DEBS Grand Challenge 2018. The challenge is based on marine traffic data and focused on real-time prediction of destination ports and arrival times for vessels, which regularly send their geo coordinates, timestamps, course and other relevant […]
There exist a number of storage benchmarks that test the ability of Linked Data systems to store and query data in an efficient way without addressing the management of data versions. To the best of our knowledge only a limited number of versioning systems (mostly academic) and benchmarks exist for storing versions and testing the […]
Continuing from our latest blogpost on Open Challenges, we look into the two remaining Open Challenges organized by the HOBBIT project; there we looked at the OKE and MOCHA open challenges, while here we will dig into the SQA and StreaML open challenges. The SQA open challenge started in December 2017 and is currently in […]
During the second year of the project, the first series of HOBBIT challenges was successfully organized and preparations for the challenges that will run during 2018 have started. HOBBIT is also proud to announce the launch of a series of four HOBBIT Open Challenges. The HOBBIT Open Challenges will ensure continuous participation and systems evaluation. […]
In one of our previous blog posts, we presented the approaches regarding the data storage benchmark. We introduced important modifications to the synthetic data generator and the dataset of the Social Network Benchmark, developed in the context of the FP7 Linked Data Benchmarking Council (LDBC), and transformed its SQL queries to SPARQL, all while preserving […]
Summarizing the experience of the successful co-organization of the DEBS Grand Challenge 2017 on the HOBBIT platform, we made one step towards a more lightweight and productive design-development of HOBBIT-related software components. We are happy to announce a standalone software library called the HOBBIT Java SDK. The proposed SDK is targeted to make the design […]
Since 2004 OAEI organises campaigns aiming at evaluating ontology matching tools and technologies. This year FORTH along with HOBBIT participated in the OAEI 2017 Instance Matching Track and introduced the HOBBIT Link Discovery Track. The Tasks come with two datasets the Sandbox and Mainbox characterized by the number of instances to match (i.e., scale). The […]
