Tag Archives: challenge

HOBBIT Highlights: Summary of HOBBIT challenges (1st & 2nd period)

The HOBBIT project has successfully organized two series of challenges in order to measure the performance of implemented systems in processing Big Linked Data. In total, we organized ten (10) challenges, five (5) in each period. In particular, during the first period, HOBBIT organized: the MOCHA challenge at ESWC 2017 (https://project-hobbit.eu/challenges/mighty-storage-challenge/) the OKE challenge at […]

Read More

SQA Challenge

Question answering (QA) systems have recently become commercially viable (and lucrative) products, thanks to increasing investments and research and the development of intuitive and easy-to-use interfaces. Regular interactions with QA systems have become increasingly frequent and natural and the consumers’ expectations around their capabilities keep growing. Such systems are now available in various settings, devices […]

Read More

HOBBIT @ DEBS Conference 2018

The DEBS Grand Challenge 2018 was successfully executed on the HOBBIT online platform. Analytical and machine learning algorithms running in a distributed streaming manner are in the focus of Grand Challenge series, which is a  joint event with the annual Distributed Event-Based Systems (DEBS) Conference. During the competition participating  teams have to demonstrate their capabilities […]

Read More

Virtuoso development progress evaluated with the Data Storage benchmark

After Virtuoso took part in the MOCHA 2017 and MOCHA 2018 challenges, and won both, we at OpenLink wanted to benchmark and evaluate a set of different Virtuoso versions using the same benchmark setup, in order to get a comparative analysis and showcase the progress of its development. The benchmark which we set out to […]

Read More

Structured Machine Learning Benchmark v2

The second version of the Structured Machine Learning Benchmark is available online. The benchmark is created for the upcoming DEBS Grand Challenge 2018. The challenge is based on marine traffic data and focused on real-time prediction of destination ports and arrival times for vessels, which regularly send their geo coordinates, timestamps, course and other relevant […]

Read More

HOBBIT Open Challenges: A New Era II

Continuing from our latest blogpost on Open Challenges, we look into the two remaining Open Challenges organized by the HOBBIT project; there we looked at the OKE and MOCHA open challenges, while here we will dig into  the SQA and StreaML open challenges. The SQA open challenge started in December 2017 and is currently in […]

Read More

HOBBIT Open Challenges: A New Era I

During the second year of the project, the first series of HOBBIT challenges was successfully organized and preparations for the challenges that will run during 2018 have started. HOBBIT is also proud to announce the launch of a series of four HOBBIT Open Challenges. The HOBBIT Open Challenges will ensure continuous participation and systems evaluation. […]

Read More

Concurrent version of the Data Storage Benchmark

In one of our previous blog posts, we presented the approaches regarding the data storage benchmark. We introduced important modifications to the synthetic data generator and the dataset of the Social Network Benchmark, developed in the context of the FP7 Linked Data Benchmarking Council (LDBC), and transformed its SQL queries to SPARQL, all while preserving […]

Read More

Ontology Matching (OM 2017)

Since 2004 OAEI organises campaigns aiming at evaluating ontology matching tools and technologies. This year FORTH along with HOBBIT participated in the OAEI 2017 Instance Matching Track and introduced the HOBBIT Link Discovery Track. The Tasks come with two datasets the Sandbox and Mainbox characterized by the number of instances to match (i.e., scale). The […]

Read More