Category Archives: Campaigns

HOBBIT Open Challenges: A New Era II

Continuing from our latest blogpost on Open Challenges, we look into the two remaining Open Challenges organized by the HOBBIT project; there we looked at the OKE and MOCHA open challenges, while here we will dig into  the SQA and StreaML open challenges. The SQA open challenge started in December 2017 and is currently in […]

Read More

HOBBIT Open Challenges: A New Era I

During the second year of the project, the first series of HOBBIT challenges was successfully organized and preparations for the challenges that will run during 2018 have started. HOBBIT is also proud to announce the launch of a series of four HOBBIT Open Challenges. The HOBBIT Open Challenges will ensure continuous participation and systems evaluation. […]

Read More

HOBBIT collaborates with EuroStars project DIESEL

HOBBIT collaborates with European research projects to support their benchmarking activities. One of the ongoing collaborations is with the DIESEL project, which aims to develop a Linked-Data driven keyword search engine suited for handling extensive amounts of enterprise data. HOBBIT and DIESEL teamed up to provide a supplementary dataset for the QALD-7 challenge at the […]

Read More

Preliminary Survey Results

In this post, we will present some preliminary results of the survey we ran for the past few months. At the time of writing, there were 61 survey participants. These were evenly divided among the different profiles, namely solution providers, technology users and scientific community. Most of the participants have two or more of these profiles. All […]

Read More

Upcoming Evaluation Campaigns powered by HOBBIT technologies, almost.

In a former blog post, we presented the predecessor of the HOBBIT platform, the General Entity Annotator Benchmarking Framework (GERBIL) [1]. This framework has been adopted by two evaluation campaigns as described in this post. These campaigns focus on tasks such as entity recognition, entity typing and question answering. Open Knowledge Extraction Challenge The OKE […]

Read More