HOBBIT organizes, joins and promotes challenges that aim to measure the performance of technologies for the different steps of the Big Linked Data (BLD) lifecycle. In contrast to existing benchmarks, we provide modular and easily extensible benchmarks for all industry-relevant BLD processing steps that allow to assess whole suites of software that cover more than one step. The infrastructure necessary to run the evaluation campaigns is presented here. Our architecture relies on web interfaces and cloud infrastructures to ensure scalability.
Current challenges:
- MOCHA2018 Challenge – ESWC 2018
- SQA Challenge – ESWC 2018
- OKE2018 Challenge – ESWC 2018
- Grand Challenge – DEBS 2018
- QALD-9 Challenge – ISWC 2018
Past challenges:
- Link Discovery Task at OAEI 2018 – OM 2018, ISWC 2018
- MOCHA2017 Challenge – ESWC 2017
- QALD2017 Challenge – ESWC 2017
- OKE2017 Challenge – ESWC 2017
- Grand Challenge – DEBS 2017
- QALD-8 Challenge – ISWC 2017
- HOBBIT Link Discovery Task at OAEI 2017 – OM 2017, ISWC 2017
- HOBBIT Link Discovery Task at OAEI 2017.5 – OM 2017.5, ISWC 2018