ODArchive – Creating an archive for structured data from Open Data Portals


Type Research Project

Duration March 1, 2020 - July 21, 2020

https://archiver.ai.wu.ac.at/
  • Information Business IN (Details)

Tags

Press 'enter' for creating the tag
  • Mitlöhner, Johann (Details) Project Head
  • Neumaier, Sebastian (Details) Project Head
  • Polleres, Axel (Details) Project Head
  • Weber, Thomas (Details) Project Head
 

Abstract (English)

We present ODArchive, a large corpus of structured data collected from over 260 Open Data portals worldwide, alongside with curated, integrated metadata. Furthermore we enrich the harvested datasets by heuristic annotations using the type hierarchies in existing Knowledge Graphs. We both (i) present the underlying distributed architecture to scale up regular harvesting and monitoring changes on these portals, and(ii) make the corpus available via different APIs. Moreover, we (iii) analyse the characteristics of tabular data within the corpus. Our APIs can be used to regularly run such analyses or to reproduce experiments from the literature that have worked on static, not publicly available corpora.

Publications

Classification

  • 1105 Computer software (Details)
  • 1109 Information and data processing (Details)
  • 1140 Software engineering (Details)