Quotation A. Martínez-Prieto, Miguel, E. Cuesta, Carlos, Fernandez Garcia, Javier David, Arias, Mario. 2015. The SOLID Architecture for Real-Time Management of Big Semantic Data. Future Generation Computer Systems 47 62-79.




Big Data management has become a critical task in many application systems, which usually rely on heavyweight batch processes to manage such large amounts of data. However, batch architectures are not an adequate choice for designing real-time systems in which data updates and reads must be satisfied with very low latency. Thus, gathering and consuming high volumes of data at high velocities is an emerging challenge which we specifically address in the scope of innovative scenarios based on semantic data (RDF) management. The Linked Open Data initiative or emergent projects in the Internet of Things are examples of such scenarios. This paper describes a new architecture (referred to as Solid) which separates the complexities of Big Semantic Data storage and indexing from real-time data acquisition and consumption. This decision relies on the use of two optimized datastores which respectively store historical (big) data and run-time data. It ensures efficient volume management and high processing velocity, but adds the need of coordinating both datastores. Solid  proposes a 3-tiered architecture in which each responsibility is specifically addressed. Besides its theoretical description, we also propose and evaluate a Solid  prototype built on top of binary RDF and state-of-the-art triplestores. Our experimental numbers report that Solid  achieves large savings in data storage (it uses up to 5 times less space than the compared triplestores), while provides efficient SPARQL resolution over the Big Semantic Data (in the order of 10-20 ms for the studied queries). These experiments also show that Solid  ensures low-latency operations because data effectively managed in real-time remain small, so do not suffer Big Data issues.


Press 'enter' for creating the tag

Publication's profile

Status of publication Published
Affiliation WU
Type of publication Journal article
Journal Future Generation Computer Systems
Citation Index SCI
Language English
Title The SOLID Architecture for Real-Time Management of Big Semantic Data
Volume 47
Number 0
Year 2015
Page from 62
Page to 79
URL http://dataweb.infor.uva.es/wp-content/uploads/2014/10/paper.pdf


Fernandez Garcia, Javier David (Former researcher)
A. Martínez-Prieto, Miguel
Arias, Mario
E. Cuesta, Carlos
Institute for Data, Process and Knowledge Management (AE Polleres) (Details)
Research areas (ÖSTAT Classification 'Statistik Austria')
1108 Informatics (Details)
1109 Information and data processing (Details)
1122 Artificial intelligence (Details)
5937 Information systems (Details)
Google Scholar: Search