Hostname: page-component-7b7567c8c-7pwfn Total loading time: 0 Render date: 2026-11-16T06:25:48.824Z Has data issue: false hasContentIssue false

Managing caching strategies for stream reasoning with reinforcement learning

Published online by Cambridge University Press:  21 September 2020

CARMINE DODARO
Affiliation:
Department of Mathematics and Computer Science, University of Calabria, Italy (e-mail: dodaro@mat.unical.it)
THOMAS EITER
Affiliation:
Institute of Logic and Computation, KBS Group, Vienna University of Technology, Austria, (e-mail: eiter@kr.tuwien.ac.at)
PAUL OGRIS
Affiliation:
Alpen-Adria-Universität, Klagenfurt, Austria, (e-mail: paul.ogris@aau.at, konstantin.schekotihin@aau.at)
KONSTANTIN SCHEKOTIHIN
Affiliation:
Alpen-Adria-Universität, Klagenfurt, Austria, (e-mail: paul.ogris@aau.at, konstantin.schekotihin@aau.at)
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

Efficient decision-making over continuously changing data is essential for many application domains such as cyber-physical systems, industry digitalization, etc. Modern stream reasoning frameworks allow one to model and solve various real-world problems using incremental and continuous evaluation of programs as new data arrives in the stream. Applied techniques use, e.g., Datalog-like materialization or truth maintenance algorithms to avoid costly re-computations, thus ensuring low latency and high throughput of a stream reasoner. However, the expressiveness of existing approaches is quite limited and, e.g., they cannot be used to encode problems with constraints, which often appear in practice. In this paper, we suggest a novel approach that uses the Conflict-Driven Constraint Learning (CDCL) to efficiently update legacy solutions by using intelligent management of learned constraints. In particular, we study the applicability of reinforcement learning to continuously assess the utility of learned constraints computed in previous invocations of the solving algorithm for the current one. Evaluations conducted on real-world reconfiguration problems show that providing a CDCL algorithm with relevant learned constraints from previous iterations results in significant performance improvements of the algorithm in stream reasoning scenarios.

Information

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Author(s), 2020. Published by Cambridge University Press