ASQP-RL Demo: Learning Approximation Sets for Exploratory Queries

Susan B. Davidson, Tova Milo, Kathy Razmadze, Gal Zeevi

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We demonstrate the Approximate Selection Query Processing (ASQP-RL) system, which uses Reinforcement Learning to select a subset of a large external dataset to process locally in a notebook during data exploration. Given a query workload over an external database and notebook memory size, the system translates the workload to select-project-join (non-aggregate) queries and finds a subset of each relation such that the data subset - called the approximation set - fits into the notebook memory and maximizes query result quality. The data subset can then be loaded into the notebook, and rapidly queried by the analyst. Our demonstration shows how ASQP-RL can be used during data exploration and achieve comparable results to external queries over the large dataset at significantly reduced query times. It also shows how ASQP-RL can be used for aggregation queries, achieving surprisingly good results compared to state-of-the-art techniques.

Original languageEnglish
Title of host publicationSIGMOD-Companion 2024 - Companion of the 2024 International Conferaence on Management of Data
Pages452-455
Number of pages4
ISBN (Electronic)9798400704222
DOIs
StatePublished - 9 Jun 2024
Event2024 International Conferaence on Management of Data, SIGMOD 2024 - Santiago, Chile
Duration: 9 Jun 202415 Jun 2024

Publication series

NameProceedings of the ACM SIGMOD International Conference on Management of Data

Conference

Conference2024 International Conferaence on Management of Data, SIGMOD 2024
Country/TerritoryChile
CitySantiago
Period9/06/2415/06/24

Keywords

  • exploratory data analysis
  • queries approximation
  • reinforcement learning

All Science Journal Classification (ASJC) codes

  • Software
  • Information Systems

Cite this