An Evaluation of Software Frequency Sketches

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Sketches enable maintaining statistics about very large streams of data in a memory frugal manner. This work presents a detailed evaluation of software implementations of several popular sketching solutions, as well as recently proposed optimizations. We compare these solutions in terms of computational speed, memory consumption, and several approximation error metrics. Overall, we find that a simple hashing based solution employed with the Nitro sampling technique [23] gives the best trade-off between memory, error and speed. Our findings also include some novel insights about how to best combine sampling with Counting Cuckoo filters depending on the application.

Original languageEnglish
Title of host publicationDEBS 2024 - Proceedings of the 18th ACM International Conference on Distributed and Event-Based Systems
Pages18-29
Number of pages12
ISBN (Electronic)9798400704437
DOIs
StatePublished - 24 Jun 2024
Externally publishedYes
Event18th ACM International Conference on Distributed and Event-Based Systems, DEBS 2024 - Villeurbanne, France
Duration: 25 Jun 202428 Jun 2024

Publication series

NameDEBS 2024 - Proceedings of the 18th ACM International Conference on Distributed and Event-Based Systems

Conference

Conference18th ACM International Conference on Distributed and Event-Based Systems, DEBS 2024
Country/TerritoryFrance
CityVilleurbanne
Period25/06/2428/06/24

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Hardware and Architecture
  • Software
  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'An Evaluation of Software Frequency Sketches'. Together they form a unique fingerprint.

Cite this