Skip to main contentSkip to search
Episciences
Open Access Journals
Sign in(new window)
Discrete Mathematics & Theoretical Computer Science logo
Discrete Mathematics & Theoretical Computer Science
Discrete Mathematics & Theoretical Computer Science logo
Discrete Mathematics & Theoretical Computer Science
Sign in(new window)
Articles & Issues
All articlesAll accepted articlesAll volumesLast volumeSectionsSpecial issuesAuthors
About
The journalIndexing
Boards
Publish
For authorsEthical charter
Submit
Discrete Mathematics & Theoretical Computer Science logo
Contact
|
Credits
eISSN 1365-8050
|
RSS
|
Atom
Episciences
Documentation
|
Acknowledgements
|
Publishing policy
Accessibility: non-compliant
|
Legal mentions
|
Privacy statement
|
Terms of use
  1. Home > Articles & Issues >
  2. Articles >
  3. Data Streams as Rand ...
Conference paper

Data Streams as Random Permutations: the Distinct Element Problem

Ahmed Helmi (1), Jérémie Lumbroso (2) (3), Conrado Martínez (1), Alfredo Viola (4)
(1) Departament Llenguatges i Sistemes Informatics,
(2) Algorithmes, Programmes et Résolution
(3) Algorithms
(4) Instituto de Computacion [Montevideo]
Download article
Open on HAL
Imported on
January 31, 2017
Published on
December 31, 2011
Last modified on
March 31, 2025
Volume
DMTCS Proceedings vol. AQ, 23rd Intern. Meeting on Probabilistic, Combinatorial, and Asymptotic Methods for the Analysis of Algorithms (AofA'12)
Proceedings
DOI
10.46298/dmtcs.3002
License
https://about.hal.science/hal-authorisation-v1
Indicators
746
Views
927
Downloads

Data Streams as Random Permutations: the Distinct Element Problem

Ahmed Helmi (1), Jérémie Lumbroso (2) (3), Conrado Martínez (1), Alfredo Viola (4)
(1) Departament Llenguatges i Sistemes Informatics,
(2) Algorithmes, Programmes et Résolution
(3) Algorithms
(4) Instituto de Computacion [Montevideo]
Abstract
In this paper, we show that data streams can sometimes usefully be studied as random permutations. This simple observation allows a wealth of classical and recent results from combinatorics to be recycled, with minimal effort, as estimators for various statistics over data streams. We illustrate this by introducing RECORDINALITY, an algorithm which estimates the number of distinct elements in a stream by counting the number of $k$-records occurring in it. The algorithm has a score of interesting properties, such as providing a random sample of the set underlying the stream. To the best of our knowledge, a modified version of RECORDINALITY is the first cardinality estimation algorithm which, in the random-order model, uses neither sampling nor hashing.
Keywords
  • [INFO.INFO-DS]Computer Science [cs]/Data Structures and Algorithms [cs.DS]
  • [INFO.INFO-DM]Computer Science [cs]/Discrete Mathematics [cs.DM]
  • [MATH.MATH-CO]Mathematics [math]/Combinatorics [math.CO]
  • [INFO.INFO-CG]Computer Science [cs]/Computational Geometry [cs.CG]
  • probabilistic algorithm
  • random permutation
  • random-order model.
  • data stream
Cited by

Source: OpenCitations

  • UltraLogLog: A Practical and More Space-Efficient Alternative to HyperLogLog for Approximate Distinct Counting

    Proceedings of the VLDB Endowment

    Authors : Otmar Ertl ORCID

    Journal reference : Volume 17, 2024, pp. 1655-1668

    DOI : 10.14778/3654621.3654632
  • Regenerative random permutations of integers

    The Annals of Probability

    Authors : Jim Pitman, Wenpin Tang

    Journal reference : Volume 47, 2019, pp.

    DOI : 10.1214/18-aop1286
  • Information theoretic limits of cardinality estimation: Fisher meets Shannon

    Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing

    Authors : Seth Pettie ORCID, Dingyu Wang ORCID

    Journal reference : Volume , 2021, pp. 556-569

    DOI : 10.1145/3406325.3451032
  • Analysis of the Strategy “Hiring Above the $$m$$ m -th Best Candidate”

    Algorithmica

    Authors : Ahmed Helmi ORCID, Conrado Martínez ORCID, Alois Panholzer ORCID

    Journal reference : Volume 70, 2014, pp. 267-300

    DOI : 10.1007/s00453-014-9895-3
Preview
Loading PDF preview...