Skip to main contentSkip to search
Episciences
Open Access Journals
Sign in(new window)
Discrete Mathematics & Theoretical Computer Science logo
Discrete Mathematics & Theoretical Computer Science
Discrete Mathematics & Theoretical Computer Science logo
Discrete Mathematics & Theoretical Computer Science
Sign in(new window)
Articles & Issues
All articlesAll accepted articlesAll volumesLast volumeSectionsSpecial issuesAuthors
About
The journalIndexing
Boards
Publish
For authorsEthical charter
Submit
Discrete Mathematics & Theoretical Computer Science logo
Contact
|
Credits
eISSN 1365-8050
|
RSS
|
Atom
Episciences
Documentation
|
Acknowledgements
|
Publishing policy
Accessibility: non-compliant
|
Legal mentions
|
Privacy statement
|
Terms of use
  1. Home > Articles & Issues >
  2. Articles >
  3. Order statistics and ...
Conference paper

Order statistics and estimating cardinalities of massive data sets

Frédéric Giroire ORCID (1)
(1) Algorithms
Download article
Open on HAL
Imported on
May 10, 2017
Published on
December 31, 2004
Last modified on
March 31, 2025
Volume 0
DMTCS Proceedings vol. AD, International Conference on Analysis of Algorithms
Proceedings
DOI
10.46298/dmtcs.3353
License
https://about.hal.science/hal-authorisation-v1
Indicators
657
Views
474
Downloads

Order statistics and estimating cardinalities of massive data sets

Frédéric Giroire ORCID (1)
(1) Algorithms
Abstract
We introduce a new class of algorithms to estimate the cardinality of very large multisets using constant memory and doing only one pass on the data. It is based on order statistics rather that on bit patterns in binary representations of numbers. We analyse three families of estimators. They attain a standard error of $\frac{1}{\sqrt{M}}$ using $M$ units of storage, which places them in the same class as the best known algorithms so far. They have a very simple internal loop, which gives them an advantage in term of processing speed. The algorithms are validated on internet traffic traces.
Keywords
  • [INFO.INFO-DS]Computer Science [cs]/Data Structures and Algorithms [cs.DS]
  • [INFO.INFO-DM]Computer Science [cs]/Discrete Mathematics [cs.DM]
  • [MATH.MATH-CO]Mathematics [math]/Combinatorics [math.CO]
  • [INFO.INFO-CG]Computer Science [cs]/Computational Geometry [cs.CG]
  • [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC]
  • cardinality
  • estimates
  • very large multiset
  • traffic analysis
Cited by

Source: OpenCitations

  • Formalization of Randomized Approximation Algorithms for Frequency Moments

    DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)

    Authors : Karayel

    Journal reference : Volume , 2022, pp.

    DOI : 10.4230/lipics.itp.2022.21
  • Counting Flows over Sliding Windows in High Speed Networks

    Lecture notes in computer science

    Authors : Josep Sanjuàs-Cuxart, Pere Barlet-Ros ORCID, Josep Solé-Pareta ORCID

    Journal reference : Volume , 2009, pp. 79-91

    DOI : 10.1007/978-3-642-01399-7_7
  • Composed sketch framework for quantiles and cardinality queries over big data streams

    Proceedings of the ACM Turing 50th Celebration Conference - China

    Authors : Shuzhuang Zhang ORCID, Hao Luo ORCID, Zhigang Wu ORCID, Yi Wang ORCID

    Journal reference : Volume , 2017, pp. 1-10

    DOI : 10.1145/3063955.3063995
  • Cardinality Estimation Using Gumbel Distribution

    DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)

    Authors : Łukasiewicz, Uznański

    Journal reference : Volume , 2020, pp.

    DOI : 10.4230/lipics.esa.2022.76
  • Sliding HyperLogLog: Estimating Cardinality in a Data Stream over a Sliding Window

    Authors : Yousra Chabchoub ORCID, Georges Hebrail

    Journal reference : Volume , 2010, pp. 1297-1303

    DOI : 10.1109/icdmw.2010.18
Preview
Loading PDF preview...