Skip to content

Latest commit

 

History

History
452 lines (268 loc) · 10.2 KB

File metadata and controls

452 lines (268 loc) · 10.2 KB

Load Factor Performance Comparison

:doc:`Sorted Containers<index>` uses a segmented-list data structure similar to a B-tree limited to two levels of nodes. As part of the implementation, a load factor is used to determine how many values should be stored in each node. This page compares three load factors on containers with as many as ten of million elements.

No single load factor is universally superior. The best load factor for your purposes will depend on your usage pattern. Originally, :doc:`Sorted Containers<index>` used a load factor of 100 but that changed in release 0.8.5 to 1,000 due to the :ref:`SortedList.__delitem__<SortedList.delitem>` benchmark which was dramatically impacted. Most benchmarks perform slightly better with a load factor of 100 but each is competitive with alternate loads. For an in-depth analysis of the load factor read :doc:`Performance at Scale<performance-scale>`.

Performance of competing implementations are benchmarked against the CPython 3.7 runtime. An :doc:`implementation performance comparison<performance>` is also included with data from popular sorted collections packages.

Because :doc:`Sorted Containers<index>` is pure-Python, its performance also depends directly on the Python runtime. A :doc:`runtime performance comparison<performance-runtime>` is also included with data from popular Python runtimes.

Though these benchmarks exercise only one API repeatedly, an effort has also been made to simulate real-world workloads. The :doc:`simulated workload performance comparison<performance-workload>` contains examples with comparisons to other implementations, load factors, and runtimes.

.. currentmodule:: sortedcontainers

Sorted List

Graphs comparing :doc:`sortedlist` performance.

__init__

Initializing with a list of random numbers using :func:`SortedList.__init__`.

_static/SortedList_load-init.png

add

Randomly adding values using :func:`SortedList.add`.

_static/SortedList_load-add.png

contains

Randomly testing membership using :func:`SortedList.__contains__`.

_static/SortedList_load-contains.png

count

Counting objects at random using :func:`SortedList.count`.

_static/SortedList_load-count.png

__delitem__

Deleting objects at random using :func:`SortedList.__delitem__`.

_static/SortedList_load-delitem.png

__getitem__

Retrieving objects by index using :func:`SortedList.__getitem__`.

_static/SortedList_load-getitem.png

index

Finding the index of an object using :func:`SortedList.index`.

_static/SortedList_load-index.png

iter

Iterating a SortedList using :func:`SortedList.__iter__`.

_static/SortedList_load-iter.png

pop

Removing the last object using :func:`SortedList.pop`.

_static/SortedList_load-pop.png

remove

Remove an object at random using :func:`SortedList.remove`.

_static/SortedList_load-remove.png

update_large

Updating a SortedList with a large iterable using :func:`SortedList.update`.

_static/SortedList_load-update_large.png

update_small

Updating a SortedList with a small iterable using :func:`SortedList.update`.

_static/SortedList_load-update_small.png

Sorted Dict

Graphs comparing :doc:`sorteddict` performance.

__init__

Initializing with a list of pairs of random numbers using :func:`SortedDict.__init__`.

_static/SortedDict_load-init.png

__contains__

Given a key at random, test whether the key is in the dictionary using :func:`SortedDict.__contains__`.

_static/SortedDict_load-contains.png

__getitem__

Given a key at random, retrieve the value using :func:`SortedDict.__getitem__`.

_static/SortedDict_load-getitem.png

__setitem__

Given a key at random, set the value using :func:`SortedDict.__setitem__`.

_static/SortedDict_load-setitem.png

__delitem__

Given a key at random, delete the value using :func:`SortedDict.__delitem__`.

_static/SortedDict_load-delitem.png

iter

Iterate the keys of a SortedDict using :func:`SortedDict.__iter__`.

_static/SortedDict_load-iter.png

setitem_existing

Given an existing key at random, set the value using :func:`SortedDict.__setitem__`.

_static/SortedDict_load-setitem_existing.png

Sorted Set

Graphs comparing :doc:`sortedset` performance.

__init__

Initializing with a list of random numbers using :func:`SortedSet.__init__`.

_static/SortedSet_load-init.png

add

Randomly add values using :func:`SortedSet.add`.

_static/SortedSet_load-add.png

contains

Randomly test membership using :func:`SortedSet.__contains__`.

_static/SortedSet_load-contains.png

difference_large

Set difference using :func:`SortedSet.difference`.

_static/SortedSet_load-difference_large.png

difference_medium

Set difference using :func:`SortedSet.difference`.

_static/SortedSet_load-difference_medium.png

difference_small

Set difference using :func:`SortedSet.difference`.

_static/SortedSet_load-difference_small.png

difference_tiny

Set difference using :func:`SortedSet.difference`.

_static/SortedSet_load-difference_tiny.png

difference_update_large

Set difference using :func:`SortedSet.difference_update`.

_static/SortedSet_load-difference_update_large.png

difference_update_medium

Set difference using :func:`SortedSet.difference_update`.

_static/SortedSet_load-difference_update_medium.png

difference_update_small

Set difference using :func:`SortedSet.difference_update`.

_static/SortedSet_load-difference_update_small.png

difference_update_tiny

Set difference using :func:`SortedSet.difference_update`.

_static/SortedSet_load-difference_update_tiny.png

intersection_large

Set intersection using :func:`SortedSet.intersection`.

_static/SortedSet_load-intersection_large.png

intersection_medium

Set intersection using :func:`SortedSet.intersection`.

_static/SortedSet_load-intersection_medium.png

intersection_small

Set intersection using :func:`SortedSet.intersection`.

_static/SortedSet_load-intersection_small.png

intersection_tiny

Set intersection using :func:`SortedSet.intersection`.

_static/SortedSet_load-intersection_tiny.png

intersection_update_large

Set intersection using :func:`SortedSet.intersection_update`.

_static/SortedSet_load-intersection_update_large.png

intersection_update_medium

Set intersection using :func:`SortedSet.intersection_update`.

_static/SortedSet_load-intersection_update_medium.png

intersection_update_small

Set intersection using :func:`SortedSet.intersection_update`.

_static/SortedSet_load-intersection_update_small.png

intersection_update_tiny

Set intersection using :func:`SortedSet.intersection_update`.

_static/SortedSet_load-intersection_update_tiny.png

iter

Iterating a set using :func:`iter(SortedSet)`.

_static/SortedSet_load-iter.png

pop

Remove the last item in a set using :func:`SortedSet.pop`.

_static/SortedSet_load-pop.png

remove

Remove an item at random using :func:`SortedSet.remove`.

_static/SortedSet_load-remove.png

union_large

Set union using :func:`SortedSet.union`.

_static/SortedSet_load-union_large.png

union_medium

Set union using :func:`SortedSet.union`.

_static/SortedSet_load-union_medium.png

union_small

Set union using :func:`SortedSet.union`.

_static/SortedSet_load-union_small.png

union_tiny

Set union using :func:`SortedSet.union`.

_static/SortedSet_load-union_tiny.png

update_large

Set update using :func:`SortedSet.update`.

_static/SortedSet_load-update_large.png

update_medium

Set update using :func:`SortedSet.update`.

_static/SortedSet_load-update_medium.png

update_small

Set update using :func:`SortedSet.update`.

_static/SortedSet_load-update_small.png

update_tiny

Set update using :func:`SortedSet.update`.

_static/SortedSet_load-update_tiny.png

symmetric_difference_large

Set symmetric-difference using :func:`SortedSet.symmetric_difference`.

_static/SortedSet_load-symmetric_difference_large.png

symmetric_difference_medium

Set symmetric-difference using :func:`SortedSet.symmetric_difference`.

_static/SortedSet_load-symmetric_difference_medium.png

symmetric_difference_small

Set symmetric-difference using :func:`SortedSet.symmetric_difference`.

_static/SortedSet_load-symmetric_difference_small.png

symmetric_difference_tiny

Set symmetric-difference using :func:`SortedSet.symmetric_difference`.

_static/SortedSet_load-symmetric_difference_tiny.png

symm_diff_update_large

Set symmetric-difference using :func:`SortedSet.symmetric_difference_update`.

_static/SortedSet_load-symmetric_difference_update_large.png

symm_diff_update_medium

Set symmetric-difference using :func:`SortedSet.symmetric_difference_update`.

_static/SortedSet_load-symmetric_difference_update_medium.png

symm_diff_update_small

Set symmetric-difference using :func:`SortedSet.symmetric_difference_update`.

_static/SortedSet_load-symmetric_difference_update_small.png

symm_diff_update_tiny

Set symmetric-difference using :func:`SortedSet.symmetric_difference_update`.

_static/SortedSet_load-symmetric_difference_update_tiny.png