From ebfbff6ee74eb7d7514d0b2910e23d0cd161507f Mon Sep 17 00:00:00 2001 From: Sam T Date: Mon, 26 Aug 2013 22:29:14 +0400 Subject: - Move non-source files to wiki. --- bench/comparison.html | 806 -------------------------------------------------- 1 file changed, 806 deletions(-) delete mode 100644 bench/comparison.html (limited to 'bench') diff --git a/bench/comparison.html b/bench/comparison.html deleted file mode 100644 index 21eb664..0000000 --- a/bench/comparison.html +++ /dev/null @@ -1,806 +0,0 @@ - - - - - criterion report - - - - - - - - -
-
-

criterion performance measurements

- -

overview

- -

want to understand this report?

- -
- -

decode/bencode

- - - - - - - -
- - - - - - - - - - - - - - - - - - - - - -
lower boundestimateupper bound
Mean execution time2.1913578762457916e-42.2023746485893544e-42.2178461803839747e-4
Standard deviation5.087390021730842e-66.651986802446098e-68.691135345202543e-6
- - -

Outlying measurements have moderate - (0.24842165829001153%) - effect on estimated standard deviation.

-
-

decode/AttoBencode

- - - - - - - -
- - - - - - - - - - - - - - - - - - - - - -
lower boundestimateupper bound
Mean execution time2.1027863815878372e-52.107262148550062e-52.114315364848484e-5
Standard deviation1.981558883229316e-72.839206403657813e-74.2609562692315003e-7
- - -

Outlying measurements have slight - (6.578245906170332e-2%) - effect on estimated standard deviation.

-
-

decode/bencoding

- - - - - - - -
- - - - - - - - - - - - - - - - - - - - - -
lower boundestimateupper bound
Mean execution time1.1285232298402671e-51.1319779245501973e-51.1359635992829064e-5
Standard deviation1.5976428601291893e-71.9001800874852365e-72.4380848103138777e-7
- - -

Outlying measurements have slight - (9.445493788287179e-2%) - effect on estimated standard deviation.

-
-

encode/bencode

- - - - - - - -
- - - - - - - - - - - - - - - - - - - - - -
lower boundestimateupper bound
Mean execution time1.420758435926815e-51.4232323237574929e-51.4269101073836334e-5
Standard deviation1.1306503628954913e-71.5396790239973762e-72.13915243650288e-7
- - -

Outlying measurements have no - (9.899999999999937e-3%) - effect on estimated standard deviation.

-
-

encode/AttoBencode

- - - - - - - -
- - - - - - - - - - - - - - - - - - - - - -
lower boundestimateupper bound
Mean execution time1.8734386118201462e-51.8928526961184167e-51.9178231718478266e-5
Standard deviation9.532890358294809e-71.1276286196733355e-61.4385552202681898e-6
- - -

Outlying measurements have severe - (0.5746741170098384%) - effect on estimated standard deviation.

-
-

encode/bencoding

- - - - - - - -
- - - - - - - - - - - - - - - - - - - - - -
lower boundestimateupper bound
Mean execution time8.777046376776623e-68.789018343348018e-68.803841125345378e-6
Standard deviation5.70844942042191e-86.814863149780535e-88.633180524918025e-8
- - -

Outlying measurements have no - (9.90000000000002e-3%) - effect on estimated standard deviation.

-
-

decode+encode/bencode

- - - - - - - -
- - - - - - - - - - - - - - - - - - - - - -
lower boundestimateupper bound
Mean execution time2.35291030544501e-42.3624635545107034e-42.376002061825532e-4
Standard deviation4.4262390276035104e-65.778061713869331e-67.512983453188837e-6
- - -

Outlying measurements have moderate - (0.18057040347385775%) - effect on estimated standard deviation.

-
-

decode+encode/AttoBencode

- - - - - - - -
- - - - - - - - - - - - - - - - - - - - - -
lower boundestimateupper bound
Mean execution time4.2145138058592286e-54.2317605851327665e-54.260514567003532e-5
Standard deviation7.69245502465871e-71.1207852025282644e-61.6961717929373198e-6
- - -

Outlying measurements have moderate - (0.20921890707833474%) - effect on estimated standard deviation.

-
-

decode+encode/bencoding

- - - - - - - -
- - - - - - - - - - - - - - - - - - - - - -
lower boundestimateupper bound
Mean execution time2.1274067293432416e-52.1374382358744627e-52.1507448607817624e-5
Standard deviation4.663108997200853e-75.868909623864882e-77.222357332288777e-7
- - -

Outlying measurements have moderate - (0.21903653075700513%) - effect on estimated standard deviation.

-
- -

understanding this report

- -

In this report, each function benchmarked by criterion is assigned - a section of its own. In each section, we display two charts, each - with an x axis that represents measured execution time. - These charts are active; if you hover your mouse over data points - and annotations, you will see more details.

- -
    -
  • The chart on the left is a - kernel - density estimate (also known as a KDE) of time - measurements. This graphs the probability of any given time - measurement occurring. A spike indicates that a measurement of a - particular time occurred; its height indicates how often that - measurement was repeated.
  • - -
  • The chart on the right is the raw data from which the kernel - density estimate is built. Measurements are displayed on - the y axis in the order in which they occurred.
  • -
- -

Under the charts is a small table displaying the mean and standard - deviation of the measurements. We use a statistical technique - called - the bootstrap - to provide confidence intervals on our estimates of these values. - The bootstrap-derived upper and lower bounds on the mean and - standard deviation let you see how accurate we believe those - estimates to be. (Hover the mouse over the table headers to see - the confidence levels.)

- -

A noisy benchmarking environment can cause some or many - measurements to fall far from the mean. These outlying - measurements can have a significant inflationary effect on the - estimate of the standard deviation. We calculate and display an - estimate of the extent to which the standard deviation has been - inflated by outliers.

- - - -
-
- - - -- cgit v1.2.3