doc: *.md formatting fixes in the benchmark dir · nodejs/node@f3f5a89

@@ -30,8 +30,6 @@ install.packages("ggplot2")

3030

install.packages("plyr")

3131

```

323233-

[wrk]: https://github.com/wg/wrk

34-3533

## Running benchmarks

36343735

### Running individual benchmarks

@@ -43,7 +41,7 @@ conclusions about the performance.

4341

Individual benchmarks can be executed by simply executing the benchmark script

4442

with node.

454346-

```

44+

```console

4745

$ node benchmark/buffers/buffer-tostring.js

48464947

buffers/buffer-tostring.js n=10000000 len=0 arg=true: 62710590.393305704

@@ -65,7 +63,7 @@ measured in ops/sec (higher is better).**

6563

Furthermore you can specify a subset of the configurations, by setting them in

6664

the process arguments:

676568-

```

66+

```console

6967

$ node benchmark/buffers/buffer-tostring.js len=1024

70687169

buffers/buffer-tostring.js n=10000000 len=1024 arg=true: 3498295.68561504

@@ -78,7 +76,7 @@ Similar to running individual benchmarks, a group of benchmarks can be executed

7876

by using the `run.js` tool. Again this does not provide the statistical

7977

information to make any conclusions.

807881-

```

79+

```console

8280

$ node benchmark/run.js arrays

83818482

arrays/var-int.js

@@ -98,7 +96,7 @@ arrays/zero-int.js n=25 type=Buffer: 90.49906662339653

9896

```

999710098

It is possible to execute more groups by adding extra process arguments.

101-

```

99+

```console

102100

$ node benchmark/run.js arrays buffers

103101

```

104102

@@ -119,13 +117,13 @@ First build two versions of node, one from the master branch (here called

119117120118

The `compare.js` tool will then produce a csv file with the benchmark results.

121119122-

```

120+

```console

123121

$ node benchmark/compare.js --old ./node-master --new ./node-pr-5134 string_decoder > compare-pr-5134.csv

124122

```

125123126124

For analysing the benchmark results use the `compare.R` tool.

127125128-

```

126+

```console

129127

$ cat compare-pr-5134.csv | Rscript benchmark/compare.R

130128131129

improvement significant p.value

@@ -159,16 +157,14 @@ _For the statistically minded, the R script performs an [independent/unpaired

159157

same for both versions. The significant field will show a star if the p-value

160158

is less than `0.05`._

161159162-

[t-test]: https://en.wikipedia.org/wiki/Student%27s_t-test#Equal_or_unequal_sample_sizes.2C_unequal_variances

163-164160

The `compare.R` tool can also produce a box plot by using the `--plot filename`

165161

option. In this case there are 48 different benchmark combinations, thus you

166162

may want to filter the csv file. This can be done while benchmarking using the

167163

`--set` parameter (e.g. `--set encoding=ascii`) or by filtering results

168164

afterwards using tools such as `sed` or `grep`. In the `sed` case be sure to

169165

keep the first line since that contains the header information.

170166171-

```

167+

```console

172168

$ cat compare-pr-5134.csv | sed '1p;/encoding=ascii/!d' | Rscript benchmark/compare.R --plot compare-plot.png

173169174170

improvement significant p.value

@@ -190,15 +186,15 @@ example to analyze the time complexity.

190186

To do this use the `scatter.js` tool, this will run a benchmark multiple times

191187

and generate a csv with the results.

192188193-

```

189+

```console

194190

$ node benchmark/scatter.js benchmark/string_decoder/string-decoder.js > scatter.csv

195191

```

196192197193

After generating the csv, a comparison table can be created using the

198194

`scatter.R` tool. Even more useful it creates an actual scatter plot when using

199195

the `--plot filename` option.

200196201-

```

197+

```console

202198

$ cat scatter.csv | Rscript benchmark/scatter.R --xaxis chunk --category encoding --plot scatter-plot.png --log

203199204200

aggregating variable: inlen

@@ -229,7 +225,7 @@ can be solved by filtering. This can be done while benchmarking using the

229225

afterwards using tools such as `sed` or `grep`. In the `sed` case be

230226

sure to keep the first line since that contains the header information.

231227232-

```

228+

```console

233229

$ cat scatter.csv | sed -E '1p;/([^,]+, ){3}128,/!d' | Rscript benchmark/scatter.R --xaxis chunk --category encoding --plot scatter-plot.png --log

234230235231

chunk encoding mean confidence.interval

@@ -290,3 +286,6 @@ function main(conf) {

290286

bench.end(conf.n);

291287

}

292288

```

289+290+

[wrk]: https://github.com/wg/wrk

291+

[t-test]: https://en.wikipedia.org/wiki/Student%27s_t-test#Equal_or_unequal_sample_sizes.2C_unequal_variances