
BM bench - BM Benchmark Suite
(c) Marco Vieth, 2002
http://www.benchmarko.de

Version: 0.50
Date:    25.01.2003

Documentation:
http://www.benchmarko.de/software/bmbench/


Purpose / Description:

BMbench is a collection of simple benchmarks in different programming languages.
It is a synthetic benchmark which means that it does not represent real workload.
Concerning the tests, it allows to compare the performance of different languages,
different implementations of the same language and maybe
the same language on different operating systems.


- The benchmark consists of up to 6 simple computations/algorithms (n = 1000000):
  0: (sum of 1..n) mod 65536  (small integer; 16 bit, if available)
  1: (sum of 1..n) mod 65536  (machine type integer; 32 bit preferred)
  2: (sum of 1..n) mod 65536  (floating point; 64 bit double preferred)
  3: Sieve of Eratosthenes: Number of primes below n/2 (bit array preferred; even numbers also stored)
  4: n-th pseudo random number from generator by Raj Jain
  5: (n=n/500): n over n/2 mod 65536 (Pascal's triangle)

- All benchmarks are programmed in the "best" known way which means:
  - They use the same (optimized) algorithm
  - They are performant (hopefully)
    (Since I do not know all the programming languages very well, there may be some optimizations,
     if you find some, please send me a note!)
  - They should be robust to optimizations (except for loop unrolling)
    - results are used and checked after execution
    - number of loops not a constant
    - loop unrolling should not be used

- It is implemented self-measuring:
  It reports elapsed time reported by functions available in the programming language.

- It is implemented self-calibrating:
  1. For every benchmark test the workload (number of loops) is doubled until the elapsed time
  is greater than 1001 ms (1 ms more than one second because some timing functons have a
  accuracy of 1 second only).
  2. Then the numer of loops is estimated so that the elapsed time will be greater than 10000 ms.
  3. The estimated elapsed time for 10 loops is reported as result.


Please report any bugs!
Any comments are welcome to mail@benchmarko.de


---

Files in this package:

Status: development status for every benchmark test, +=ok, -=problems, .=not implemented)
Type: main data types used:
       ? = unknown
       T = Bit
       B = Byte
       S = short (16 bit)
       I = integer (32 bit)
       L = long integer (any number of bits)
       D = double (e.g. 64 bit)


File              Status  Type    Description
00readme.txt                      this readme
00results1.html                   Benchmark results (HTML)
00results1.xls                    Benchmark results (Excel)
00results1_log_linux1.txt         Benchmark measurement log (Linux)
bmbench1.abap     .+++++  ?IDTII  ABAP/4 for SAP R/3 4.x
bmbench1.awk      ++++++  DDDDDD  AWK for gawk
bmbench1.bas      --+...  ??????  BASIC for Locomotive BASIC or bwbasic (Bywater BASIC Interpreter)
bmbench1.bc       .+....  DDDDDD  BC for bc (arbitrary precision calculator, no timing)
bmbench1.c        ++++++  SIDTII  C for gcc, Microsoft C, Borland C (bcc), ...
bmbench1.f        ++++++  SID?II  Fortran for g77 or f2c
bmbench1.fs       .+....  ??????  Forth for gforth (to do)
bmbench1.html             ??????  HTML page to start JavaScript from browser
bmbench1.java     ++++++  SIDTII  Java
bmbench1.js       ++++++  IIDIII  JavaScript for Browsers, Rhino, NGS (only NGS has integer)
bmbench1.lisp     ++++++  IIDIII  Lisp for clisp
bmbench1.mi       ++++++  SIDTII  Modula-2 for mocka
bmbench1.p        ++++++  SIDTII  Pascal for gpc, p2c
bmbench1.pl       ++++++  IIDIII  Perl for Perl 5
bmbench1.pl4      ++++++  DDDDDD  Perl for old Perl 4 (no Integer available)
bmbench1.py       ++++++  SLDIII  Python for python
bmbench1.st       ++++++  ILDBDI  Smalltalk for gst (I only 30 bit)
bmbench1.tcl      ++++++  IIDIII  Tcl for tclsh
bmbench1_java.html        ??????  HTML page to start Java from browser (as an applet, not used)
bmbench1_sto.bas  --+-..  ??????  BASIC for Star Office 5.2
bmbench1_vba.bas  .-....  ??????  VBA (Visual Basic for Applications, e.g. Excel)
run_bench1.sh                     Shell script to run tests under UNIX (e.g. Linux)
run_bench1_misc.sh                Another shell script
run_bench_browser1.sh             Shell script to run browser tests under UNIX (e.g. Linux)


---

Other languages:
gpp     GNU C++ Compiler
gcj     The GNU Java Compiler
clisp   A Common-Lisp interpreter
m4      GNU m4
mtc     Modula-2 / C Converter
gst     GNU Smalltalk


---
