Jump to content

MINC/SoftwareDevelopment/Benchmarks

Add links
From Wikibooks, open books for an open world
< MINC | SoftwareDevelopment
This page may need to be reviewed for quality.

A bunch of non scientific tests aiming to do a bit of benchmarking

Predominately this is a bit of a "mine is faster than yours" type of page, but hopefully it might be useful to someone who is trying to ascertain just what system to buy to do MINC stuff. If this is you, as a rule of thumb MINC type processing is more than often I/O bound with multiple file I/O's going on all the time. This means you should buy a motherboard with a fast FSB (Front side bus) instead of just a fast processor and fair chunk of RAM to avoid having to use swap/virtual memory.

The command we use to compute a rough indication of execution time is this: 

time /usr/local/bic/bin/minctracc -clobber -debug -nonlinear -step 2 2 2 \
   /usr/local/bic/share/mni-models/icbm_avg_152_t1_tal_lin.mnc \
   /usr/local/bic/share/mni-models/icbm_avg_152_t1_tal_lin.mnc \
   /tmp/out.xfm

Notes

[edit | edit source]
  • yes I know it is not the best test, but it seems good enough for now
  • yes I know it should make an identity transform and this is something you/we should check

Results

[edit | edit source]
ARMv6 700MHz  BCM2835      128KB cache   512MB RAM  Raspbian 8              88m 13.12s  Raspberry PI1  VF - wall time was 2:07:24 with 70% CPU utilization
Intel 450MHz  Pent II      512KB cache   256MB RAM  Debian Sarge            53m 54.20s  lorax          AJ
Intel 450MHz  Pent III     512KB cache   386MB RAM  Debian Sarge            49m 47.55s  feeble         AJ
MIPS  400MHz, R12000    8MB/32KB cache    28GB RAM  IRIX 6.5.x              28m 12.95s  yorick         AJ
IBM   1.5GHz  G4           512KB cache     1GB RAM  OS X 10.3.9             21m 07.00s  PowerBook G4   LC
AMD   1.2Ghz  Athlon L110  512KB cache     2GB RAM  Ubuntu Koala            19m 34.78s  Gateway LT31   VF - gcc 4.1.2 32 bit
AMD   1.3GHz  Athlon XP    512KB cache     2GB RAM  Debian Sarge            17m 59.26s  audrey         AJ
Intel 1.5GHz  Itanium 2 8MB/256K cache     4GB RAM  Debian Sarge            17m 48.50s  aeneas         JFM - gcc 3.4.4
IBM   2.0GHz  G5(1core)    512KB cache     2GB RAM  OS X 10.4.3             15m 15.35s  mrspc          MD
Intel 1.4GHz  Pent III     512KB cache     4GB RAM  Debian Sarge            15m 24.73s  Dell-1650      JFM
IBM   2.0Ghz  G5(2core)   1024KB cache   2.5GB RAM  OS X 10.4.8             15m 37.30s                 OW
AMD   1.2Ghz  Athlon L110  512KB cache     2GB RAM  Ubuntu Koala            13m 23.87s  Gateway LT31   VF - gcc 4.3.3 64 bit
Intel 1.7GHz  Pent M      2048KB cache  1.25GB RAM  Cygwin under XP         13m 17.27s  T42 Thinkpad   AJ
Intel 1.7GHz  Pent M      2048KB cache  1.25GB RAM  vmware Ubuntu under XP  12m 56.22s  T42 Thinkpad   AJ
Intel 2.8GHz  Pent 4       512KB cache  1.25GB RAM  Ubuntu Hardy            12m 33.51s  Satellite 2450 AZ
Intel 1.5GHz  Celeron M   1024KB cache     1GB RAM  Ubuntu Dapper           12m 31.08s  Aspire 3610    VF
Intel 1.6GHz  Pent M      1024KB cache   512MB RAM  Ubuntu Dapper           12m 11.60s  Satellite M30  VF
AMD   1.5GHz  Athlon XP    512KB cache     1GB RAM  Debian Sarge            12m 06.94s  orsino         MD
Intel 1.6GHz  Pent M      2048KB cache   512MB RAM  Ubuntu Edgy             11m 49.92s  Tecra M3       VF
Intel 1.7GHz  Pent M      2048KB cache  1.25GB RAM  Ubuntu Dapper           11m 39.49s  T42 Thinkpad   AJ
AMD   1.6GHz  Athlon XP    256KB cache     1GB RAM  Ubuntu Edgy             11m 33.11s                 VF
Intel 1.8GHz  Pent M      2048KB cache     2GB RAM  Ubuntu Dapper           11m 33.03s  Qosmio F10     KM
AMD   2.0GHz  Athlon MP    512KB cache     2GB RAM  Debian Sarge            11m 10.65s  angus          KM
AMD   2.0GHz  Athlon MP    512KB cache     2GB RAM  Debian Sarge            10m 46.00s  node0          VF
Intel 1.7GHz  Core Duo    2048KB cache     2GB RAM  Cygwin under XP         10m 39.22s  X60s Thinkpad  MD
Intel 1.5GHz  Itanium 2 8MB/256K cache     4GB RAM  Debian Sarge            10m 47.89s  aeneas,icc -O3 VF - Intel Compiler 9.1.042
AMD   2.1GHz  Athlon MP    512KB cache     2GB RAM  Debian Sarge            10m 15.93s  dromio         MF
Intel 3.0GHz  Xeon        2048KB cache     3GB RAM  Debian Sarge             9m 58.31s  grumpy         AJ
AMD   2.1Ghz  Athlon 64    512KB cache     2GB RAM  Debian Sarge             9m 39.11s  portia         VF
AMD   2.1GHz  Athlon XP    512KB cache     2GB RAM  Debian Sarge             9m 26.84s  gonzalo        VF
AMD   2.0GHz  Opteron 246 1034KB cache     3GB RAM  Debian Sarge             9m 17.63s  banquo         AJ
Intel 1.7GHz  Core Duo    2048KB cache     2GB RAM  Ubuntu Edgy              9m  7.96s  X60s Thinkpad  MD
Intel 1.6Ghz  Xeon E5310  4096KB cache     3GB RAM  Debian Sarge             8m 55.97s  2xQuad Xeon    VF
Intel 1.6GHz  Core2Duo    4096KB cache     3GB RAM  Ubuntu Hardy i386        8m 44.41s  X61 Thinkpad   AZ
Intel 1.8GHz  Pent M      2048KB cache     2GB RAM  Cygwin under XP          8m 28.85s  Qosmio F10     KM
AMD   2.2Ghz  Athlon 64    512KB cache     2GB RAM  Debian Sarge             8m 21.52s  pluto          VF
AMD   2.2Ghz  Athlon MP    512KB cache     2GB RAM  Red Hat Valhalla         8m 21.47s  homer          AG
Intel 3.4GHz  Pent D 945  2048KB cache     3GB RAM  Debian Sarge             8m  3.19s  denney         AJ
Intel 3.4GHz  P4 HT        512KB cache   0.5GB RAM  Debian Sarge             7m 56.77s  owen           AJ
Intel 1.83Ghz Core2Duo    2048KB cache     1GB RAM  Ubuntu Edgy              7m 46.36s  Compaq NX7400  OW
AMD   2.6Ghz  Opteron 252 1024KB cache     8GB RAM  Ubuntu Dapper            7m 44.63s                 JPL
AMD   1.7GHz  Athlon 64X2  256KB cache     1GB RAM  Ubuntu Gutsy             7m 38.28s  Gateway laptop AZ
AMD   2.0GHz  Athlon 64X2  512KB cache     2GB RAM  Debian Sarge             7m 35.39s  newhomer       ACV
Intel 2.13GHz Core2Duo    2048KB cache     2GB RAM  Ubuntu Edgy              6m 31.37s                 VF
Intel 2.13GHz Core2Duo    2048KB cache     3GB RAM  Debian Sarge             6m 30.11s                 AJ
Intel 2.33GHz Core2Duo    2048KB cache     2GB RAM  OS X 10.4.8              6m 18.60s  blork          SM
Intel 2.2GHz  Core2Duo    4096KB cache     2GB RAM  OS X 10.5.0              6m 14.53s  MacBook Pro    JH  - gcc 4.0.1 32bit
Intel 3.20Ghz Xeon        2048KB cache     8GB RAM  Red Hat EL smp           6m  1.37s  ANU - APAC     AJ  - Intel-cc 9.1.047
AMD   2.2Ghz  Opteron 875 1024KB cache    32GB RAM  Red Hat EL AS 4          5m 58.63s  CLUMEQ:krylov  VF  - gcc 3.4.4 64bit
Intel 2.3Ghz  XeonE5345 2x4096KB cache   3.2GB RAM  Ubuntu Feisty            5m 51.48s  ANU - murdoch  AJ  - gcc 4.1.2 32bit
Intel 1.6GHz  Core2Duo    4096KB cache     3GB RAM  Ubuntu Hardy amd64       5m 46.23s  X61 Thinkpad   AZ
Intel 2.4Ghz  Core2Quad   4096KB cache     4GB RAM  Feisty i386 bigiron      5m 35.01s  ANU - ben      AJ  - gcc 4.1.2 32bit
AMD   2.8GHz  Athlon 64X2  512KB cache     4GB RAM  Debian 4.0               5m 24.79s  lorentz        ACV
Intel 2.13GHz Core2Duo    4096KB cache     2GB RAM  Feisty amd64             5m 12.88s                 JH  - gcc 4.1.2 64bit
Intel 1.87GHz QEMU        4096KB cache    10GB RAM  Centos 6                 5m 11.586s nrx3 VM        HEA - gcc 4.4.7 64bit (minctoolkit 0.3.16)
Intel 2.66GHz Core2Duo    4096KB cache     2GB RAM  Debian Etch              5m 04.68s  taylor         MF  - gcc 4.1.2 32bit
Intel 3.16Ghz Core2Duo    6144KB cache     8GB RAM  Ubuntu Hardy i386        4m 54.74s  igns           VF  - AJ's deb for Hardy i386
Intel 2.2GHz  Core2Duo    4096KB cache     2GB RAM  OS X 10.5.2              4m 49.32s  MacBook Pro    ACV - 64bit Minc2
AMD   2.6Ghz  Opteron 2435   6MB cache    16GB RAM  CentOS                   4m 40.63s  TACC           VF  - gcc 4.3.3 64bit (minc 2.0.15, mni_autoreg 0.99.3)
Intel 2.8GHz  Core2Quad 2x6144KB cache     8GB RAM  Debian Etch              4m 37.48s  paris          KM  - gcc 4.1.2 32bit
Intel 2.2GHz  Core2Duo    4096KB cache     2GB RAM  OS X 10.5.2              4m 35.99s  MacBook Pro    ACV - 64bit Minc1
Intel 2.2GHz  Core2Duo    4096KB cache     2GB RAM  OS X 10.5.0              4m 34.93s  MacBook Pro    JH  - gcc 4.0.1 64bit
Intel 2.80Ghz i7-860      8192KB cache     10GB RAM Ubuntu odroid            4m 06.07s  william        KM  - gcc 4.4.7 64bit (minc 2.1.10, mni_autoreg 0.99.6) 
Intel 2.33GHz XeonE5345   4096KB cache    16GB RAM  Ubuntu Gutsy amd64       4m 04.48s  2xQuad Xeon    AZ  - gcc 4.2 64bit
Intel 2.26GHz Core2Duo    3072KB cache     4GB RAM  Ubuntu Jaunty            4m 00.81s  Tecra M10      MF  - gcc 4.3.3 64bit
Intel 2.27GHz XeonL5520   8192KB cache    12GB RAM  CentOS                   3m 54.75s  TACC           VF  - gcc 4.3.3 64bit (minc 2.0.15, mni_autoreg 0.99.3)
Intel 2.33GHz XeonE5410 2x6144KB cache    16GB RAM  Ubuntu Gutsy amd64       3m 49.43s  2xQuad Xeon    VF  - AJ's .deb for amd64
Intel 2.4GHz  Core2Quad 2x4096KB cache     8GB RAM  Ubuntu Gutsy amd64       3m 47.12s                 VF  - AJ's .deb for amd64
Intel 2.6Ghz  Core2Duo  2x6144KB cache     2GB RAM  OS X 10.5.2              3m 46.74s  MacBook Pro    SN  - gcc 4.0.1 64bit (minc 2.0.15, mni_autoreg 0.99.3)
Intel 2.4Ghz  Core2Quad 2x4096KB cache     4GB RAM  Ubuntu Feisty amd64      3m 46.46s  ANU - ben      AJ  - gcc 4.1.2 64bit
Intel 2.6Ghz  XeonE5355 2x4096KB cache    16GB RAM  Ubuntu Gutsy amd64       3m 43.35s  opus           MD  - AJ's .deb for amd64
Intel 2.6Ghz  Core2Duo  2x6144KB cache     2GB RAM  OS X 10.5.2              3m 42.54s  MacBook Pro    SN  - gcc 4.0.1 64bit (minc 1.5.1, mni_autoreg 0.99.3)
Intel 2.8Ghz  XeonE5400 2x6144KB cache     2GB RAM  OS X 10.5.2              3m 34.90s  MacPro-mrspc   ACV - gcc 4.0.1 64bit (minc 2.0.15, mni_autoreg 0.99.3)
Intel 2.8Ghz  XeonE5400 2x6144KB cache    14GB RAM  OS X 10.5.2              3m 34.83s  MacPro-mrspc   ACV - gcc 4.0.1 64bit (minc 2.0.15, mni_autoreg 0.99.3)
Intel 2.6Ghz  Core2Quad   4096KB cache    16GB RAM  Ubuntu Gutsy amd64       3m 31.55s  v8             SM  - gcc 4.2 64bit
Intel 2.8Ghz  XeonE5400 2x6144KB cache    14GB RAM  OS X 10.5.2              3m 30.52s  MacPro-mrspc   ACV - gcc 4.0.1 64bit (minc 1.5.1, mni_autoreg 0.99.3)
Intel 2.8Ghz  XeonE5400 2x6144KB cache     2GB RAM  OS X 10.5.2              3m 30.30s  MacPro-mrspc   ACV - gcc 4.0.1 64bit (minc 1.5.1, mni_autoreg 0.99.3)
Intel 2.66GHz XeonE5430 2x6144KB cache    32GB RAM  Debian Etch amd64        3m 29.99s  Tyan 2xQuad    JFM - gcc 4.1.2 64bit (minc 2.0.15, mni_autoreg 0.99.3)
Intel 2.5Ghz  XeonE5420 2x6144KB cache     8GB RAM  Ubuntu Hardy amd64       3m 27.75s  loki           EG  - AJ's deb for amd64
Intel 3.00GHz XeonE5450 2x6144KB cache     8GB RAM  CentOS                   3m 21.12s  TACC           VF  - gcc 4.3.3 64bit (minc 2.0.15, mni_autoreg 0.99.3)
Intel 2.80GHz Core2Quad 2x6144KB cache     8GB RAM  Debian Lenny (4.1.1-21)  3m 14.35s  paris          KM  - gcc 4.1.2 64bit (minc 2.0.18, mni_autoreg 0.99.3)
Intel 2.80GHz XeonE5462 2x6144KB cache    16GB RAM  CentOS                   3m 12.35s  RQCHP          CL  - gcc 4.1.2 64bit (minc 2.0.15, mni_autoreg 0.99.3) 
Intel 2.80Ghz i7-860      8192KB cache     4GB RAM  Ubuntu 10.04             3m  1.66s  new snug       VF  - gcc 4.4.3 64bit (minc 2.0.18, mni_autoreg 0.99.6) 
Intel 3.33Ghz XeonX5260   6144KB cache     8GB RAM  CentOS                   3m 2.690s  TACC           VF  - gcc 4.3.3 64bit (minc 2.0.15, mni_autoreg 0.99.3)
Intel 2.66Ghz i7-920      8192KB cache     6GB RAM  Ubuntu Karmic amd64      2m 52.18s  ANU - bertie   AJ  - gcc 4.4.1 30GB OCZ Vertex SSD HDD
Intel 3.16Ghz Core2Duo    6144KB cache     8GB RAM  Ubuntu Intrepid amd64    2m 50.41s  new igns       VF  - AJ's deb for Intrepid amd64
Intel 3.33Ghz i5-660      4096KB cache     4GB RAM  Debian 5                 2m 43.92s  vernon         VF  - gcc 4.3.4 64bit (minc 2.0.18, mni_autoreg 0.99.6)
Intel 3.06Ghz i7-950      8192KB cache     6GB RAM  Debian 5                 2m 40.86s  romeo          VF  - gcc 4.3.4 64bit (minc 2.0.18, mni_autoreg 0.99.6)
Intel 3.40Ghz i7-6700     8192 KB cache   16GB RAM  Ubuntu Xenial Xerus      2m 37.48s  KM - angus2    KM    minc-toolkit-1.9.11-20160202 ST1000DM003-1SB102 average-sata
Intel 3.06Ghz i7-950      8192KB cache    12GB RAM  Ubuntu Karmic amd64      2m 31.76s  ANU - harold   AJ  - gcc 4.4.1 30GB OCZ Vertex SSD HDD
Intel 2.67Ghz Xeon X5650 12288KB cache    48GB RAM  Ubuntu Karmic amd64      2m 28.72s  2x six-core    AZ  - AJ's debs for karmic
Intel 4.00Ghz i7-950 (OC) 8192KB cache    12GB RAM  Ubuntu Karmic amd64      2m 02.23s  ANU - harold   AJ  - gcc 4.4.1 30GB OCZ Vertex SSD HDD (Overclocked)
Intel 3.70Ghz E5-1630    10240KB cache    65GB RAM  Ubuntu Trusty amd64      1m 48.79s  CAI - zeep     AJ  - minc-toolkt-itk4 1.9.10 (minctracc 0.99.60)
Apple M1 Max             24+48MB cache    64GB RAM  macOS 12.6.1  arm64      1m 14.97s   Mac Studio    VF  - Rosetta + x86-64 build minc-toolkit-v2  1.9.18
AMD   EPYC 9634            384MB cache   512GB RAM  Ubuntu 20.04  amd64      1m 04.75s   aran          VF  - minc-toolkit-v2 1.9.18 
AMD   3.40Ghz 5950X         64MB cache   128GB RAM  Ubuntu 20.04  amd64         57.97s   gonzalo       VF  - minc-toolkit-v2 1.9.18 
AMD   4.3Ghz  9950X         64Mb cache   128GB RAM  Ubuntu 20.04  amd64         53.6s    alzheimer     VF  - minc-toolkit-v2 1.9.18
Apple M1 Max             24+48MB cache    64GB RAM  macOS 12.6.1  arm64         49.82s   Mac Studio    VF  - Native arm64 build minc-toolkit-v2  1.9.19
Apple M2 Ultra                           192GB RAM  macOS 14.6.1  arm64         39.02s   Mac Studio    VF  - Native arm64 build minc-toolkit-v2  1.9.19

ACV - Alexandre Carmel-Veilleux
AJ  - Andrew Janke
AZ  - Alex Zijdenbos
EG  - Elias Gedamu
HEA - Haz-Edine Assemlal
JFM - JF Malouin
JH  - Jonathan Harlap
JPL - Jason Pygswallyshaw Lerch
KM  - Kelvin Mok
LC  - Louis Collins
MD  - Mishkin Derakhshan
OW  - Oliver Winz
VF  - Vladimir Fonov
SM  - Sebastian Muehlboeck
MF  - Mike Ferreira
SN  - Sridar Narayanan
CL  - Claude Lepage


Feel free to add your own results.

Retrieved from "https://en.wikibooks.org/wiki/MINC/SoftwareDevelopment/Benchmarks"