Results for open benchmarks

Benchmarks Gcc O0 Gcc O1 Gcc O2 Gcc O3 Segmentation Fault Peanut Butter Tortoise Vectorizers Foo
automaton 114 81 75 67 99 (3) 100 (4) 84 97
binrep 78 42 37 36 73 (2) 73 (2) 73 72
fibonacci 1100 683 709 670 862 (2) 1068 (4) 715 730
jacobi 13341731 4454405 4453383 4453383 10987549 (3) 11511837 (4) 7586837 8171485
mandel 6480375 2173100 2173100 1299204 6477411 (4) 6259678 (2) 5615371 6477411
movingedge 1356 753 696 387 1244 (2) 1309 (4) 983 902
multiply 540 10 10 8 152 (1) 152 (1) 150 24
sort 11329 7682 7858 7608 8372 (2) 10974 (4) 7106 8100
sort_insertion 2946 2059 2057 2044 2320 (3) 2913 (4) 1724 2256
tax 182 105 106 87 134 (2) 135 (3) 136 117
trivia 85 32 32 32 43 (3) 49 (4) 41 40

  • Ranking statistics
Rank Segmentation Fault Peanut Butter Tortoise Vectorizers Foo
1st 1 1 8 4
2nd 5 2 0 6
3rd 4 1 0 0
4th 1 7 3 1

  • Inputs for some benchmarks
automaton 7 1 0 1 1 0 0 -1
binrep 23
movingedge 23
multiply 23
tax 2008 1980 938 1 0 1 797 1
trivia 23

Results for hidden benchmarks

Benchmarks Gcc O0 Gcc O1 Gcc O2 Gcc O3 Segmentation Fault Peanut Butter Tortoise Vectorizers Foo
ding_sleek 459233 244426 243006 234357 284752 (2) 407368 (3) 245853 (1) failed-3
ding_sloppy 18930163 322373 320953 320953 failed-4 7957584 (2) 7652586 (1) failed-3
scherer 23579540 21279869 20679859 20279839 failed-4 failed-1 failed-4 failed-3
shen_easy 2339129 1775013 1764719 1728159 failed-3 failed-2 failed-4 1913175 (1)
shen_hard 18811675 10178954 9956374 5811887 failed-3 failed-2 failed-2 failed-3

  • Ranking statistics
Rank Segmentation Fault Peanut Butter Tortoise Vectorizers FooSorted ascending
2nd 1 1 0 0
3rd 0 1 0 0
4th 0 0 0 0
1st 0 0 2 1
failed 4 3 3 4

  • Failure kinds
failed-1 infinite loop at run time
failed-2 segmentation fault at run time
failed-3 internal compiler error
failed-4 wrong output

-- XiaomingGu - 25 Mar 2008

Edit | Attach | Watch | Print version | History: r52 | r27 < r26 < r25 < r24 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r25 - 2008-04-06 - YiChu
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding URCS? Send feedback