Group | 3np1 | ack | contrast | dead-global | dot | enigma | fannkuch | fib | loop | mat-mult | multi_comp_unit_b | o_area | o_attributeoffset | o_life | o_lists | o_mutual_recursion | o_stamp | o_tree | sieve | strings | student-gs | student-primes | student-sort | student-tsp |
Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O | Comp +O | Run +O | Comp -O | Run -O |
group1 | 0.226388931274414 | 6.19525599479675, | 0.169044017791748 | RunFAIL, | 0.219380140304565 | 4.13650393486023, | 0.172709941864014 | RunFAIL, | 0.585608005523682 | RunFAIL, | 0.397245168685913 | RunFAIL, | BuildFAIL | | BuildFAIL | | 0.210860967636108 | 2.10191488265991, | 0.169820070266724 | RunFAIL, | 0.743189811706543 | RunFAIL, | 0.397527933120728 | RunFAIL, | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | 0.134164094924927 | 1.23110413551331, | BuildFAIL | | 0.326472043991089 | 3.96686315536499, | 0.230803966522217 | RunFAIL, | 0.171783924102783 | RunFAIL, | 0.149091958999634 | RunFAIL, | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | 0.174408912658691 | RunFAIL, | 0.143554925918579 | RunFAIL, | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | 0.233279943466187 | 2.42680096626282, | 0.181118011474609 | RunFAIL, | 0.177470922470093 | 0.93581485748291, | 0.138402938842773 | RunFAIL, | 0.299213171005249 | 10.9960770606995, | 0.20566987991333 | RunFAIL, | 0.184667825698853 | 0.449756860733032, | 0.149088859558105 | 0.471831083297729, | 0.265537977218628 | RunFAIL, | 0.197303056716919 | RunFAIL, | BuildFAIL | | BuildFAIL | |
group2 | BuildFAIL | | 0.13992714881897 | RunINCORRECT, | BuildFAIL | | 0.140226125717163 | RunINCORRECT, | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | 0.138391017913818 | RunFAIL, | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | 0.134896993637085 | 1.63572096824646, | BuildFAIL | | 0.13329005241394 | 1.02031517028809, | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | 0.144788980484009 | RunINCORRECT, | BuildFAIL | | 0.1354079246521 | 0.700273990631104, | BuildFAIL | | 0.154155969619751 | RunFAIL, | BuildFAIL | | 0.142714023590088 | 0.00525403022766113, | BuildFAIL | | 0.151702165603638 | RunFAIL, | BuildFAIL | | BuildFAIL | |
group3 | 0.332449197769165 | 5.1702868938446, | 0.240767002105713 | 5.33793187141418, | 0.219036102294922 | 1.55897188186646, | 0.210789918899536 | 1.5324981212616, | 1.1723358631134 | RunINCORRECT, | 1.5835587978363 | RunINCORRECT, | 0.150560140609741 | 0.224381923675537, | 0.142904996871948 | 0.223546981811523, | 0.341720104217529 | 2.09991598129272, | 0.326726913452148 | 3.42545986175537, | 1.41595911979675 | 2.59320092201233, | 1.28760886192322 | 2.80841398239136, | 0.996989011764526 | RunINCORRECT, | 0.787529945373535 | RunINCORRECT, | 0.167466878890991 | 1.55018305778503, | 0.157182216644287 | 1.56455302238464, | 0.160712003707886 | 0.469506025314331, | 0.144230127334595 | 0.464457035064697, | 0.584554195404053 | 4.74427390098572, | 0.550945997238159 | RunINCORRECT, | BuildFAIL | | BuildFAIL | | 0.569079875946045 | RunFAIL, | 0.886852979660034 | RunFAIL, | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | 0.377238035202026 | 1.1821300983429, | 0.827162981033325 | 1.73077416419983, | 0.200186014175415 | 1.39915585517883, | 0.186907052993774 | 1.40540194511414, | 0.628105878829956 | RunFAIL, | 0.586513996124268 | 10.4149761199951, | BuildFAIL | | BuildFAIL | | 0.416351079940796 | 3.19797611236572, | 0.819775104522705 | 6.46755409240723, | 0.994632959365845 | 1.53217887878418, | 1.20030498504639 | 0.865374088287354, |
group4 | 0.49012303352356 | 2.82701301574707, | 0.27289080619812 | 5.042729139328, | 0.424823045730591 | 2.21271991729736, | 0.28795599937439 | 3.19518089294434, | 1.11156487464905 | RunFAIL, | 0.48165488243103 | RunFAIL, | 0.204402923583984 | RunFAIL, | 0.189505100250244 | RunFAIL, | 0.393181085586548 | 1.12343382835388, | 0.25960898399353 | 3.11875796318054, | 1.25968503952026 | RunFAIL, | 0.542821884155273 | RunFAIL, | 0.755879878997803 | 11.5802178382874, | 0.400136947631836 | 47.0372169017792, | 0.244200944900513 | 2.31291007995605, | 0.188966035842896 | 2.69821691513062, | 0.216455936431885 | 0.319265127182007, | 0.180285215377808 | 0.320325136184692, | 0.787977933883667 | 1.29778504371643, | 0.390072107315063 | 4.90252208709717, | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | 0.401108026504517 | RunFAIL, | BuildFAIL | | 1.34712386131287 | RunFAIL, | 0.501613140106201 | RunFAIL, | 0.920480012893677 | RunFAIL, | 0.503595113754272 | RunFAIL, | 0.342766046524048 | RunFAIL, | 0.242592811584473 | 0.00599384307861328, | 0.675679922103882 | RunFAIL, | 0.389626979827881 | RunFAIL, | 0.651138067245483 | RunFAIL, | 0.316842079162598 | RunFAIL, | 0.422169923782349 | 0.473670959472656, | 0.284919023513794 | 2.17503309249878, | 0.285149097442627 | 0.731995105743408, | 0.220574140548706 | 0.777178764343262, | 0.606897115707397 | 3.10085892677307, | 0.342247009277344 | 15.5096158981323, | 0.28745698928833 | 0.242841958999634, | 0.202735900878906 | 0.250647068023682, | 0.53228497505188 | 1.95458078384399, | 0.308881998062134 | 8.32512092590332, | 0.988219976425171 | RunFAIL, | 0.465597867965698 | RunFAIL, |
group5 | BuildFAIL | | 0.159314870834351 | 5.66500091552734, | BuildFAIL | | 0.182209014892578 | 3.96705794334412, | BuildFAIL | | 0.505393028259277 | 1.68150901794434, | BuildFAIL | | BuildFAIL | | 0.377765893936157 | 1.65171980857849, | 0.17396092414856 | 4.23611688613892, | 1.90060186386108 | 2.02490901947021, | 0.916028022766113 | 4.15697813034058, | BuildFAIL | | 0.335258960723877 | 65.4957449436188, | 0.200005054473877 | 3.01714110374451, | 0.14261794090271 | 4.82163000106812, | 0.17165994644165 | 0.465913057327271, | 0.140491962432861 | 1.36849403381348, | 0.972602844238281 | 6.64086103439331, | 0.317798137664795 | 6.42589402198792, | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | BuildFAIL | | 0.384755849838257 | 1.34795713424683, | 0.180532932281494 | 2.73658990859985, | 0.206373929977417 | 0.725940942764282, | 0.148052930831909 | 1.11033797264099, | 1.09419703483582 | 10.3102731704712, | 0.240493059158325 | RunINCORRECT, | 0.232074975967407 | 0.321814060211182, | 0.165294170379639 | 0.570839166641235, | 0.445546865463257 | 3.58323001861572, | 0.227960109710693 | 13.3729290962219, | BuildFAIL | | 0.448851823806763 | 2.50185585021973, |
group6 | 0.253509044647217 | 4.21001195907593, | 0.155523061752319 | 5.07146000862122, | 0.347162961959839 | 1.07990598678589, | 0.186156988143921 | 2.19236993789673, | 2.69850301742554 | RunFAIL, | 0.300749063491821 | 1.59875893592834, | 0.183172941207886 | 0.197552919387817, | 0.144354820251465 | 0.497112989425659, | 0.326377153396606 | 1.07059097290039, | 0.177735805511475 | 2.9230101108551, | 19.8593940734863 | 1.20584106445312, | 0.335501194000244 | 4.4476900100708, | 1.11017203330994 | RunFAIL, | 0.221199035644531 | 55.1209769248962, | 0.185343980789185 | 0.887923002243042, | 0.146381139755249 | 2.74896883964539, | 0.190438985824585 | 0.31181788444519, | 0.145452976226807 | 0.969353914260864, | 1.08098697662354 | 1.9202561378479, | 0.220407962799072 | 8.90273904800415, | 0.237128973007202 | 0.332750797271729, | 0.172143936157227 | 0.634534120559692, | BuildFAIL | | 0.23658013343811 | 0.575170993804932, | 0.288686990737915 | 0.535335063934326, | 0.191464185714722 | 2.06250095367432, | BuildFAIL | | 0.326177835464478 | 2.02393198013306, | BuildFAIL | | 0.30591893196106 | 2.6291401386261, | 0.269640922546387 | 0.49451208114624, | 0.171015977859497 | 0.775079011917114, | BuildFAIL | | 0.240224838256836 | 0.499181985855103, | 0.365408897399902 | 0.200520992279053, | 0.20360803604126 | 0.426668167114258, | 0.434741020202637 | 1.2437150478363, | 0.181429862976074 | 2.32866191864014, | 0.224951982498169 | 0.650511026382446, | 0.154881000518799 | 0.892858982086182, | 1.00815105438232 | 4.70692801475525, | 0.212975025177002 | 29.3037729263306, | 0.227787017822266 | 0.205747127532959, | 0.155457973480225 | 0.287868022918701, | 0.414928197860718 | 2.32493901252747, | 0.196506977081299 | 12.7256550788879, | 6.81293177604675 | 0.718633890151978, | 0.278877019882202 | 3.19120407104492, |
group7 | 0.355180978775024 | 4.24555706977844, | 0.167652130126953 | 5.13224411010742, | 0.247087955474854 | 1.04141092300415, | 0.169301986694336 | 2.58667707443237, | 0.80168080329895 | 0.630409955978394, | 0.228253126144409 | 1.13231801986694, | 0.166057109832764 | 0.191973924636841, | 0.162317037582397 | 0.643407106399536, | 0.298053979873657 | 0.808350801467896, | 0.166652917861938 | 1.73124408721924, | 2.17432999610901 | RunINCORRECT, | 0.236967802047729 | 2.36130309104919, | 1.02703309059143 | 11.122682094574, | 0.199615001678467 | 29.299968957901, | 0.191308975219727 | 1.16310286521912, | 0.173480033874512 | 3.25663590431213, | 0.169681072235107 | 0.313789129257202, | 0.165627002716064 | 0.925770044326782, | 0.693190813064575 | 0.96649694442749, | 0.192218065261841 | 3.55038285255432, | 0.229440212249756 | 0.30105185508728, | 0.165171146392822 | 0.536531925201416, | 0.605537891387939 | 0.217319011688232, | 0.215854167938232 | 0.581806898117065, | 0.269129991531372 | 0.396358966827393, | 0.175570964813232 | 1.54808402061462, | BuildFAIL | | 0.242147922515869 | 1.21472382545471, | 0.635740041732788 | 1.1704740524292, | 0.219094038009644 | 2.02213215827942, | 0.246068000793457 | 0.47074294090271, | 0.171989917755127 | 0.692390203475952, | 0.479348182678223 | 0.160259962081909, | 0.205551147460938 | 0.407257080078125, | 0.32349705696106 | 0.196794986724854, | 0.191627979278564 | 0.337023019790649, | 0.341203927993774 | 0.413573980331421, | 0.173943042755127 | 1.5138738155365, | 0.1976318359375 | 0.588721990585327, | 0.164185047149658 | 0.753012895584106, | 0.550980091094971 | 3.01733183860779, | 0.17521595954895 | 11.1012530326843, | 0.215310096740723 | 0.163146018981934, | 0.167803049087524 | 0.262731075286865, | 0.497731924057007 | 1.1609058380127, | 0.193629026412964 | 6.03204417228699, | 1.26999378204346 | 0.342394113540649, | 0.210258007049561 | 1.08352589607239, |
staff | 0.326159000396729 | 2.49811005592346, | 0.224406957626343 | 4.32443690299988, | 0.227001905441284 | 1.0414719581604, | 0.206789970397949 | 1.06807208061218, | 0.955711126327515 | 0.61414098739624, | 11.271968126297 | 0.631011009216309, | 0.184587001800537 | 0.198755025863647, | 0.151650905609131 | 0.192572832107544, | 0.248516082763672 | 0.759787082672119, | 0.181449174880981 | 0.76963996887207, | 4.62925982475281 | 1.19281101226807, | 15.0312731266022 | 1.45691800117493, | 2.33974885940552 | 19.7073619365692, | 0.297212839126587 | 8.2856810092926, | 0.182218074798584 | 1.66501712799072, | 0.170694828033447 | 1.77312898635864, | 0.192395925521851 | 0.317718029022217, | 0.17153787612915 | 0.314704895019531, | 0.477935075759888 | 0.510600090026855, | 0.494699001312256 | 0.763850212097168, | 0.26181697845459 | 0.308314800262451, | 0.198610067367554 | 0.309467792510986, | 1.2626850605011 | 0.171568155288696, | 1.51465582847595 | RunINCORRECT, | 0.315030097961426 | 0.404466867446899, | 0.225242853164673 | 0.410781860351562, | 1.96321797370911 | 0.541660070419312, | 1.16918611526489 | 0.584964990615845, | 0.70228910446167 | 1.21679496765137, | 0.323863983154297 | 1.21554017066956, | 0.272964954376221 | 0.455337047576904, | 0.198917865753174 | 0.457203149795532, | 0.983057022094727 | 0.15520715713501, | 0.942439079284668 | 0.162253141403198, | 0.353417873382568 | 0.221139907836914, | 0.238178014755249 | 0.233889102935791, | 0.322904109954834 | 0.372773170471191, | 0.208139896392822 | 0.370214939117432, | 0.209801912307739 | 0.665663003921509, | 0.170542001724243 | 0.646818876266479, | 0.470251083374023 | 0.690114974975586, | 0.239850044250488 | 2.98811817169189, | 0.253177881240845 | 0.175534009933472, | 0.172662973403931 | 0.178958892822266, | 0.357968091964722 | 0.682050228118896, | 0.202987909317017 | 0.629415035247803, | 3.02179288864136 | 0.729016065597534, | 11.9829931259155 | 0.166157007217407, |