Comparison of results from DM811 exam project

Each submitted program has been run 3 times with different seeds on each of the 24 instances of class "E". The boxplot below represents the distribution of ranks for each algorithm over all instances (ranks are values in [1..3x9]). The lower the rank the better the performance. If the notches of two plots do not overlap, this is 'strong evidence' that the two medians differ (Chambers et al., 1983, p. 62).
Programs submitted but not included in the analysis were not halting when required or attaining results by far worse than those here reported.

The following Table reports the best results for each program.

Group.1 x.10287 x.111085 x.161186 x.171086 x.270886 x.280486 x.290186 x.30983 x.81284 x.90289
E-01.dim 102 144 1 122 58 32 349 0 55 62
E-02.dim 101 152 0 163 86 27 322 0 90 104
E-03.dim 22 25 0 5 0 0 0 0 1 2
E-04.dim 19 27 0 21 0 0 0 0 0 8
E-05.dim 14 63 0 60 7 0 1 0 13 30
E-06.dim 22 77 0 84 7 0 0 0 15 43
E-07.dim 3 39 0 30 2 0 0 0 0 10
E-08.dim 6 21 0 21 0 0 0 0 0 4
E-09.dim 154 159 14 169 110 45 250 0 117 102
E-10.dim 186 138 27 126 101 69 262 0 117 122
E-11.dim 7 24 0 27 0 0 0 0 1 2
E-12.dim 15 34 0 33 4 0 11 0 5 13
E-13.dim 30 78 0 74 1 2 1 0 39 38
E-14.dim 47 106 0 69 13 0 7 0 34 41
E-15.dim 1 18 0 25 0 0 0 0 0 2
E-16.dim 0 17 0 16 0 0 0 0 0 0
E-17.dim 0 0 0 385 0 0 0 0 0 0
E-18.dim 5 49 0 47 0 0 0 0 1 0
E-19.dim 39 120 3 91 32 12 54 0 27 45
E-20.dim 30 0 0 32 8 0 274 0 12 4
E-21.dim 37 71 0 127 6 3 2 0 29 36
E-22.dim 207 1119 39 248 141 80 215 312 232 234
E-23.dim 145 216 39 207 137 0 183 2 84 116
E-24.dim 23 83 0 224 17 0 12 0 82 100

Last modified: Wed Nov 18 13:57:57 CET 2009