Running NIST STS 2.1.1 on NeuG True RNG (2)

NeuG 0.05 was released, and I have a USB memory which says "64GB" capacity. This USB memory is a bit bigger than the one I used, and it can have 500 files of 125MB (=1,000,000,000 bits, that is for 1,000 samples of 1,000,000-bit sequence).

Thus, I tested random numbers generated by FST-01 running NeuG. Generating 500 files took about two weeks, and testing 500 files also took about two weeks.

Thus, I ran the test suite over 500 files, while a single file has 125MB. All parameters are defaults.

Results

  • Tested on 500 files.
No errors 325 files
Some errors 175 files
  • Error of propotion of passing sequences
1 failure 141 files
2 failures 23 files
3 failures 1 files
4 failures 1 files
  • Error of uniformity of p-values
1 failure 11 files

Errors

Here is the detail of errors:

004:        106 105  95  96 109 109  98  84  98 100  0.809249    977/1000 *  NonOverlappingTemplate
004:        129  99 113  96 100  79  95  91  96 102  0.068145    979/1000 *  OverlappingTemplate
006:        110 101  95  94  92  99 114 112 108  75  0.183547    978/1000 *  NonOverlappingTemplate
007:        115 102  91 101  99 104 114 101  89  84  0.435430    979/1000 *  FFT
008:        103  97  98  99  95 104  98  98 104 104  0.999340    979/1000 *  NonOverlappingTemplate
008:        106 107 106  95 102  99  96  97  95  97  0.989786    977/1000 *  NonOverlappingTemplate
010:        126  93  85 104 109 126  71  77 107 102  0.000247    979/1000 *  NonOverlappingTemplate
012:        113 117  87  74  91 113 107  84  97 117  0.010383    979/1000 *  OverlappingTemplate
015:        106 102 107  92 101  93  92  84 107 116  0.506194    979/1000 *  NonOverlappingTemplate
020:        106 106 110  86  86  79 129  96  98 104  0.026768    978/1000 *  NonOverlappingTemplate
024:         98 104 102  81  97 119  93 110  86 110  0.213309    979/1000 *  NonOverlappingTemplate
025:        116  90 105 115 100 102  85  98 110  79  0.129620    977/1000 *  Frequency
025:        108  90 117 101 105 106  95  97  96  85  0.544254    979/1000 *  CumulativeSums
025:        118  90 101 105  95 104  97  99 107  84  0.528111    979/1000 *  CumulativeSums
025:        104 104  96 105  91  96 102 101 101 100  0.994720    978/1000 *  NonOverlappingTemplate
026:        105 102 107  83  94 109  96 106  98 100  0.798139    979/1000 *  NonOverlappingTemplate
029:        106  71 110  90 101  95 105 117 103 102  0.112047    978/1000 *  NonOverlappingTemplate
029:         70  61  63  71  72  65  75  53  64  55  0.580373    631/649  *  RandomExcursions
030:        106  93  91  97 112  96 105 104 106  90  0.823725    978/1000 *  NonOverlappingTemplate
030:        122  89 100  95  96  98 107 116  79  98  0.122325    979/1000 *  NonOverlappingTemplate
032:        117  95 102 102  81  95  84 120 122  82  0.009810    976/1000 *  NonOverlappingTemplate
037:        115 103  96 102  89 103  97  99 102  94  0.887645    977/1000 *  NonOverlappingTemplate
037:        103 107  96 108  95  96  99 101  97  98  0.992381    979/1000 *  NonOverlappingTemplate
040:        115 108  84 103 111  97  79 108  97  98  0.212184    978/1000 *  NonOverlappingTemplate
042:        103 106  94 105  92 104  83 120  80 113  0.107512    978/1000 *  NonOverlappingTemplate
043:        110  76 105 108 112  82  99  92 111 105  0.107512    979/1000 *  NonOverlappingTemplate
052:        101 118  73 105  95  93 116 104  97  98  0.109435    978/1000 *  NonOverlappingTemplate
064:         69  58  60  66  56  63  63  63  58  72  0.919698    609/628  *  RandomExcursions
065:        116 102 108  87  96 128  86  90  95  92  0.052275    979/1000 *  NonOverlappingTemplate
067:        105 107  98 114 103  95  79  91 115  93  0.272977    979/1000 *  NonOverlappingTemplate
075:         74  42  53  64  61  61  78  61  60  60  0.100837    597/614  *  RandomExcursionsVariant
077:        102  99 100 106  95 105  88 104 108  93  0.933472    978/1000 *  NonOverlappingTemplate
078:        117  94  93 115  96  79 106 103  96 101  0.263572    976/1000 *  NonOverlappingTemplate
078:        114  93 116  96 120  93 109  95  79  85  0.043087    979/1000 *  Serial
081:        109  98  95 115 109  78  97 102  90 107  0.302657    979/1000 *  NonOverlappingTemplate
082:         94  94 108  98  98  95 107  98  96 112  0.922855    978/1000 *  NonOverlappingTemplate
085:        115 107 101  89 113 103 103  83  92  94  0.373625    978/1000 *  NonOverlappingTemplate
086:        139  76 113  98  90  86  96 122  82  98  0.000092 *  981/1000    Universal
087:         97 102 105 111  95 112  83  90 103 102  0.605916    979/1000 *  NonOverlappingTemplate
098:         91  92  99 106 102 105 124  98  97  86  0.353733    979/1000 *  NonOverlappingTemplate
099:         96  85  97 115 106 107  97 119  94  84  0.201189   1000/1000 *  NonOverlappingTemplate
105:        103  94  93  89  97 118 105 106 104  91  0.630872    979/1000 *  NonOverlappingTemplate
106:        108 111 103 104 109  97  78  99  90 101  0.450297    979/1000 *  NonOverlappingTemplate
107:        110 101  82 103 103  93 103  86 104 115  0.402962    976/1000 *  NonOverlappingTemplate
115:        108 113  95 105  89  88  98  98 105 101  0.757790    975/1000 *  NonOverlappingTemplate
120:        106 103 101 119  85  80 103 104 112  87  0.133404    979/1000 *  NonOverlappingTemplate
121:        124 102  98  99 110  99  98  94  88  88  0.339271    978/1000 *  NonOverlappingTemplate
126:        102 100  88 110 101 117  99  93  94  96  0.699313    978/1000 *  NonOverlappingTemplate
132:        107 103 104  99  96  82 106  95 109  99  0.781106    979/1000 *  NonOverlappingTemplate
135:        107  94  91 100 111  94 101  91 102 109  0.842937    979/1000 *  NonOverlappingTemplate
135:        128 101  92  92  93 101 110  98  95  90  0.217857    979/1000 *  OverlappingTemplate
139:        115 109 113  98  90  91  88  97 105  94  0.461612    979/1000 *  NonOverlappingTemplate
140:        107 128 100 100  85 102  92  94  87 105  0.138860    979/1000 *  NonOverlappingTemplate
142:        111 114 101  98  98 102  93 101  91  91  0.796268    979/1000 *  NonOverlappingTemplate
149:        118 101  98  92  89 108  95 101  90 108  0.566688    976/1000 *  NonOverlappingTemplate
150:        142  72  93 120  86  97  89 108 105  88  0.000047 *  985/1000    FFT
157:        118  84  95 102  99 102  99  96 103 102  0.695200    978/1000 *  LinearComplexity
158:        116  91 131 102  84  85  97  92  94 108  0.020831    979/1000 *  NonOverlappingTemplate
161:        120 122  93  72 112  89  99 102  83 108  0.005358    979/1000 *  NonOverlappingTemplate
162:        114 101  93  89 106  98  83 111 110  95  0.399442    976/1000 *  NonOverlappingTemplate
167:        107 109  95 102 100 102 102  90  87 106  0.858002    977/1000 *  NonOverlappingTemplate
167:         81  99 103 112  94  89  90 106 113 113  0.245490   1000/1000 *  NonOverlappingTemplate
169:        140  88  80  90  99 125  88  85  87 118  0.000023 *  992/1000    NonOverlappingTemplate
169:         99  99  75 100 109  97 108  99 114 100  0.368587    978/1000 *  NonOverlappingTemplate
172:         90 100 111 106  97  99  97  97 112  91  0.825505    979/1000 *  NonOverlappingTemplate
174:        111  92 100 103 103 104 106  86  84 111  0.506194    977/1000 *  NonOverlappingTemplate
177:        101 105 107  96 101  79 102 100 107 102  0.749884    979/1000 *  NonOverlappingTemplate
178:        104 102 106  96 109  99  96  78  92 118  0.317565    979/1000 *  NonOverlappingTemplate
178:         64  62  64  62  45  67  60  48  63  69  0.425059    589/604  *  RandomExcursions
180:        133 130  89 123 101 100  76  89  77  82  0.000003 *  986/1000    NonOverlappingTemplate
184:        119  93  95  92 101  95  94 117 106  88  0.326749    975/1000 *  FFT
190:        109  84  93 101 109 107  98 104  97  98  0.788728    978/1000 *  NonOverlappingTemplate
190:        118  95 106 102 105  91 100  97  90  96  0.719747    979/1000 *  NonOverlappingTemplate
191:        109  98  97 101  88  92  94 116  99 106  0.707513    978/1000 *  NonOverlappingTemplate
192:        101 120  90 108 100  99  84 114  99  85  0.189625    979/1000 *  Serial
195:        105  88 100  95 100 113  98  95  98 108  0.867692    978/1000 *  NonOverlappingTemplate
198:        113  79 129  85  99  97 103 101  87 107  0.024028    978/1000 *  FFT
201:         65  79  60  75  56  61  41  64  54  66  0.054292    606/621  *  RandomExcursions
205:         69  66  70  53  59  66  46  72  63  53  0.269027    600/617  *  RandomExcursions
207:        120  95 108  85 121 104  77  93  89 108  0.022452    979/1000 *  NonOverlappingTemplate
207:        106  98 106  99  89  87 101 107  92 115  0.630872    978/1000 *  NonOverlappingTemplate
210:        117 104 115 103  85  96  92  95  94  99  0.431754    979/1000 *  OverlappingTemplate
212:        117  97  97 104  96 102 108  87  96  96  0.731886    979/1000 *  NonOverlappingTemplate
214:        104 100  92 109  90 107 110 115 101  72  0.115387    979/1000 *  NonOverlappingTemplate
226:        107 108  82 101 112 122  84  83 114  87  0.019453    978/1000 *  NonOverlappingTemplate
228:        115  90  82 102  96 115  96  99 119  86  0.100109    977/1000 *  NonOverlappingTemplate
231:        110  98  99  87  97 107  94 111 103  94  0.803720    978/1000 *  NonOverlappingTemplate
232:         78  94  77  81 132 113 113 122  86 104  0.000068 *  989/1000    NonOverlappingTemplate
232:         78  94  76  81 131 114 114 123  85 104  0.000043 *  989/1000    NonOverlappingTemplate
238:        106  96 116  88 113 118  89  95  87  92  0.152044    979/1000 *  NonOverlappingTemplate
239:        121 115  93 100  92  89  95 106  93  96  0.329850    979/1000 *  NonOverlappingTemplate
241:        109 118  93 108 110  81  98  92  98  93  0.275709    979/1000 *  NonOverlappingTemplate
243:        116  85  98 101  84 103 104 102 118  89  0.204439    979/1000 *  NonOverlappingTemplate
244:        120  99  91  95 108  89  96 107 106  89  0.424453    978/1000 *  NonOverlappingTemplate
245:        110  99  88 119  98  96 102  96  97  95  0.657933    979/1000 *  NonOverlappingTemplate
252:        103  87 126 100 110 106  97  84  91  96  0.140453    978/1000 *  NonOverlappingTemplate
253:        105  82  97 104  97 129  95 100  95  96  0.167184    979/1000 *  NonOverlappingTemplate
258:        118  98  97 107  87  79  88 109 100 117  0.088226    979/1000 *  NonOverlappingTemplate
258:         99  95 124 101  94  88  96 103 105  95  0.476911    976/1000 *  NonOverlappingTemplate
259:        118  86 122  91 100 103  96  97 100  87  0.168112    976/1000 *  LinearComplexity
260:        129  76  96  90  91 118 107  70  97 126  0.000044 *  985/1000    NonOverlappingTemplate
261:        100 118 102 104  79 110 110  94  84  99  0.172816    979/1000 *  LongestRun
264:        107 119 101  90  95 116  93 103  90  86  0.245490    979/1000 *  NonOverlappingTemplate
268:        107  80 110 110  89 113  92 101 102  96  0.331408    976/1000 *  NonOverlappingTemplate
270:        113 104  96  95  95  91  92 106 104 104  0.864494    979/1000 *  NonOverlappingTemplate
272:        103  91 101  93 113 105  93 111  91  99  0.753844    979/1000 *  NonOverlappingTemplate
274:        125  87 103  96 100  90 100 104  97  98  0.394195    979/1000 *  NonOverlappingTemplate
277:        107  86 107  78 107 109  93 105 105 103  0.337688    975/1000 *  NonOverlappingTemplate
279:        118 110  94 104  84 100 110  87  94  99  0.320607    978/1000 *  Universal
279:         68  61  53  67  63  67  53  57  66  58  0.837157    598/613  *  RandomExcursionsVariant
281:         96 108 102 116  92 109  89 103 100  85  0.494392    979/1000 *  NonOverlappingTemplate
287:        131 120  91  90  92 103  85 113  80  95  0.003795    978/1000 *  Universal
289:        114  93  81  95 115  93  90 108 115  96  0.158133    979/1000 *  NonOverlappingTemplate
295:         68  55  61  68  51  55  65  57  81  59  0.260548    605/620  *  RandomExcursions
297:         99  90 109 100  93  99 118  95  96 101  0.741918    979/1000 *  NonOverlappingTemplate
297:        113  81  69  94 108  87 102 108 116 122  0.002304    979/1000 *  NonOverlappingTemplate
302:        128  98 114 101  89 101  92  99  82  96  0.087692    978/1000 *  NonOverlappingTemplate
305:        130 112 105 104  82  85 104 103  88  87  0.019721    979/1000 *  NonOverlappingTemplate
317:        100 110  95  94 109  88  94 117  98  95  0.595549    975/1000 *  NonOverlappingTemplate
319:         89 106 135 112 105  74 109  79  76 115  0.000049 *  986/1000    NonOverlappingTemplate
319:        120 104  86  89  99 106 101  95  88 112  0.286836    975/1000 *  NonOverlappingTemplate
320:        107  99 100 106  86 102 111 108  95  86  0.645448    975/1000 *  NonOverlappingTemplate
321:        108 108  94 108  96 100  95  86 104 101  0.849708    979/1000 *  NonOverlappingTemplate
322:        117  97  92 103 120  96  92 105  90  88  0.262249    978/1000 *  NonOverlappingTemplate
325:        103 108 100 115  93  97  82  95  99 108  0.564639    978/1000 *  NonOverlappingTemplate
325:        127  91  99 114 102 102  80 101  87  97  0.068145    979/1000 *  NonOverlappingTemplate
331:        109 109 107 105 104  90 105  82  92  97  0.560545    978/1000 *  Rank
334:        106  97  90 102  98 111  99 103 106  88  0.864494    979/1000 *  NonOverlappingTemplate
337:        128  98  98  94  84  99 102 102 101  94  0.255705    979/1000 *  NonOverlappingTemplate
340:         53  96  57  61  50  81  77  39  61  42  0.000000 *  610/617     RandomExcursionsVariant
341:        110 112 102  96  96 107  85 100  93  99  0.735908    979/1000 *  LinearComplexity
349:        123 105 105 103  89 102  89 101  86  97  0.319084    979/1000 *  NonOverlappingTemplate
350:        119 113  98  89 107  84 109  94  92  95  0.233162    979/1000 *  FFT
355:        133  96 120 112 107  78  93  81  69 111  0.000029 *  989/1000    CumulativeSums
355:        129 121 111  89  81 100  86  95  96  92  0.009333    979/1000 *  NonOverlappingTemplate
356:         89 110 113 109  92 102  94  92 107  92  0.583145    978/1000 *  NonOverlappingTemplate
357:         94  94  91  97 111 105 110 104 102  92  0.841226    978/1000 *  NonOverlappingTemplate
358:        120  84  98  98  96  92 114  96 104  98  0.370262    973/1000 *  NonOverlappingTemplate
360:        137 110  91  99  88 116 106  82  91  80  0.000984    979/1000 *  Universal
362:        124  97  76 108 116  83  99  96  93 108  0.025193    979/1000 *  NonOverlappingTemplate
363:         66  60  66  69  69  68  62  61  60  59  0.986869    622/640  *  RandomExcursions
363:         66  58  64  69  63  57  75  50  59  79  0.300009    624/640  *  RandomExcursionsVariant
365:        116  92  97 109 107  94  91  96  94 104  0.695200    977/1000 *  NonOverlappingTemplate
366:        110  94 101 119  96  99 102  97  92  90  0.645448    978/1000 *  NonOverlappingTemplate
369:        104  97  94  90  89 103  98  97 119 109  0.589341    978/1000 *  NonOverlappingTemplate
371:         95 115  92 113  96  89 107  89 114  90  0.285427    977/1000 *  NonOverlappingTemplate
373:        102 112 100  91 103 114  78 116  86  98  0.131879    979/1000 *  NonOverlappingTemplate
374:        110  95  99 107  81 122  97  86 100 103  0.194813    972/1000 *  NonOverlappingTemplate
375:        115 110  76 103  86 116 101 106  89  98  0.084551    979/1000 *  NonOverlappingTemplate
377:        118 104 111  85  82  92  97 105 106 100  0.246750    979/1000 *  NonOverlappingTemplate
381:        109 107 101  90  96 104  97  96 105  95  0.947308    979/1000 *  NonOverlappingTemplate
383:        117  86  86  99  98 106 103  99  99 107  0.552383    978/1000 *  NonOverlappingTemplate
386:        107  97 104 108 116  93  95  91 101  88  0.643366    979/1000 *  NonOverlappingTemplate
387:        106  99 125 111  78 107  93  85 105  91  0.049346    979/1000 *  NonOverlappingTemplate
390:        106 107 100  97 101  85 110 107  95  92  0.781106    979/1000 *  NonOverlappingTemplate
390:        110  91  93 119  95  97 102 104  88 101  0.544254    977/1000 *  NonOverlappingTemplate
391:         62  59  67  77  57  80  53  60  59  55  0.207019    614/629  *  RandomExcursionsVariant
393:        101 111 109  88 100 111 106  97  88  89  0.556460   1000/1000 *  NonOverlappingTemplate
397:        108  88 105  97  89  98  97 110 116  92  0.538182    977/1000 *  NonOverlappingTemplate
397:        127  96 102  97 109  96  86 101  98  88  0.213309    978/1000 *  NonOverlappingTemplate
397:        108  88 105  97  91  96  97 112 114  92  0.583145    977/1000 *  NonOverlappingTemplate
400:        103 103  94 129 102  92 103  79  98  97  0.113372    977/1000 *  NonOverlappingTemplate
402:        118 101  93 111  99 115  88  88  92  95  0.277082    979/1000 *  NonOverlappingTemplate
402:        101 104 101  92 115  91  83 105 108 100  0.568739    979/1000 *  NonOverlappingTemplate
403:        105 103 109  90  99 104  82 106  87 115  0.361938    979/1000 *  NonOverlappingTemplate
406:        102  95  79 110 102  89 122  95 108  98  0.175691    978/1000 *  FFT
406:         94 109  76 112 101 100  89 112 100 107  0.241741    979/1000 *  NonOverlappingTemplate
407:        128  96 110  85  80  90 107 103 101 100  0.051281    978/1000 *  NonOverlappingTemplate
408:        112  92 114 103  82 107 100  89 102  99  0.426272    979/1000 *  NonOverlappingTemplate
408:         84  49  63  65  65  61  64  64  58  55  0.211497    613/628  *  RandomExcursions
411:         97 128  98  83 102  93 103 103  83 110  0.079051    979/1000 *  NonOverlappingTemplate
411:        127  99 110  91  88 112 110 111  76  76  0.002270    977/1000 *  Universal
412:         97 103  90  80  92 116 102 108 100 112  0.311542    978/1000 *  NonOverlappingTemplate
414:         67  62  60  61  67  48  63  70  50  56  0.547637    588/604  *  RandomExcursions
419:        122  88  93  94 107  98 122  91 106  79  0.034257    977/1000 *  FFT
421:        101  89 105  89 116 106  77 146  80  91  0.000028 *  986/1000    NonOverlappingTemplate
425:         97  96 102  98  99 104  94  89 103 118  0.798139    979/1000 *  NonOverlappingTemplate
431:        123  88  97 104 104 107 101 104  77  95  0.147815    979/1000 *  NonOverlappingTemplate
433:        106  91  99  82  97 117 109 102  94 103  0.465415    979/1000 *  NonOverlappingTemplate
439:         90 112 114  89  92  90 100 109 109  95  0.426272    978/1000 *  NonOverlappingTemplate
440:        103  88  99  92 106 108  82 109 106 107  0.526105    979/1000 *  NonOverlappingTemplate
443:        124  94  91 111  91 102 102  95  99  91  0.342451    978/1000 *  NonOverlappingTemplate
445:         85  99 102 101 102  98 111 105  90 107  0.803720   1000/1000 *  NonOverlappingTemplate
453:        105  97 106 109 100 101 109  97  86  90  0.800005    978/1000 *  Serial
454:        119  99  89 106  99  88 104  99  96 101  0.639202    977/1000 *  NonOverlappingTemplate
457:        114  95 106  91  93 105  86 101 109 100  0.647530    979/1000 *  NonOverlappingTemplate
458:         96 109 124  86  90 100 104  85 104 102  0.196920    979/1000 *  NonOverlappingTemplate
459:         95  95  94 100  98  97 110 110 105  96  0.946308    977/1000 *  NonOverlappingTemplate
460:        122 103  85 106  99  98  98 110  91  88  0.284024    977/1000 *  Universal
461:        126  84 112  86 102 106  91 109 103  81  0.030399    978/1000 *  NonOverlappingTemplate
462:         92 103 104  88 102  93 107 102 103 106  0.921624    979/1000 *  NonOverlappingTemplate
462:        115  95  98 108 114  96  95  91  99  89  0.576961    979/1000 *  NonOverlappingTemplate
463:        108  78 115 100 104  97  93 106  98 101  0.448424    977/1000 *  NonOverlappingTemplate
464:        121  91  86 120 105  94 104  90  97  92  0.134172    978/1000 *  NonOverlappingTemplate
464:        120  93  85 120 105  94 105  90  96  92  0.145326    978/1000 *  NonOverlappingTemplate
466:        115  92  91  98  96 103 101 121  90  93  0.358641    978/1000 *  NonOverlappingTemplate
472:        117  98 123  94 100 100  91  94 100  83  0.179584    979/1000 *  NonOverlappingTemplate
477:        108  89 105  98 111  90 100  93  90 116  0.494392    979/1000 *  NonOverlappingTemplate
478:         77  53  51  73  49  53  58  56  53  83  0.007160    591/606  *  RandomExcursions
485:        107 101  94 100  85 115  93 106 101  98  0.713641    976/1000 *  NonOverlappingTemplate
488:         87 112 106  90  99 101 105 118  99  83  0.282626    979/1000 *  LongestRun
492:        117  97  97 109  98 104  95  86  99  98  0.705466    978/1000 *  OverlappingTemplate
493:        111 112  92  98  92  97  86  94 102 116  0.439122    979/1000 *  NonOverlappingTemplate
494:        129  78 103  94  92 108  89  88 110 109  0.021701    978/1000 *  NonOverlappingTemplate
499:        120 117 106  84 105  76  99  92  94 107  0.043934    978/1000 *  NonOverlappingTemplate

Reference

I tested NeuG 0.04 with NIST STS 2.1.1 in 2012.