NeuG 0.05 was released, and I have a USB memory which says "64GB" capacity. This USB memory is a bit bigger than the one I used, and it can have 500 files of 125MB (=1,000,000,000 bits, that is for 1,000 samples of 1,000,000-bit sequence).
Thus, I tested random numbers generated by FST-01 running NeuG. Generating 500 files took about two weeks, and testing 500 files also took about two weeks.
Thus, I ran the test suite over 500 files, while a single file has 125MB. All parameters are defaults.
Results
- Tested on 500 files.
No errors | 325 files |
Some errors | 175 files |
- Error of propotion of passing sequences
1 failure | 141 files |
2 failures | 23 files |
3 failures | 1 files |
4 failures | 1 files |
- Error of uniformity of p-values
1 failure | 11 files |
Errors
Here is the detail of errors:
004: 106 105 95 96 109 109 98 84 98 100 0.809249 977/1000 * NonOverlappingTemplate 004: 129 99 113 96 100 79 95 91 96 102 0.068145 979/1000 * OverlappingTemplate 006: 110 101 95 94 92 99 114 112 108 75 0.183547 978/1000 * NonOverlappingTemplate 007: 115 102 91 101 99 104 114 101 89 84 0.435430 979/1000 * FFT 008: 103 97 98 99 95 104 98 98 104 104 0.999340 979/1000 * NonOverlappingTemplate 008: 106 107 106 95 102 99 96 97 95 97 0.989786 977/1000 * NonOverlappingTemplate 010: 126 93 85 104 109 126 71 77 107 102 0.000247 979/1000 * NonOverlappingTemplate 012: 113 117 87 74 91 113 107 84 97 117 0.010383 979/1000 * OverlappingTemplate 015: 106 102 107 92 101 93 92 84 107 116 0.506194 979/1000 * NonOverlappingTemplate 020: 106 106 110 86 86 79 129 96 98 104 0.026768 978/1000 * NonOverlappingTemplate 024: 98 104 102 81 97 119 93 110 86 110 0.213309 979/1000 * NonOverlappingTemplate 025: 116 90 105 115 100 102 85 98 110 79 0.129620 977/1000 * Frequency 025: 108 90 117 101 105 106 95 97 96 85 0.544254 979/1000 * CumulativeSums 025: 118 90 101 105 95 104 97 99 107 84 0.528111 979/1000 * CumulativeSums 025: 104 104 96 105 91 96 102 101 101 100 0.994720 978/1000 * NonOverlappingTemplate 026: 105 102 107 83 94 109 96 106 98 100 0.798139 979/1000 * NonOverlappingTemplate 029: 106 71 110 90 101 95 105 117 103 102 0.112047 978/1000 * NonOverlappingTemplate 029: 70 61 63 71 72 65 75 53 64 55 0.580373 631/649 * RandomExcursions 030: 106 93 91 97 112 96 105 104 106 90 0.823725 978/1000 * NonOverlappingTemplate 030: 122 89 100 95 96 98 107 116 79 98 0.122325 979/1000 * NonOverlappingTemplate 032: 117 95 102 102 81 95 84 120 122 82 0.009810 976/1000 * NonOverlappingTemplate 037: 115 103 96 102 89 103 97 99 102 94 0.887645 977/1000 * NonOverlappingTemplate 037: 103 107 96 108 95 96 99 101 97 98 0.992381 979/1000 * NonOverlappingTemplate 040: 115 108 84 103 111 97 79 108 97 98 0.212184 978/1000 * NonOverlappingTemplate 042: 103 106 94 105 92 104 83 120 80 113 0.107512 978/1000 * NonOverlappingTemplate 043: 110 76 105 108 112 82 99 92 111 105 0.107512 979/1000 * NonOverlappingTemplate 052: 101 118 73 105 95 93 116 104 97 98 0.109435 978/1000 * NonOverlappingTemplate 064: 69 58 60 66 56 63 63 63 58 72 0.919698 609/628 * RandomExcursions 065: 116 102 108 87 96 128 86 90 95 92 0.052275 979/1000 * NonOverlappingTemplate 067: 105 107 98 114 103 95 79 91 115 93 0.272977 979/1000 * NonOverlappingTemplate 075: 74 42 53 64 61 61 78 61 60 60 0.100837 597/614 * RandomExcursionsVariant 077: 102 99 100 106 95 105 88 104 108 93 0.933472 978/1000 * NonOverlappingTemplate 078: 117 94 93 115 96 79 106 103 96 101 0.263572 976/1000 * NonOverlappingTemplate 078: 114 93 116 96 120 93 109 95 79 85 0.043087 979/1000 * Serial 081: 109 98 95 115 109 78 97 102 90 107 0.302657 979/1000 * NonOverlappingTemplate 082: 94 94 108 98 98 95 107 98 96 112 0.922855 978/1000 * NonOverlappingTemplate 085: 115 107 101 89 113 103 103 83 92 94 0.373625 978/1000 * NonOverlappingTemplate 086: 139 76 113 98 90 86 96 122 82 98 0.000092 * 981/1000 Universal 087: 97 102 105 111 95 112 83 90 103 102 0.605916 979/1000 * NonOverlappingTemplate 098: 91 92 99 106 102 105 124 98 97 86 0.353733 979/1000 * NonOverlappingTemplate 099: 96 85 97 115 106 107 97 119 94 84 0.201189 1000/1000 * NonOverlappingTemplate 105: 103 94 93 89 97 118 105 106 104 91 0.630872 979/1000 * NonOverlappingTemplate 106: 108 111 103 104 109 97 78 99 90 101 0.450297 979/1000 * NonOverlappingTemplate 107: 110 101 82 103 103 93 103 86 104 115 0.402962 976/1000 * NonOverlappingTemplate 115: 108 113 95 105 89 88 98 98 105 101 0.757790 975/1000 * NonOverlappingTemplate 120: 106 103 101 119 85 80 103 104 112 87 0.133404 979/1000 * NonOverlappingTemplate 121: 124 102 98 99 110 99 98 94 88 88 0.339271 978/1000 * NonOverlappingTemplate 126: 102 100 88 110 101 117 99 93 94 96 0.699313 978/1000 * NonOverlappingTemplate 132: 107 103 104 99 96 82 106 95 109 99 0.781106 979/1000 * NonOverlappingTemplate 135: 107 94 91 100 111 94 101 91 102 109 0.842937 979/1000 * NonOverlappingTemplate 135: 128 101 92 92 93 101 110 98 95 90 0.217857 979/1000 * OverlappingTemplate 139: 115 109 113 98 90 91 88 97 105 94 0.461612 979/1000 * NonOverlappingTemplate 140: 107 128 100 100 85 102 92 94 87 105 0.138860 979/1000 * NonOverlappingTemplate 142: 111 114 101 98 98 102 93 101 91 91 0.796268 979/1000 * NonOverlappingTemplate 149: 118 101 98 92 89 108 95 101 90 108 0.566688 976/1000 * NonOverlappingTemplate 150: 142 72 93 120 86 97 89 108 105 88 0.000047 * 985/1000 FFT 157: 118 84 95 102 99 102 99 96 103 102 0.695200 978/1000 * LinearComplexity 158: 116 91 131 102 84 85 97 92 94 108 0.020831 979/1000 * NonOverlappingTemplate 161: 120 122 93 72 112 89 99 102 83 108 0.005358 979/1000 * NonOverlappingTemplate 162: 114 101 93 89 106 98 83 111 110 95 0.399442 976/1000 * NonOverlappingTemplate 167: 107 109 95 102 100 102 102 90 87 106 0.858002 977/1000 * NonOverlappingTemplate 167: 81 99 103 112 94 89 90 106 113 113 0.245490 1000/1000 * NonOverlappingTemplate 169: 140 88 80 90 99 125 88 85 87 118 0.000023 * 992/1000 NonOverlappingTemplate 169: 99 99 75 100 109 97 108 99 114 100 0.368587 978/1000 * NonOverlappingTemplate 172: 90 100 111 106 97 99 97 97 112 91 0.825505 979/1000 * NonOverlappingTemplate 174: 111 92 100 103 103 104 106 86 84 111 0.506194 977/1000 * NonOverlappingTemplate 177: 101 105 107 96 101 79 102 100 107 102 0.749884 979/1000 * NonOverlappingTemplate 178: 104 102 106 96 109 99 96 78 92 118 0.317565 979/1000 * NonOverlappingTemplate 178: 64 62 64 62 45 67 60 48 63 69 0.425059 589/604 * RandomExcursions 180: 133 130 89 123 101 100 76 89 77 82 0.000003 * 986/1000 NonOverlappingTemplate 184: 119 93 95 92 101 95 94 117 106 88 0.326749 975/1000 * FFT 190: 109 84 93 101 109 107 98 104 97 98 0.788728 978/1000 * NonOverlappingTemplate 190: 118 95 106 102 105 91 100 97 90 96 0.719747 979/1000 * NonOverlappingTemplate 191: 109 98 97 101 88 92 94 116 99 106 0.707513 978/1000 * NonOverlappingTemplate 192: 101 120 90 108 100 99 84 114 99 85 0.189625 979/1000 * Serial 195: 105 88 100 95 100 113 98 95 98 108 0.867692 978/1000 * NonOverlappingTemplate 198: 113 79 129 85 99 97 103 101 87 107 0.024028 978/1000 * FFT 201: 65 79 60 75 56 61 41 64 54 66 0.054292 606/621 * RandomExcursions 205: 69 66 70 53 59 66 46 72 63 53 0.269027 600/617 * RandomExcursions 207: 120 95 108 85 121 104 77 93 89 108 0.022452 979/1000 * NonOverlappingTemplate 207: 106 98 106 99 89 87 101 107 92 115 0.630872 978/1000 * NonOverlappingTemplate 210: 117 104 115 103 85 96 92 95 94 99 0.431754 979/1000 * OverlappingTemplate 212: 117 97 97 104 96 102 108 87 96 96 0.731886 979/1000 * NonOverlappingTemplate 214: 104 100 92 109 90 107 110 115 101 72 0.115387 979/1000 * NonOverlappingTemplate 226: 107 108 82 101 112 122 84 83 114 87 0.019453 978/1000 * NonOverlappingTemplate 228: 115 90 82 102 96 115 96 99 119 86 0.100109 977/1000 * NonOverlappingTemplate 231: 110 98 99 87 97 107 94 111 103 94 0.803720 978/1000 * NonOverlappingTemplate 232: 78 94 77 81 132 113 113 122 86 104 0.000068 * 989/1000 NonOverlappingTemplate 232: 78 94 76 81 131 114 114 123 85 104 0.000043 * 989/1000 NonOverlappingTemplate 238: 106 96 116 88 113 118 89 95 87 92 0.152044 979/1000 * NonOverlappingTemplate 239: 121 115 93 100 92 89 95 106 93 96 0.329850 979/1000 * NonOverlappingTemplate 241: 109 118 93 108 110 81 98 92 98 93 0.275709 979/1000 * NonOverlappingTemplate 243: 116 85 98 101 84 103 104 102 118 89 0.204439 979/1000 * NonOverlappingTemplate 244: 120 99 91 95 108 89 96 107 106 89 0.424453 978/1000 * NonOverlappingTemplate 245: 110 99 88 119 98 96 102 96 97 95 0.657933 979/1000 * NonOverlappingTemplate 252: 103 87 126 100 110 106 97 84 91 96 0.140453 978/1000 * NonOverlappingTemplate 253: 105 82 97 104 97 129 95 100 95 96 0.167184 979/1000 * NonOverlappingTemplate 258: 118 98 97 107 87 79 88 109 100 117 0.088226 979/1000 * NonOverlappingTemplate 258: 99 95 124 101 94 88 96 103 105 95 0.476911 976/1000 * NonOverlappingTemplate 259: 118 86 122 91 100 103 96 97 100 87 0.168112 976/1000 * LinearComplexity 260: 129 76 96 90 91 118 107 70 97 126 0.000044 * 985/1000 NonOverlappingTemplate 261: 100 118 102 104 79 110 110 94 84 99 0.172816 979/1000 * LongestRun 264: 107 119 101 90 95 116 93 103 90 86 0.245490 979/1000 * NonOverlappingTemplate 268: 107 80 110 110 89 113 92 101 102 96 0.331408 976/1000 * NonOverlappingTemplate 270: 113 104 96 95 95 91 92 106 104 104 0.864494 979/1000 * NonOverlappingTemplate 272: 103 91 101 93 113 105 93 111 91 99 0.753844 979/1000 * NonOverlappingTemplate 274: 125 87 103 96 100 90 100 104 97 98 0.394195 979/1000 * NonOverlappingTemplate 277: 107 86 107 78 107 109 93 105 105 103 0.337688 975/1000 * NonOverlappingTemplate 279: 118 110 94 104 84 100 110 87 94 99 0.320607 978/1000 * Universal 279: 68 61 53 67 63 67 53 57 66 58 0.837157 598/613 * RandomExcursionsVariant 281: 96 108 102 116 92 109 89 103 100 85 0.494392 979/1000 * NonOverlappingTemplate 287: 131 120 91 90 92 103 85 113 80 95 0.003795 978/1000 * Universal 289: 114 93 81 95 115 93 90 108 115 96 0.158133 979/1000 * NonOverlappingTemplate 295: 68 55 61 68 51 55 65 57 81 59 0.260548 605/620 * RandomExcursions 297: 99 90 109 100 93 99 118 95 96 101 0.741918 979/1000 * NonOverlappingTemplate 297: 113 81 69 94 108 87 102 108 116 122 0.002304 979/1000 * NonOverlappingTemplate 302: 128 98 114 101 89 101 92 99 82 96 0.087692 978/1000 * NonOverlappingTemplate 305: 130 112 105 104 82 85 104 103 88 87 0.019721 979/1000 * NonOverlappingTemplate 317: 100 110 95 94 109 88 94 117 98 95 0.595549 975/1000 * NonOverlappingTemplate 319: 89 106 135 112 105 74 109 79 76 115 0.000049 * 986/1000 NonOverlappingTemplate 319: 120 104 86 89 99 106 101 95 88 112 0.286836 975/1000 * NonOverlappingTemplate 320: 107 99 100 106 86 102 111 108 95 86 0.645448 975/1000 * NonOverlappingTemplate 321: 108 108 94 108 96 100 95 86 104 101 0.849708 979/1000 * NonOverlappingTemplate 322: 117 97 92 103 120 96 92 105 90 88 0.262249 978/1000 * NonOverlappingTemplate 325: 103 108 100 115 93 97 82 95 99 108 0.564639 978/1000 * NonOverlappingTemplate 325: 127 91 99 114 102 102 80 101 87 97 0.068145 979/1000 * NonOverlappingTemplate 331: 109 109 107 105 104 90 105 82 92 97 0.560545 978/1000 * Rank 334: 106 97 90 102 98 111 99 103 106 88 0.864494 979/1000 * NonOverlappingTemplate 337: 128 98 98 94 84 99 102 102 101 94 0.255705 979/1000 * NonOverlappingTemplate 340: 53 96 57 61 50 81 77 39 61 42 0.000000 * 610/617 RandomExcursionsVariant 341: 110 112 102 96 96 107 85 100 93 99 0.735908 979/1000 * LinearComplexity 349: 123 105 105 103 89 102 89 101 86 97 0.319084 979/1000 * NonOverlappingTemplate 350: 119 113 98 89 107 84 109 94 92 95 0.233162 979/1000 * FFT 355: 133 96 120 112 107 78 93 81 69 111 0.000029 * 989/1000 CumulativeSums 355: 129 121 111 89 81 100 86 95 96 92 0.009333 979/1000 * NonOverlappingTemplate 356: 89 110 113 109 92 102 94 92 107 92 0.583145 978/1000 * NonOverlappingTemplate 357: 94 94 91 97 111 105 110 104 102 92 0.841226 978/1000 * NonOverlappingTemplate 358: 120 84 98 98 96 92 114 96 104 98 0.370262 973/1000 * NonOverlappingTemplate 360: 137 110 91 99 88 116 106 82 91 80 0.000984 979/1000 * Universal 362: 124 97 76 108 116 83 99 96 93 108 0.025193 979/1000 * NonOverlappingTemplate 363: 66 60 66 69 69 68 62 61 60 59 0.986869 622/640 * RandomExcursions 363: 66 58 64 69 63 57 75 50 59 79 0.300009 624/640 * RandomExcursionsVariant 365: 116 92 97 109 107 94 91 96 94 104 0.695200 977/1000 * NonOverlappingTemplate 366: 110 94 101 119 96 99 102 97 92 90 0.645448 978/1000 * NonOverlappingTemplate 369: 104 97 94 90 89 103 98 97 119 109 0.589341 978/1000 * NonOverlappingTemplate 371: 95 115 92 113 96 89 107 89 114 90 0.285427 977/1000 * NonOverlappingTemplate 373: 102 112 100 91 103 114 78 116 86 98 0.131879 979/1000 * NonOverlappingTemplate 374: 110 95 99 107 81 122 97 86 100 103 0.194813 972/1000 * NonOverlappingTemplate 375: 115 110 76 103 86 116 101 106 89 98 0.084551 979/1000 * NonOverlappingTemplate 377: 118 104 111 85 82 92 97 105 106 100 0.246750 979/1000 * NonOverlappingTemplate 381: 109 107 101 90 96 104 97 96 105 95 0.947308 979/1000 * NonOverlappingTemplate 383: 117 86 86 99 98 106 103 99 99 107 0.552383 978/1000 * NonOverlappingTemplate 386: 107 97 104 108 116 93 95 91 101 88 0.643366 979/1000 * NonOverlappingTemplate 387: 106 99 125 111 78 107 93 85 105 91 0.049346 979/1000 * NonOverlappingTemplate 390: 106 107 100 97 101 85 110 107 95 92 0.781106 979/1000 * NonOverlappingTemplate 390: 110 91 93 119 95 97 102 104 88 101 0.544254 977/1000 * NonOverlappingTemplate 391: 62 59 67 77 57 80 53 60 59 55 0.207019 614/629 * RandomExcursionsVariant 393: 101 111 109 88 100 111 106 97 88 89 0.556460 1000/1000 * NonOverlappingTemplate 397: 108 88 105 97 89 98 97 110 116 92 0.538182 977/1000 * NonOverlappingTemplate 397: 127 96 102 97 109 96 86 101 98 88 0.213309 978/1000 * NonOverlappingTemplate 397: 108 88 105 97 91 96 97 112 114 92 0.583145 977/1000 * NonOverlappingTemplate 400: 103 103 94 129 102 92 103 79 98 97 0.113372 977/1000 * NonOverlappingTemplate 402: 118 101 93 111 99 115 88 88 92 95 0.277082 979/1000 * NonOverlappingTemplate 402: 101 104 101 92 115 91 83 105 108 100 0.568739 979/1000 * NonOverlappingTemplate 403: 105 103 109 90 99 104 82 106 87 115 0.361938 979/1000 * NonOverlappingTemplate 406: 102 95 79 110 102 89 122 95 108 98 0.175691 978/1000 * FFT 406: 94 109 76 112 101 100 89 112 100 107 0.241741 979/1000 * NonOverlappingTemplate 407: 128 96 110 85 80 90 107 103 101 100 0.051281 978/1000 * NonOverlappingTemplate 408: 112 92 114 103 82 107 100 89 102 99 0.426272 979/1000 * NonOverlappingTemplate 408: 84 49 63 65 65 61 64 64 58 55 0.211497 613/628 * RandomExcursions 411: 97 128 98 83 102 93 103 103 83 110 0.079051 979/1000 * NonOverlappingTemplate 411: 127 99 110 91 88 112 110 111 76 76 0.002270 977/1000 * Universal 412: 97 103 90 80 92 116 102 108 100 112 0.311542 978/1000 * NonOverlappingTemplate 414: 67 62 60 61 67 48 63 70 50 56 0.547637 588/604 * RandomExcursions 419: 122 88 93 94 107 98 122 91 106 79 0.034257 977/1000 * FFT 421: 101 89 105 89 116 106 77 146 80 91 0.000028 * 986/1000 NonOverlappingTemplate 425: 97 96 102 98 99 104 94 89 103 118 0.798139 979/1000 * NonOverlappingTemplate 431: 123 88 97 104 104 107 101 104 77 95 0.147815 979/1000 * NonOverlappingTemplate 433: 106 91 99 82 97 117 109 102 94 103 0.465415 979/1000 * NonOverlappingTemplate 439: 90 112 114 89 92 90 100 109 109 95 0.426272 978/1000 * NonOverlappingTemplate 440: 103 88 99 92 106 108 82 109 106 107 0.526105 979/1000 * NonOverlappingTemplate 443: 124 94 91 111 91 102 102 95 99 91 0.342451 978/1000 * NonOverlappingTemplate 445: 85 99 102 101 102 98 111 105 90 107 0.803720 1000/1000 * NonOverlappingTemplate 453: 105 97 106 109 100 101 109 97 86 90 0.800005 978/1000 * Serial 454: 119 99 89 106 99 88 104 99 96 101 0.639202 977/1000 * NonOverlappingTemplate 457: 114 95 106 91 93 105 86 101 109 100 0.647530 979/1000 * NonOverlappingTemplate 458: 96 109 124 86 90 100 104 85 104 102 0.196920 979/1000 * NonOverlappingTemplate 459: 95 95 94 100 98 97 110 110 105 96 0.946308 977/1000 * NonOverlappingTemplate 460: 122 103 85 106 99 98 98 110 91 88 0.284024 977/1000 * Universal 461: 126 84 112 86 102 106 91 109 103 81 0.030399 978/1000 * NonOverlappingTemplate 462: 92 103 104 88 102 93 107 102 103 106 0.921624 979/1000 * NonOverlappingTemplate 462: 115 95 98 108 114 96 95 91 99 89 0.576961 979/1000 * NonOverlappingTemplate 463: 108 78 115 100 104 97 93 106 98 101 0.448424 977/1000 * NonOverlappingTemplate 464: 121 91 86 120 105 94 104 90 97 92 0.134172 978/1000 * NonOverlappingTemplate 464: 120 93 85 120 105 94 105 90 96 92 0.145326 978/1000 * NonOverlappingTemplate 466: 115 92 91 98 96 103 101 121 90 93 0.358641 978/1000 * NonOverlappingTemplate 472: 117 98 123 94 100 100 91 94 100 83 0.179584 979/1000 * NonOverlappingTemplate 477: 108 89 105 98 111 90 100 93 90 116 0.494392 979/1000 * NonOverlappingTemplate 478: 77 53 51 73 49 53 58 56 53 83 0.007160 591/606 * RandomExcursions 485: 107 101 94 100 85 115 93 106 101 98 0.713641 976/1000 * NonOverlappingTemplate 488: 87 112 106 90 99 101 105 118 99 83 0.282626 979/1000 * LongestRun 492: 117 97 97 109 98 104 95 86 99 98 0.705466 978/1000 * OverlappingTemplate 493: 111 112 92 98 92 97 86 94 102 116 0.439122 979/1000 * NonOverlappingTemplate 494: 129 78 103 94 92 108 89 88 110 109 0.021701 978/1000 * NonOverlappingTemplate 499: 120 117 106 84 105 76 99 92 94 107 0.043934 978/1000 * NonOverlappingTemplate
Reference
I tested NeuG 0.04 with NIST STS 2.1.1 in 2012.