NeuG 0.11 was released.
With standalone NeuG device of FST-01, I gathered 500 files of 125MB (=1,000,000,000 bits, that is for 1,000 samples of 1,000,000-bit sequence).
Then, I ran the test suite over 500 files, while a single file has 125MB. All parameters are defaults.
Results
- Tested on 500 files.
| No errors | 349 files |
| Some errors | 151 files |
- Error of propotion of passing sequences
| 1 failure | 115 files |
| 2 failures | 26 files |
| 3 failures | 4 files |
| 4 failures | 1 files |
- Error of uniformity of p-values
| 1 failure | 7 files |
| 2 failures | 1 files |
Errors
Here is the detail of errors:
006: 125 117 95 101 86 110 89 96 86 95 0.068145 978/1000 * NonOverlappingTemplate 010: 112 112 96 103 102 84 98 112 100 81 0.288249 979/1000 * NonOverlappingTemplate 011: 80 69 63 64 62 68 63 49 69 55 0.358128 627/642 * RandomExcursionsVariant 014: 106 94 88 89 112 104 100 103 102 102 0.821937 978/1000 * NonOverlappingTemplate 016: 104 99 98 111 101 86 117 90 88 106 0.429923 979/1000 * NonOverlappingTemplate 019: 108 86 107 84 110 105 84 100 101 115 0.229559 979/1000 * NonOverlappingTemplate 020: 102 75 110 111 102 106 98 98 94 104 0.392456 979/1000 * Runs 022: 67 54 63 62 48 68 65 62 64 68 0.741531 606/621 * RandomExcursionsVariant 025: 113 107 85 111 103 95 104 84 95 103 0.433590 978/1000 * NonOverlappingTemplate 026: 60 65 69 55 57 66 66 60 54 47 0.615953 584/599 * RandomExcursionsVariant 030: 116 105 95 89 94 90 105 102 94 110 0.607993 979/1000 * NonOverlappingTemplate 033: 103 88 102 112 105 109 102 79 96 104 0.452173 977/1000 * NonOverlappingTemplate 033: 115 100 103 106 107 103 81 80 104 101 0.271619 979/1000 * NonOverlappingTemplate 036: 120 99 110 109 107 79 98 90 84 104 0.106246 979/1000 * NonOverlappingTemplate 036: 73 66 42 69 61 65 70 65 61 56 0.250105 613/628 * RandomExcursionsVariant 039: 112 81 97 99 85 98 103 109 115 101 0.304126 976/1000 * NonOverlappingTemplate 048: 107 107 90 93 95 101 91 97 109 110 0.794391 979/1000 * NonOverlappingTemplate 048: 63 67 58 63 59 68 40 67 49 62 0.209514 580/596 * RandomExcursionsVariant 048: 68 74 61 51 57 39 62 61 60 63 0.133599 581/596 * RandomExcursionsVariant 051: 106 97 103 102 104 94 103 106 82 103 0.844641 979/1000 * NonOverlappingTemplate 052: 114 119 95 85 102 95 85 89 111 105 0.150340 979/1000 * NonOverlappingTemplate 053: 68 59 55 66 52 57 66 62 70 58 0.801804 597/613 * RandomExcursions 061: 103 102 90 90 106 97 95 107 105 105 0.922855 977/1000 * Serial 062: 96 101 104 80 116 87 109 111 96 100 0.292519 977/1000 * NonOverlappingTemplate 062: 109 107 100 97 99 98 96 92 108 94 0.954015 978/1000 * NonOverlappingTemplate 064: 118 91 94 87 107 111 101 98 92 101 0.484646 979/1000 * NonOverlappingTemplate 064: 90 83 105 106 110 91 106 110 102 97 0.554420 979/1000 * NonOverlappingTemplate 064: 119 109 119 106 115 94 101 66 88 83 0.001453 978/1000 * NonOverlappingTemplate 064: 105 98 106 84 96 121 92 108 89 101 0.328297 979/1000 * Universal 066: 119 105 104 104 92 89 100 100 95 92 0.645448 979/1000 * NonOverlappingTemplate 069: 132 102 93 89 89 113 106 94 89 93 0.044220 975/1000 * NonOverlappingTemplate 072: 71 45 60 63 60 50 66 89 73 57 0.008389 618/634 * RandomExcursions 082: 114 92 105 92 100 102 106 92 117 80 0.248014 978/1000 * NonOverlappingTemplate 084: 107 107 93 99 116 91 88 96 100 103 0.684890 979/1000 * OverlappingTemplate 095: 109 109 83 95 110 95 101 104 98 96 0.701366 979/1000 * NonOverlappingTemplate 096: 104 100 93 86 88 85 85 121 123 115 0.015065 979/1000 * NonOverlappingTemplate 096: 121 99 94 88 97 99 89 96 111 106 0.413628 978/1000 * NonOverlappingTemplate 100: 123 92 100 82 140 107 89 91 75 101 0.000092 * 987/1000 NonOverlappingTemplate 100: 120 82 82 104 91 96 101 95 109 120 0.053969 979/1000 * NonOverlappingTemplate 101: 100 115 95 110 93 84 91 119 96 97 0.260930 979/1000 * CumulativeSums 105: 128 95 101 102 97 87 98 94 102 96 0.310049 976/1000 * NonOverlappingTemplate 105: 72 65 74 72 56 65 62 61 56 55 0.609047 623/638 * RandomExcursions 109: 105 96 113 90 96 107 92 96 104 101 0.858002 978/1000 * NonOverlappingTemplate 111: 107 99 99 103 88 102 98 104 90 110 0.892036 979/1000 * NonOverlappingTemplate 111: 125 107 110 81 91 100 94 96 99 97 0.172816 979/1000 * Universal 113: 107 93 102 110 93 103 99 101 94 98 0.963497 979/1000 * NonOverlappingTemplate 113: 53 78 59 38 68 61 94 59 39 53 0.000002 * 598/602 RandomExcursions 114: 107 97 96 121 94 107 92 86 98 102 0.467322 977/1000 * NonOverlappingTemplate 125: 125 105 94 88 92 117 107 94 77 101 0.035406 978/1000 * NonOverlappingTemplate 127: 73 136 116 90 108 121 86 88 102 80 0.000035 * 994/1000 NonOverlappingTemplate 129: 73 64 60 61 62 58 49 57 61 57 0.782382 587/602 * RandomExcursionsVariant 131: 115 96 102 110 110 94 98 96 78 101 0.361938 978/1000 * NonOverlappingTemplate 136: 63 57 57 47 68 64 69 63 65 57 0.699986 595/610 * RandomExcursionsVariant 136: 69 58 54 61 64 51 68 66 59 60 0.827105 595/610 * RandomExcursionsVariant 137: 104 108 95 100 72 96 109 108 96 112 0.207730 979/1000 * NonOverlappingTemplate 137: 124 87 106 106 98 104 96 94 91 94 0.345650 979/1000 * NonOverlappingTemplate 138: 112 98 102 109 102 88 111 96 94 88 0.639202 979/1000 * NonOverlappingTemplate 142: 121 110 106 98 106 93 86 79 100 101 0.160805 978/1000 * FFT 146: 102 99 103 94 106 97 104 102 81 112 0.719747 978/1000 * NonOverlappingTemplate 160: 61 75 67 65 59 64 58 57 48 53 0.463829 592/607 * RandomExcursions 164: 122 78 106 114 97 83 81 109 112 98 0.013194 979/1000 * NonOverlappingTemplate 168: 108 101 91 96 107 98 89 91 97 122 0.428095 979/1000 * NonOverlappingTemplate 169: 97 93 89 101 95 95 109 118 104 99 0.686955 979/1000 * NonOverlappingTemplate 170: 63 72 49 59 70 62 61 82 54 52 0.101155 608/624 * RandomExcursions 176: 101 125 63 110 106 101 103 117 108 66 0.000032 * 989/1000 NonOverlappingTemplate 177: 131 113 93 103 97 92 96 84 100 91 0.064015 979/1000 * OverlappingTemplate 178: 107 88 99 99 96 109 113 93 99 97 0.816537 978/1000 * NonOverlappingTemplate 183: 117 105 111 104 92 91 99 94 99 88 0.556460 979/1000 * NonOverlappingTemplate 183: 117 95 107 87 96 104 93 109 112 80 0.192724 978/1000 * NonOverlappingTemplate 185: 115 101 92 104 114 93 88 100 94 99 0.603841 975/1000 * NonOverlappingTemplate 190: 106 98 113 83 104 100 115 99 88 94 0.419021 977/1000 * FFT 194: 101 105 106 105 97 90 99 92 101 104 0.972382 979/1000 * NonOverlappingTemplate 196: 110 93 96 77 105 111 99 101 116 92 0.235589 978/1000 * NonOverlappingTemplate 196: 105 90 107 101 96 110 92 107 97 95 0.884671 1000/1000 * NonOverlappingTemplate 199: 85 113 100 104 123 106 101 102 71 95 0.030197 979/1000 * NonOverlappingTemplate 202: 64 54 71 53 70 62 72 63 59 65 0.709396 618/633 * RandomExcursionsVariant 203: 130 94 96 92 109 92 106 95 101 85 0.106246 979/1000 * NonOverlappingTemplate 204: 72 52 54 76 59 68 60 64 53 65 0.373135 608/623 * RandomExcursions 205: 120 89 93 114 93 92 92 112 102 93 0.249284 979/1000 * ApproximateEntropy 207: 128 124 106 86 91 94 94 94 100 83 0.014051 979/1000 * NonOverlappingTemplate 211: 61 62 68 71 77 60 54 60 66 56 0.627204 620/635 * RandomExcursionsVariant 212: 122 105 105 105 103 102 100 99 92 67 0.044797 979/1000 * Serial 216: 103 83 97 109 112 97 106 96 92 105 0.655854 978/1000 * NonOverlappingTemplate 216: 104 118 86 104 84 106 115 94 95 94 0.233162 979/1000 * NonOverlappingTemplate 217: 111 84 111 85 85 112 107 103 109 93 0.171867 979/1000 * NonOverlappingTemplate 229: 119 92 85 104 96 102 110 93 89 110 0.307077 977/1000 * ApproximateEntropy 230: 135 117 99 118 80 87 110 92 89 73 0.000082 * 986/1000 FFT 238: 112 99 99 87 109 97 91 104 89 113 0.542228 979/1000 * NonOverlappingTemplate 242: 120 97 80 104 90 87 95 119 100 108 0.079538 975/1000 * Universal 244: 121 94 94 96 106 105 104 75 106 99 0.177628 979/1000 * NonOverlappingTemplate 245: 117 109 104 105 86 100 72 102 97 108 0.100109 978/1000 * BlockFrequency 248: 92 117 106 97 100 90 100 105 100 93 0.767582 977/1000 * NonOverlappingTemplate 248: 98 89 91 97 90 126 106 102 99 102 0.322135 978/1000 * NonOverlappingTemplate 249: 101 108 84 103 112 103 104 103 83 99 0.536163 979/1000 * NonOverlappingTemplate 252: 48 80 34 54 59 72 67 60 67 79 0.000564 605/620 * RandomExcursions 253: 118 91 99 94 128 99 95 97 94 85 0.085068 979/1000 * NonOverlappingTemplate 255: 121 101 105 98 84 89 101 110 94 97 0.355364 975/1000 * NonOverlappingTemplate 255: 119 111 105 95 78 105 100 104 90 93 0.209948 978/1000 * NonOverlappingTemplate 262: 113 115 90 102 106 81 92 90 108 103 0.254411 979/1000 * NonOverlappingTemplate 264: 130 93 82 89 115 101 86 92 99 113 0.015065 979/1000 * NonOverlappingTemplate 264: 105 109 99 107 89 97 91 106 99 98 0.906069 979/1000 * NonOverlappingTemplate 265: 105 91 114 91 96 94 113 94 101 101 0.697257 979/1000 * OverlappingTemplate 269: 81 67 55 50 81 52 66 65 52 64 0.031832 618/633 * RandomExcursions 273: 89 97 94 103 93 94 114 109 105 102 0.773405 979/1000 * NonOverlappingTemplate 273: 104 92 108 92 102 99 105 112 96 90 0.836048 978/1000 * NonOverlappingTemplate 273: 66 61 70 54 66 63 66 70 59 65 0.944403 625/640 * RandomExcursionsVariant 279: 102 80 112 105 111 96 119 97 95 83 0.124476 979/1000 * OverlappingTemplate 281: 110 105 99 92 104 107 109 80 90 104 0.482707 978/1000 * LinearComplexity 284: 114 83 116 103 98 90 86 88 117 105 0.088762 978/1000 * NonOverlappingTemplate 285: 97 101 96 94 85 102 104 100 107 114 0.786830 979/1000 * NonOverlappingTemplate 285: 63 48 55 63 57 63 62 63 47 59 0.739918 566/580 * RandomExcursionsVariant 287: 117 87 109 109 91 86 94 113 100 94 0.250558 979/1000 * NonOverlappingTemplate 289: 77 63 65 57 56 57 56 54 44 66 0.220081 580/595 * RandomExcursions 289: 116 118 110 109 93 99 68 99 90 98 0.021999 979/1000 * LinearComplexity 290: 96 120 108 108 87 91 102 90 101 97 0.429923 978/1000 * OverlappingTemplate 292: 118 108 114 94 99 99 95 94 95 84 0.380407 976/1000 * FFT 293: 108 92 104 94 106 87 84 112 111 102 0.428095 978/1000 * NonOverlappingTemplate 307: 109 90 114 80 99 93 104 109 94 108 0.331408 979/1000 * NonOverlappingTemplate 308: 75 101 109 109 97 113 88 104 111 93 0.164425 1000/1000 * NonOverlappingTemplate 308: 105 98 93 87 110 81 110 100 108 108 0.404728 979/1000 * NonOverlappingTemplate 317: 117 104 102 71 90 70 93 126 125 102 0.000059 * 988/1000 NonOverlappingTemplate 317: 87 92 77 86 102 104 101 79 143 129 0.000005 * 991/1000 NonOverlappingTemplate 318: 115 94 96 101 89 101 97 92 104 111 0.729870 979/1000 * NonOverlappingTemplate 323: 92 91 117 102 105 82 93 100 118 100 0.236810 979/1000 * NonOverlappingTemplate 329: 105 76 92 106 98 96 87 99 122 119 0.043368 978/1000 * NonOverlappingTemplate 331: 109 106 78 103 84 103 96 89 104 128 0.033807 977/1000 * NonOverlappingTemplate 332: 113 117 86 94 96 107 96 100 102 89 0.440975 978/1000 * OverlappingTemplate 336: 69 63 55 54 76 46 59 59 57 53 0.268803 574/591 * RandomExcursions 352: 75 60 65 61 71 59 59 71 64 46 0.375448 615/631 * RandomExcursionsVariant 361: 117 94 93 89 110 97 97 104 97 102 0.697257 979/1000 * NonOverlappingTemplate 363: 120 91 99 96 96 100 112 101 90 95 0.550347 979/1000 * NonOverlappingTemplate 363: 82 64 61 59 67 54 64 46 50 59 0.090936 591/606 * RandomExcursions 365: 100 94 111 91 104 87 114 91 109 99 0.552383 979/1000 * CumulativeSums 365: 114 98 106 106 88 87 113 96 99 93 0.514124 979/1000 * Universal 365: 68 47 39 82 47 65 45 57 84 67 0.000028 * 593/601 RandomExcursions 367: 100 105 108 100 93 98 106 85 110 95 0.809249 979/1000 * NonOverlappingTemplate 370: 95 114 114 96 83 94 100 103 100 101 0.566688 1000/1000 * NonOverlappingTemplate 371: 66 76 55 70 52 68 52 62 68 55 0.317614 609/624 * RandomExcursions 374: 111 100 105 78 99 78 116 102 109 102 0.102526 978/1000 * NonOverlappingTemplate 380: 111 98 100 89 98 113 107 106 85 93 0.556460 975/1000 * NonOverlappingTemplate 381: 55 62 55 57 72 60 62 76 63 66 0.627044 612/628 * RandomExcursions 384: 62 58 78 55 74 65 52 52 48 62 0.114264 590/606 * RandomExcursions 387: 77 52 63 49 59 71 52 70 62 65 0.200877 605/620 * RandomExcursionsVariant 388: 94 112 82 94 96 98 106 110 113 95 0.446556 976/1000 * NonOverlappingTemplate 390: 111 98 98 102 100 92 95 91 99 114 0.834308 977/1000 * NonOverlappingTemplate 391: 100 102 103 102 99 110 87 108 95 94 0.903338 979/1000 * NonOverlappingTemplate 392: 107 77 88 99 95 104 112 95 97 126 0.063217 979/1000 * NonOverlappingTemplate 394: 111 107 103 91 96 97 85 87 106 117 0.347257 979/1000 * NonOverlappingTemplate 395: 105 95 88 101 112 100 97 97 99 106 0.915317 977/1000 * NonOverlappingTemplate 401: 100 97 102 96 105 95 115 94 109 87 0.749884 979/1000 * NonOverlappingTemplate 402: 105 63 124 108 123 67 116 85 105 104 0.000004 * 986/1000 NonOverlappingTemplate 404: 110 112 101 86 104 105 105 93 80 104 0.373625 978/1000 * NonOverlappingTemplate 414: 64 56 66 83 79 62 59 43 64 64 0.040602 625/640 * RandomExcursionsVariant 414: 80 63 55 69 67 58 64 59 59 66 0.614356 625/640 * RandomExcursionsVariant 414: 81 61 66 69 58 65 61 63 57 59 0.637119 625/640 * RandomExcursionsVariant 418: 99 109 98 107 104 93 77 101 101 111 0.482707 979/1000 * NonOverlappingTemplate 419: 64 59 66 61 62 52 67 58 47 65 0.724817 585/601 * RandomExcursions 423: 127 87 80 95 106 106 91 111 97 100 0.065639 973/1000 * NonOverlappingTemplate 424: 116 112 90 109 105 93 96 94 117 68 0.016717 978/1000 * NonOverlappingTemplate 424: 82 52 56 55 59 71 50 51 63 64 0.083442 587/603 * RandomExcursions 426: 109 93 96 93 105 102 101 114 98 89 0.792508 978/1000 * NonOverlappingTemplate 430: 91 95 94 116 105 96 100 116 97 90 0.530120 1000/1000 * NonOverlappingTemplate 437: 130 101 82 81 111 95 103 105 97 95 0.035174 977/1000 * NonOverlappingTemplate 438: 96 107 101 103 74 113 112 98 92 104 0.244236 975/1000 * NonOverlappingTemplate 440: 122 87 83 102 110 101 107 92 116 80 0.033362 979/1000 * NonOverlappingTemplate 446: 101 102 89 111 117 88 107 89 96 100 0.469232 979/1000 * NonOverlappingTemplate 451: 110 90 89 98 112 88 105 92 106 110 0.496351 979/1000 * OverlappingTemplate 452: 62 60 62 62 70 49 70 52 57 74 0.397459 603/618 * RandomExcursions 452: 66 66 50 85 62 61 51 56 53 68 0.063536 603/618 * RandomExcursions 454: 97 104 94 106 90 95 105 108 104 97 0.948298 976/1000 * NonOverlappingTemplate 461: 119 73 84 112 102 93 105 108 93 111 0.034942 979/1000 * NonOverlappingTemplate 461: 60 56 61 76 69 59 60 62 76 55 0.499373 619/634 * RandomExcursions 462: 124 103 83 100 85 104 104 118 92 87 0.050629 979/1000 * NonOverlappingTemplate 464: 68 69 71 66 50 67 51 66 45 68 0.157564 606/621 * RandomExcursionsVariant 464: 70 75 66 64 61 61 70 50 47 57 0.242986 606/621 * RandomExcursionsVariant 468: 77 71 48 61 55 74 63 58 55 70 0.167699 616/632 * RandomExcursionsVariant 468: 59 63 59 67 57 73 61 59 68 66 0.925420 615/632 * RandomExcursionsVariant 469: 110 104 96 105 92 100 98 105 85 105 0.834308 979/1000 * NonOverlappingTemplate 472: 118 98 88 87 94 99 101 97 107 111 0.476911 978/1000 * Universal 482: 117 84 105 102 98 102 101 107 103 81 0.348869 978/1000 * NonOverlappingTemplate 485: 107 88 96 98 99 103 97 119 103 90 0.635037 979/1000 * NonOverlappingTemplate 485: 107 88 96 99 99 102 96 120 104 89 0.566688 979/1000 * NonOverlappingTemplate 487: 74 57 49 62 42 61 76 58 58 56 0.071628 577/593 * RandomExcursionsVariant 489: 102 75 97 104 98 122 114 97 97 94 0.125200 978/1000 * NonOverlappingTemplate 490: 95 117 99 100 98 96 108 101 91 95 0.829047 979/1000 * NonOverlappingTemplate 490: 67 67 65 59 49 60 69 68 48 57 0.432672 594/609 * RandomExcursionsVariant 492: 119 102 98 92 121 95 98 80 107 88 0.092041 979/1000 * NonOverlappingTemplate 492: 99 108 104 108 102 92 93 100 102 92 0.951205 978/1000 * NonOverlappingTemplate 492: 64 58 64 62 77 54 55 72 71 56 0.443156 617/633 * RandomExcursions 493: 68 76 114 98 115 103 110 115 99 102 0.004908 1000/1000 * NonOverlappingTemplate 495: 117 109 114 83 84 95 106 106 91 95 0.156373 979/1000 * FFT 496: 118 97 102 97 104 85 87 102 95 113 0.388990 976/1000 * NonOverlappingTemplate
Reference
I tested NeuG 0.04 with NIST STS 2.1.1 in November 2012. I tested NeuG 0.05 with NIST STS 2.1.1 in February 2013.