NeuG 1.0 was released.
With standalone NeuG device of FST-01, I gathered 500 files of 125MB (=1,000,000,000 bits, that is for 1,000 samples of 1,000,000-bit sequence).
Then, I ran the test suite over 500 files, while a single file has 125MB. All parameters are defaults.
Results
- Tested on 500 files.
| No errors | 349 files |
| Some errors | 151 files |
- Error of propotion of passing sequences
| 1 failure | 115 files |
| 2 failures | 23 files |
| 3 failures | 9 files |
- Error of uniformity of p-values
| 1 failure | 5 files |
Errors
Here is the detail of errors:
006: 100 86 107 106 117 89 113 96 96 90 0.357000 979/1000 * NonOverlappingTemplate 007: 106 87 105 83 100 82 114 105 117 101 0.139655 979/1000 * NonOverlappingTemplate 007: 68 61 66 52 64 55 66 55 79 60 0.428390 611/626 * RandomExcursions 012: 104 95 104 93 89 99 107 122 98 89 0.450297 977/1000 * NonOverlappingTemplate 013: 122 109 99 93 96 100 98 87 96 100 0.514124 978/1000 * NonOverlappingTemplate 013: 63 67 57 70 63 46 66 64 71 59 0.557053 611/626 * RandomExcursions 017: 129 104 89 98 88 107 96 90 104 95 0.148653 979/1000 * FFT 017: 100 119 80 93 108 104 83 114 95 104 0.116746 977/1000 * NonOverlappingTemplate 023: 131 95 95 100 85 95 91 99 118 91 0.041709 979/1000 * NonOverlappingTemplate 036: 98 103 99 107 109 86 82 107 107 102 0.568739 978/1000 * NonOverlappingTemplate 037: 82 83 100 80 108 147 102 89 106 103 0.000071 * 990/1000 LongestRun 037: 111 102 99 103 94 105 93 107 92 94 0.915317 974/1000 * NonOverlappingTemplate 038: 106 87 102 97 111 117 97 91 102 90 0.512137 977/1000 * NonOverlappingTemplate 038: 109 91 88 97 108 110 88 101 94 114 0.478839 979/1000 * NonOverlappingTemplate 038: 109 91 87 97 109 107 90 102 94 114 0.528111 979/1000 * NonOverlappingTemplate 041: 99 105 101 92 93 107 109 96 100 98 0.968128 978/1000 * NonOverlappingTemplate 041: 101 97 102 99 93 104 95 85 115 109 0.703417 979/1000 * NonOverlappingTemplate 042: 74 70 53 56 60 69 52 59 49 65 0.283791 592/607 * RandomExcursions 044: 112 99 90 105 100 104 93 87 102 108 0.767582 978/1000 * NonOverlappingTemplate 045: 110 91 93 95 99 102 89 106 102 113 0.749884 977/1000 * NonOverlappingTemplate 047: 122 105 91 100 104 89 103 105 96 85 0.348869 979/1000 * Rank 047: 69 64 70 59 50 60 63 58 65 72 0.720714 615/630 * RandomExcursions 049: 80 52 52 55 68 50 52 72 63 67 0.068613 592/611 * RandomExcursions 050: 114 104 87 102 104 111 99 85 94 100 0.550347 979/1000 * NonOverlappingTemplate 053: 127 110 102 95 90 101 86 112 83 94 0.062036 978/1000 * NonOverlappingTemplate 057: 121 104 101 97 103 93 83 102 88 108 0.329850 978/1000 * NonOverlappingTemplate 060: 62 53 62 75 58 61 69 61 60 60 0.812729 606/621 * RandomExcursions 063: 110 83 92 107 102 106 101 100 97 102 0.783019 979/1000 * NonOverlappingTemplate 064: 91 96 101 86 131 90 117 105 90 93 0.033142 978/1000 * NonOverlappingTemplate 064: 108 117 100 89 100 107 105 69 110 95 0.060112 979/1000 * Serial 065: 72 63 66 61 56 46 70 53 48 63 0.211405 581/598 * RandomExcursionsVariant 067: 108 101 91 101 96 93 101 93 117 99 0.786830 979/1000 * Universal 069: 74 76 64 63 47 57 59 61 65 72 0.281188 623/638 * RandomExcursionsVariant 069: 77 79 66 72 51 38 56 67 65 67 0.008389 619/638 * RandomExcursionsVariant 069: 89 72 58 66 56 63 63 63 46 62 0.035917 619/638 * RandomExcursionsVariant 072: 110 99 118 102 100 96 99 101 79 96 0.433590 977/1000 * NonOverlappingTemplate 072: 112 97 93 106 117 95 91 87 101 101 0.530120 978/1000 * OverlappingTemplate 073: 56 57 62 59 62 62 54 80 59 65 0.550748 601/616 * RandomExcursions 074: 110 102 104 115 75 89 91 98 94 122 0.049346 978/1000 * NonOverlappingTemplate 077: 127 97 97 78 96 82 103 99 114 107 0.032274 972/1000 * FFT 077: 99 94 121 102 97 92 88 103 92 112 0.422638 979/1000 * NonOverlappingTemplate 080: 105 93 112 94 106 87 97 98 113 95 0.672470 979/1000 * NonOverlappingTemplate 086: 126 101 82 92 94 107 100 110 103 85 0.095426 979/1000 * NonOverlappingTemplate 088: 112 100 98 90 89 96 99 110 99 107 0.801865 979/1000 * NonOverlappingTemplate 088: 73 52 73 77 62 63 38 40 55 68 0.000972 585/601 * RandomExcursions 091: 123 112 90 103 84 105 89 90 107 97 0.144504 979/1000 * NonOverlappingTemplate 092: 111 100 91 106 101 99 90 112 89 101 0.733899 978/1000 * NonOverlappingTemplate 095: 123 92 113 105 95 92 87 99 95 99 0.295391 979/1000 * NonOverlappingTemplate 096: 118 99 98 85 103 87 98 114 109 89 0.253122 977/1000 * NonOverlappingTemplate 096: 109 94 101 92 75 109 104 99 117 100 0.216713 978/1000 * NonOverlappingTemplate 100: 112 93 81 103 107 91 108 101 82 122 0.074330 977/1000 * NonOverlappingTemplate 102: 60 60 57 55 57 78 56 52 55 53 0.484646 568/583 * RandomExcursions 104: 109 99 97 95 98 95 106 97 101 103 0.991468 978/1000 * OverlappingTemplate 113: 112 94 93 111 111 109 87 104 85 94 0.352107 979/1000 * NonOverlappingTemplate 114: 116 102 96 89 77 106 106 113 100 95 0.217857 978/1000 * LinearComplexity 115: 94 84 96 105 115 108 93 96 104 105 0.607993 1000/1000 * NonOverlappingTemplate 115: 115 103 106 80 104 103 108 101 92 88 0.377007 977/1000 * NonOverlappingTemplate 115: 84 62 69 49 70 58 49 65 67 52 0.041438 608/625 * RandomExcursions 116: 74 65 64 60 66 73 50 72 59 55 0.427082 623/638 * RandomExcursions 120: 103 105 114 98 90 92 91 96 106 105 0.783019 979/1000 * NonOverlappingTemplate 126: 111 93 98 98 105 102 92 93 104 104 0.940080 974/1000 * LinearComplexity 129: 75 56 51 79 56 72 68 62 53 53 0.082855 610/625 * RandomExcursions 137: 76 52 60 54 64 64 62 55 50 69 0.353190 587/606 * RandomExcursions 140: 120 97 104 100 94 95 102 98 109 81 0.404728 979/1000 * NonOverlappingTemplate 141: 120 96 96 100 109 96 105 81 96 101 0.408275 978/1000 * NonOverlappingTemplate 144: 130 88 91 96 89 103 122 88 93 100 0.021407 978/1000 * LongestRun 146: 78 66 66 62 52 56 54 65 48 73 0.156854 605/620 * RandomExcursionsVariant 146: 80 66 69 60 56 58 59 57 64 51 0.371778 605/620 * RandomExcursionsVariant 147: 68 65 72 61 53 89 44 49 65 37 0.000081 * 598/603 RandomExcursions 150: 122 102 98 99 99 96 91 98 107 88 0.546283 977/1000 * NonOverlappingTemplate 152: 105 93 101 103 120 100 95 108 88 87 0.450297 979/1000 * OverlappingTemplate 153: 96 97 87 119 106 104 111 99 92 89 0.424453 978/1000 * NonOverlappingTemplate 162: 118 103 107 94 94 86 93 109 78 118 0.069430 973/1000 * NonOverlappingTemplate 162: 125 110 100 91 97 101 79 99 98 100 0.180568 976/1000 * NonOverlappingTemplate 162: 101 96 101 92 92 101 118 110 87 102 0.591409 1000/1000 * NonOverlappingTemplate 171: 125 119 110 77 95 90 103 105 86 90 0.014051 979/1000 * NonOverlappingTemplate 174: 58 64 49 59 59 62 65 74 53 62 0.635384 590/605 * RandomExcursions 175: 102 88 98 101 100 106 95 106 106 98 0.968128 979/1000 * NonOverlappingTemplate 179: 108 76 114 85 99 121 95 101 99 102 0.082010 978/1000 * NonOverlappingTemplate 182: 114 92 76 117 100 104 98 109 98 92 0.165340 978/1000 * NonOverlappingTemplate 183: 103 98 101 112 99 105 96 92 100 94 0.964295 979/1000 * NonOverlappingTemplate 183: 119 121 90 95 109 98 110 85 91 82 0.042531 979/1000 * NonOverlappingTemplate 185: 101 92 98 106 113 79 113 110 97 91 0.293952 979/1000 * NonOverlappingTemplate 195: 112 97 107 85 117 99 104 95 96 88 0.420827 979/1000 * NonOverlappingTemplate 196: 124 96 93 100 101 95 98 87 98 108 0.429923 976/1000 * NonOverlappingTemplate 196: 112 89 92 111 114 100 92 86 92 112 0.266235 979/1000 * NonOverlappingTemplate 209: 138 95 97 95 113 96 95 87 85 99 0.012300 979/1000 * Universal 211: 127 93 108 85 91 93 112 91 98 102 0.112047 978/1000 * NonOverlappingTemplate 211: 68 75 53 66 49 64 51 72 53 55 0.141256 591/606 * RandomExcursions 214: 113 93 105 95 105 94 108 97 89 101 0.812905 979/1000 * NonOverlappingTemplate 216: 110 82 115 90 104 101 103 97 99 99 0.548314 979/1000 * NonOverlappingTemplate 225: 109 93 97 110 86 89 105 106 99 106 0.684890 979/1000 * NonOverlappingTemplate 227: 113 116 102 103 93 95 91 96 100 91 0.647530 977/1000 * NonOverlappingTemplate 228: 105 104 90 100 91 110 65 113 83 139 0.000054 * 990/1000 NonOverlappingTemplate 231: 107 98 99 106 96 102 101 108 92 91 0.955835 978/1000 * NonOverlappingTemplate 231: 130 113 82 105 89 101 82 105 92 101 0.020973 979/1000 * NonOverlappingTemplate 231: 108 103 116 100 115 81 100 85 105 87 0.147815 978/1000 * NonOverlappingTemplate 232: 98 96 92 105 105 103 89 111 99 102 0.917870 979/1000 * NonOverlappingTemplate 235: 109 103 105 100 105 99 89 94 96 100 0.958485 979/1000 * NonOverlappingTemplate 235: 110 102 105 100 105 99 89 93 97 100 0.949278 979/1000 * NonOverlappingTemplate 241: 128 94 118 90 102 90 108 84 92 94 0.039073 979/1000 * FFT 246: 123 105 99 93 118 100 95 86 87 94 0.139655 979/1000 * NonOverlappingTemplate 247: 116 105 100 98 93 84 113 101 109 81 0.212184 977/1000 * NonOverlappingTemplate 247: 111 92 109 82 98 99 92 118 95 104 0.331408 978/1000 * NonOverlappingTemplate 247: 109 109 97 104 97 95 96 94 101 98 0.972382 979/1000 * NonOverlappingTemplate 248: 110 98 98 91 91 104 94 106 98 110 0.866097 977/1000 * NonOverlappingTemplate 248: 63 60 51 69 51 62 71 71 63 66 0.568607 612/627 * RandomExcursions 249: 116 102 94 90 94 115 87 99 98 105 0.478839 977/1000 * NonOverlappingTemplate 250: 88 106 100 102 104 102 86 106 103 103 0.872425 979/1000 * NonOverlappingTemplate 251: 95 119 112 83 100 114 86 97 99 95 0.188601 979/1000 * NonOverlappingTemplate 253: 115 113 116 95 110 105 89 94 79 84 0.056426 978/1000 * NonOverlappingTemplate 253: 115 112 117 95 110 106 89 94 78 84 0.046269 978/1000 * NonOverlappingTemplate 254: 118 90 90 97 109 98 106 98 103 91 0.587274 978/1000 * NonOverlappingTemplate 257: 120 89 113 99 99 97 96 97 100 90 0.508172 978/1000 * NonOverlappingTemplate 257: 117 111 94 92 103 87 108 99 90 99 0.480771 979/1000 * NonOverlappingTemplate 257: 100 109 115 97 108 102 85 97 112 75 0.127393 979/1000 * NonOverlappingTemplate 258: 103 109 113 108 82 91 95 101 95 103 0.546283 979/1000 * NonOverlappingTemplate 260: 103 105 109 89 93 121 88 97 86 109 0.239266 975/1000 * NonOverlappingTemplate 268: 118 101 83 101 101 97 107 85 123 84 0.051281 978/1000 * NonOverlappingTemplate 271: 91 92 106 97 97 101 124 104 93 95 0.469232 974/1000 * NonOverlappingTemplate 273: 113 96 105 97 95 100 101 100 85 108 0.803720 976/1000 * NonOverlappingTemplate 275: 103 96 93 101 108 94 109 100 96 100 0.974370 978/1000 * NonOverlappingTemplate 275: 112 108 94 88 90 91 103 98 113 103 0.574903 977/1000 * NonOverlappingTemplate 277: 117 110 80 102 88 95 107 94 99 108 0.267573 979/1000 * CumulativeSums 279: 131 101 89 105 90 99 88 93 103 101 0.118120 975/1000 * Universal 281: 107 111 99 106 104 106 106 72 94 95 0.249284 977/1000 * NonOverlappingTemplate 282: 109 92 104 84 90 94 115 93 104 115 0.298282 978/1000 * NonOverlappingTemplate 282: 109 92 103 85 90 94 115 92 105 115 0.308561 978/1000 * NonOverlappingTemplate 283: 100 101 80 88 100 97 104 100 114 116 0.332970 979/1000 * NonOverlappingTemplate 291: 97 106 104 103 87 100 91 97 119 96 0.630872 979/1000 * NonOverlappingTemplate 297: 116 110 97 91 103 89 94 103 86 111 0.402962 979/1000 * NonOverlappingTemplate 299: 102 118 105 85 104 91 96 102 92 105 0.550347 1000/1000 * NonOverlappingTemplate 303: 105 83 127 74 99 100 127 96 101 88 0.001967 976/1000 * NonOverlappingTemplate 304: 139 107 105 87 93 106 106 79 94 84 0.001909 977/1000 * Universal 307: 104 91 101 99 89 107 117 100 97 95 0.747898 979/1000 * NonOverlappingTemplate 312: 92 111 89 109 104 108 90 87 111 99 0.476911 1000/1000 * NonOverlappingTemplate 312: 79 45 47 57 68 64 55 75 54 53 0.017601 580/597 * RandomExcursions 319: 72 58 52 69 58 61 64 70 63 60 0.767016 610/627 * RandomExcursions 320: 120 109 85 84 103 109 97 99 92 102 0.255705 977/1000 * NonOverlappingTemplate 321: 95 112 104 109 85 98 101 104 90 102 0.723804 978/1000 * NonOverlappingTemplate 324: 103 107 105 94 93 113 104 102 76 103 0.399442 979/1000 * NonOverlappingTemplate 324: 128 113 95 100 102 81 82 95 107 97 0.041438 979/1000 * NonOverlappingTemplate 326: 60 67 60 62 76 49 54 60 62 76 0.298470 610/626 * RandomExcursionsVariant 326: 64 58 59 76 61 50 64 69 71 54 0.422521 611/626 * RandomExcursionsVariant 332: 94 99 104 89 114 71 104 103 109 113 0.094854 979/1000 * NonOverlappingTemplate 333: 131 86 96 85 102 101 96 101 85 117 0.022452 979/1000 * NonOverlappingTemplate 335: 124 95 79 91 115 96 103 95 93 109 0.083526 976/1000 * NonOverlappingTemplate 336: 113 132 90 95 92 90 101 97 82 108 0.026948 977/1000 * NonOverlappingTemplate 337: 103 98 100 91 106 100 111 88 95 108 0.848027 979/1000 * NonOverlappingTemplate 339: 116 95 103 95 93 100 98 108 82 110 0.478839 979/1000 * NonOverlappingTemplate 341: 95 96 93 99 110 113 105 94 96 99 0.884671 978/1000 * NonOverlappingTemplate 341: 93 98 93 99 110 111 107 94 96 99 0.893482 978/1000 * NonOverlappingTemplate 341: 115 104 103 77 101 92 108 93 110 97 0.299736 976/1000 * NonOverlappingTemplate 342: 109 97 107 114 105 88 86 102 107 85 0.368587 979/1000 * NonOverlappingTemplate 345: 97 93 102 102 107 106 117 91 84 101 0.556460 979/1000 * NonOverlappingTemplate 348: 115 92 100 110 92 87 94 99 101 110 0.574903 978/1000 * NonOverlappingTemplate 352: 122 108 89 91 95 101 105 90 92 107 0.339271 978/1000 * NonOverlappingTemplate 355: 119 117 116 70 88 129 104 93 93 71 0.000022 * 985/1000 NonOverlappingTemplate 358: 108 98 99 98 93 112 96 97 103 96 0.957612 979/1000 * NonOverlappingTemplate 359: 98 98 98 110 109 81 103 105 84 114 0.319084 978/1000 * NonOverlappingTemplate 373: 101 99 96 109 123 93 118 91 74 96 0.038313 977/1000 * NonOverlappingTemplate 374: 125 93 96 92 106 98 117 75 95 103 0.042531 976/1000 * FFT 378: 104 109 103 122 97 94 97 84 99 91 0.365253 977/1000 * NonOverlappingTemplate 380: 74 58 58 65 52 55 64 71 72 48 0.225592 601/617 * RandomExcursions 381: 79 70 48 66 59 60 64 57 74 59 0.229900 620/636 * RandomExcursions 386: 83 127 91 100 94 104 101 101 90 109 0.147815 979/1000 * NonOverlappingTemplate 390: 103 115 105 91 100 96 107 111 88 84 0.413628 978/1000 * NonOverlappingTemplate 393: 108 102 86 98 120 85 96 92 98 115 0.212184 978/1000 * NonOverlappingTemplate 402: 107 92 89 101 131 91 93 100 102 94 0.134944 979/1000 * NonOverlappingTemplate 403: 134 123 99 102 83 99 99 93 79 89 0.002105 979/1000 * OverlappingTemplate 403: 102 109 106 83 97 84 126 92 101 100 0.116746 978/1000 * Serial 404: 99 96 96 102 107 104 97 107 107 85 0.887645 979/1000 * NonOverlappingTemplate 410: 99 96 98 101 98 113 98 104 101 92 0.971699 976/1000 * NonOverlappingTemplate 423: 101 87 105 104 106 77 96 108 103 113 0.323668 979/1000 * NonOverlappingTemplate 431: 91 107 103 105 113 112 99 98 88 84 0.454053 979/1000 * NonOverlappingTemplate 432: 79 65 62 69 49 54 48 71 68 52 0.060031 602/617 * RandomExcursions 433: 103 97 96 97 97 95 96 100 100 119 0.872425 979/1000 * NonOverlappingTemplate 435: 121 97 96 96 90 98 99 93 108 102 0.632955 978/1000 * NonOverlappingTemplate 438: 124 109 87 100 94 90 117 89 95 95 0.114712 978/1000 * Universal 443: 68 55 80 81 49 60 54 58 56 74 0.027150 620/635 * RandomExcursions 444: 108 107 109 102 93 82 101 112 98 88 0.471146 978/1000 * NonOverlappingTemplate 445: 101 93 102 102 104 93 116 100 100 89 0.834308 979/1000 * NonOverlappingTemplate 458: 101 103 100 101 114 100 97 106 95 83 0.773405 978/1000 * NonOverlappingTemplate 458: 118 100 89 89 107 103 108 104 94 88 0.452173 978/1000 * NonOverlappingTemplate 458: 114 94 96 102 87 96 95 103 96 117 0.558502 979/1000 * NonOverlappingTemplate 464: 97 104 104 101 117 97 101 91 85 103 0.682823 979/1000 * NonOverlappingTemplate 466: 106 117 99 113 89 103 84 93 92 104 0.342451 979/1000 * NonOverlappingTemplate 470: 107 116 82 98 96 103 92 119 99 88 0.197981 978/1000 * NonOverlappingTemplate 473: 111 99 106 98 97 101 103 89 102 94 0.945296 977/1000 * NonOverlappingTemplate 485: 98 100 101 95 98 108 106 93 106 95 0.982454 979/1000 * NonOverlappingTemplate 486: 134 87 94 109 104 83 88 97 99 105 0.023071 979/1000 * Universal 495: 63 85 79 83 39 50 42 59 75 58 0.000008 * 630/633 RandomExcursionsVariant 497: 85 54 68 64 62 58 60 60 53 71 0.177505 620/635 * RandomExcursions
Reference
I tested NeuG 0.04 with NIST STS 2.1.1 in November 2012. I tested NeuG 0.05 with NIST STS 2.1.1 in February 2013. I tested NeuG 0.11 with NIST STS 2.1.1 in August 2013.