Fossil

File History
Login

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

History of test/utf.test

2016-06-11
00:06
added new tests for invalid utf8 sequences file: [e2489218] check-in: [6da500a1] user: sdr branch: trunk, size: 688060
2016-06-10
11:49
Add many test-cases of (possible) invalid UTF-8 sequences file: [482701be] check-in: [acf7fe47] user: jan.nijtmans branch: trunk, size: 674640
10:23
Fix corner-case in invalid utf-8 detection, with modified test-cases. Additional test-cases still to be done. file: [9f57146e] check-in: [87da6f97] user: jan.nijtmans branch: trunk, size: 607620
2016-03-02
20:43
Rename the test suite procedure 'repo_init' to 'test_setup'. file: [4f476e82] check-in: [413921cc] user: mistachkin branch: testerCleanup, size: 607604
08:13
All test files must now call 'repo_init', using an empty string if they do not require a new repository. file: [d4234226] check-in: [3a578e04] user: mistachkin branch: testerCleanup, size: 607603
06:45
More work... file: [3ed60b96] check-in: [29f0328c] user: mistachkin branch: testerCleanup, size: 607589
2016-01-11
19:46
Prevent the 'array set' commands in the 'utf.test' file from causing problems if there are pre-existing scalar variables. file: [7fd75c8d] check-in: [ad6de638] user: mistachkin branch: trunk, size: 607494
2014-06-10
04:32
Pass command line arguments to hooks via a TH1 list variable. Enhance test suite infrastructure and add tests. Update hook TH_ERROR return code handling comments to reflect reality. file: [9b9447e3] check-in: [b34dbc78] user: mistachkin branch: th1Hooks, size: 607399
2014-04-25
15:03
Fix handling of overlong UTF-8 forms: All overlong forms except 0xC0 0x80 (\u0000) are considered invalid. Run same test-cases as on trunk, which now contains various overlong UTF-8 sequences, as proof that everything is correct. file: [db1a2d0b] check-in: [636da047] user: jan.nijtmans branch: invalid-utf8, size: 607653
11:00
More UTF-8-related test-cases file: [d9f70000] check-in: [621f9865] user: jan.nijtmans branch: trunk, size: 606899
2013-04-08
09:03
Implement LOOK_INVALID for utf-16, and use it to detect UTF-16 without BOM in network byte order file: [67ad5bb7] check-in: [2d14d82c] user: jan.nijtmans branch: ui-no-utf8, size: 527208
2013-04-04
15:24
eliminate goto file: [117248ea] check-in: [c11b3736] user: jan.nijtmans branch: improve_commit_warning, size: 527206
12:02
don't use tabs file: [5137277e] check-in: [c3a39ffe] user: jan.nijtmans branch: improve_commit_warning, size: 527482
11:35
merge trunk file: [d35afb3f] check-in: [d8bc29f3] user: jan.nijtmans branch: improve_commit_warning, size: 527482
2013-04-03
12:14
Restore the original UTF test numbering. file: [4ab7763c] check-in: [00f9c9e8] user: mistachkin branch: trunk, size: 526588
09:59
merge trunk file: [66e3221e] check-in: [ccc9896f] user: jan.nijtmans branch: looks-like-utf, size: 285324
09:39
Implement LOOK_SHORT flag Re-order test-cases such that adding to "data" array will not result in more renumberings any more. This should prevent the "More than 10,000 changes" in some (not all) cases. file: [607f1513] check-in: [1686ff71] user: jan.nijtmans branch: trunk, size: 526574
2013-04-02
08:36
More compact, better readable, output for test-looks-like-utf command. file: [4ee1fa7c] check-in: [caa50cff] user: jan.nijtmans branch: looks-like-utf, size: 285338
2013-03-21
12:37
merge trunk. Not correct: Test-case 414 doesn't give the right answer! file: [4735c9a3] check-in: [4310b0b2] user: jan.nijtmans branch: improve_commit_warning, size: 527207
12:06
Add flag LOOK_INVALID, not used yet. Add many more UTF8/16 test-cases. file: [13760067] check-in: [3ec3909b] user: jan.nijtmans branch: trunk, size: 526588
2013-03-19
08:59
Merge "cr-warning" branch to trunk: Fossil now warns before committing files with CR line-endings and offers to convert them to LF line-endings; fossil's diff cannot handle those. In checkin.c, use LOOK_BINARY in stead of LOOK_NUL, in case more flags are added to the BINARY detection. Rename LOOK_LENGTH to LOOK_LONG. file: [087e3ae2] check-in: [ea2598e4] user: jan.nijtmans branch: trunk, size: 337461
08:34
Fix expected value of test-cases: The value of LOOK_LONE_CR is wrong in 19 cases. I leave it to Joe to fix the code. file: [83f243d6] check-in: [8af1541a] user: jan.nijtmans branch: bomRefactor, size: 403012
2013-03-18
23:47
Make sure that LOOK_CR is set even when a CR/LF pair is detected. Rename the LOOK_LENGTH flag to LOOK_LONG for clarify. Add LOOK_SHORT flag to indicate that the looks_like_utf16() function did not perform a full check. Support tests for UTF-16 in reverse byte order. Enhancements to the test-looks-like-utf command. file: [4598e233] check-in: [b0b3f2a4] user: mistachkin branch: bomRefactor, size: 403031
12:37
Adapt test-case 112 such that it contains a reversed CR/LF, a case not covered before. Fix detection of reversed CR/LF and lone CR in reversed UTF-16 case, broken by [e3f9a42b58]. file: [4d95bf95] check-in: [a4cdc723] user: jan.nijtmans branch: trunk, size: 339285
11:45
Add test-cases using reverse UTF-16 BOM, and the unicode characters U+0A00 and U+0D00 file: [3ebd13aa] check-in: [d1f0c4b9] user: jan.nijtmans branch: trunk, size: 339256
10:22
Add test-cases using reverse UTF-16 BOM, and the unicode characters U+0A00 and U+0D00 file: [e543eee5] check-in: [a9f1cbbd] user: jan.nijtmans branch: reverse-bom-testcases, size: 337742
09:30
Remove dead code from checkin.c Fix LOOK_BINARY macro: LOOK_ODD doesn't say anything about being binary or not, it only means it cannot be UTF-16. file: [c27875a9] check-in: [12ce0041] user: jan.nijtmans branch: trunk, size: 252076
05:38
Correct inverted result of looks_like_binary() macro. Correct off-by-one error in the looks_like_utf16() function. Restore original meaning of the LOOK_CR and LOOK_LF flags. Restore LOOK_ODD flag, abstracting UTF-16 content inspection away from blob length. When performing byte swaps, do so consistently. Fix test cases to work with Tcl versions prior to 8.6. Add could_be_utf16() function to preform the preliminary blob checks. Adjustments to style and comments. file: [aa12562d] check-in: [e3f9a42b] user: mistachkin branch: trunk, size: 252147
2013-03-17
09:54
remove the LOOK_ODD flag. It doesn't fit in looks_like_utf16() because it doesn't need each character to be scanned. file: [f781dda9] check-in: [d4fe8be6] user: jan.nijtmans branch: trunk, size: 241400
2013-03-15
10:05
Add two new utf-16 test-cases, which were handled wrong up to now, and fix the code accordingly. file: [1b851b7b] check-in: [fab2b8ae] user: jan.nijtmans branch: trunk, size: 256516
2013-03-14
22:14
Better handling and tests for initial CR/LF chars in the looks_like_utf*() functions. file: [db59d81a] check-in: [3d6d2e7f] user: mistachkin branch: trunk, size: 252042
2013-03-13
15:03
merge trunk file: [afc1b22a] check-in: [9263d4c2] user: jan.nijtmans branch: bomRefactor, size: 218562
14:52
make expected "utf-check" parameters less cryptic file: [17c609e6] check-in: [5a9f8558] user: jan.nijtmans branch: trunk, size: 218623
13:44
remove debug code file: [10b81b22] check-in: [7ef1890c] user: jan.nijtmans branch: bomRefactor, size: 261067
13:37
merge trunk file: [f3301ecc] check-in: [3718383e] user: jan.nijtmans branch: bomRefactor, size: 261125
2013-03-12
22:37
Modify the looks_like_utf*() functions to detect lone CR and LF characters and set new output flags accordingly. file: [30a364da] check-in: [7dee9038] user: mistachkin branch: trunk, size: 261128
12:00
Fix determination of LOOK_CR/LOOK_LF to include the first character in the file, eliminating overlap with LOOK_CRLF. This way, inconsistant line endings can be determined by verifying that at most one of the flags LOOK_CR/LOOK_LF/LOOK_CRLF may be set. Test cases adapted accordingly. file: [2f4cbab3] check-in: [c1d35267] user: jan.nijtmans branch: trunk, size: 230288
2013-03-11
15:37
Combine looks_like_utf8/looks_like_utf16 to a single looks_like_utf function, which can be used in both checkin.c and utf.test. This assures that utf.test really checks the same thing as checkin.c is using. file: [dedd3493] check-in: [e42ea98f] user: jan.nijtmans branch: bomRefactor, size: 230492
2013-03-10
01:36
Add UTF detection tests for the LOOK_ODD flag. file: [6212599d] check-in: [c58b815f] user: mistachkin branch: trunk, size: 230528
2013-03-08
02:15
Make it easier to correlate the UTF detection test results with the byte-order-mark and data used to produce them. Wrong line endings. file: [3586475e] check-in: [9b90146a] user: mistachkin branch: mistake, size: 116680
00:46
In the test for the UTF-8/UTF-16 detection functions, use the right byte-order-mark for the endianness of the machine. file: [0c1948f9] check-in: [05ac5884] user: mistachkin branch: trunk, size: 113818
00:09
Revise the looks_like_utf16() function so that it can handle blobs with an odd number of bytes and still set all the applicable output flags. Add tests for the UTF-8/UTF-16 detection functions. file: [7a749a50] check-in: [e3ae4148] user: mistachkin branch: trunk, size: 113625 Added