Grant Report : Robust Perl 6 Unicode Support – June 2017

综合编程 2017-06-06

Samantha McVey has made progress on hergrant to improve the robustness of Unicode support in Rakudo. She is working in the following repos: https://github.com/samcv/UCD
, https://github.com/samcv/Unicode-Grant
.

Here are a few highlights from her complete blog post
.

The script tests the contents of each grapheme individually from the GraphemeClusterBreak.txt file from the Unicode 9.0 test suite.

Previously we only checked the total number of ‘.chars’ each for the string as a whole. Obviously we want something more precise than that, since the test specifies the location of each of the breaks between codepoints. The new code checks that codepoints are put in the correct graphemes in the proper order. In addition we also check the string length as well.

This new test uses a grammar to parse the file and generally is much more robust than the previous script.

  • I have some currently unmerged tests which need to wait to be merged, although sections of it are complete and are being incorporated into the larger Unicode Database Retrofit, reusing this code.

  • I have written grammars and modules to process and provide data on the PropertyValueAliases
    and PropertyAliases
    . They will be used for testing that all of the canonical property names and all the property values themselves properly resolve to separate property codes, as well as that they are usable in regex.

  • As part of my grant work I am working on making Unicode property values distinct per property, and also on allowing all canonical Unicode property values to work.

  • I've also started adding some documentation to my Unicode-Grant wiki with information about what is enclosed in each Unicode data files; there are a few other pages as well. This wiki
    is planned to be expanded to have many more sections than it does currently."

MAJ

您可能感兴趣的

The clash between two Burmese fonts is stalling gr... In the early days of Burmese internet, a unique font was invented, but it has resulted in painpoints Bindez wants to fix. Like in many emerging m...
Revitalizing blogs.perl.org About a year ago, I submitted a grant proposal to TPF to revitalize this platform, blogs.perl.org. It was supposed to have taken only a few months, bu...
Perl 5.26.0 is now available Front page |perl.perl5.porters | Postings from May 2017 Perl 5.26.0 is now available! Thread Next From: Sawyer X Date: May ...
Demystifying encodings — part 3 Do you ever have trouble with encodings? I used to in the past, but now I rarely do, because I do a simple thing. While knowing the things I expla...
Hubert ‘depesz’ Lubaczewski: Waiting f... On 28th of March 2018, Peter Eisentraut committed patch: Transforms for jsonb to PL/Python Add a new contrib module jsonb_plpython that...
0
Perlsphere

责编内容来自:Perlsphere (本文源链)
阅读提示:酷辣虫无法对本内容的真实性提供任何保证,请自行验证并承担相关的风险与后果!
本站遵循[CC BY-NC-SA 4.0]。如您有版权、意见投诉等问题,请通过eMail联系我们处理。