Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No mention of NFG in the docs? #3258

Open
lizmat opened this issue Mar 9, 2020 · 7 comments
Open

No mention of NFG in the docs? #3258

lizmat opened this issue Mar 9, 2020 · 7 comments
Assignees
Labels
docs Documentation issue (primary issue type) RFE Request for enhancement. Try to use alternative wording that explain the concept more clearly

Comments

@lizmat
Copy link
Collaborator

lizmat commented Mar 9, 2020

Looks like NFG is not explained anywhere? While it is one of the Unique Selling Points of Raku.

https://6guts.wordpress.com/2015/04/30/this-week-the-big-nfg-switch-on-and-many-fixes/ perhaps as a source of information?

@JJ
Copy link
Contributor

JJ commented Mar 9, 2020

Not that I remember. We'll have to do something about it. Thanks for the report.

@JJ JJ added docs Documentation issue (primary issue type) RFE Request for enhancement. Try to use alternative wording that explain the concept more clearly labels Mar 9, 2020
@coke
Copy link
Collaborator

coke commented Mar 13, 2021

We should still have our own writeup, but:

https://docs.raku.org/language/glossary#index-entry-NFG points to articles

and there are multiple pointers to that in Lang/regex, Lang/unicode, and Type/Cool

@mykhal
Copy link
Contributor

mykhal commented Jul 16, 2021

I was writing new issue request (but eventually got here):

Raku docs don't seem to sufficiently reflect potentially unexpected Unicode normalization during Str construction. (I don't see it mentioned in docs at raku.org). See e.g. following cases:

"\x340" eq "\x300" ;           # True # False might have been expected
"\x340".ords.map(*.base(16)) ; # (300) # (340) might have been expected

Find some more interesting character on which it happens, put it in nicer code example, and mention it at least in

maybe also in

Also mention how to make/handle intentionally non-normalized Unicode strings, if applicable.

@JJ
Copy link
Contributor

JJ commented Jul 17, 2021

Any idea why it happens in that specific case? Is that legit or is it a bug?

@mykhal
Copy link
Contributor

mykhal commented Jul 17, 2021

@JJ it's OK, see red closed rakudo issue #4457 link above. Non-normalizad Unicode strings should be probably done like

Uni(0x340).list eqv Uni(0x300).list  # False

(direct Uni eqv'ing does not (yet(?)) work. UPDATE: now it does)

@JJ
Copy link
Contributor

JJ commented Jul 17, 2021

So it's totally legit, but it might still need some explanation as required by the OP.

@mykhal
Copy link
Contributor

mykhal commented Jul 17, 2021

Right. Here it's kind of mentioned: language/traps, section All text is normalized by default. Similar example might fit there.

@coke coke added this to the 2023-First Quarter milestone Feb 7, 2023
@coke coke self-assigned this Mar 8, 2023
@coke coke modified the milestones: 2023-Quarter 1, 2023-Quarter 2 Apr 1, 2023
@coke coke modified the milestones: 2023-Quarter 2, 2023-Quarter 3 Jul 12, 2023
@coke coke removed their assignment Aug 15, 2023
@coke coke modified the milestones: 2023-Quarter 3, 2023-Quarter 4 Oct 8, 2023
@coke coke modified the milestones: 2023-Quarter 4, 2024-Quarter-2 Mar 31, 2024
@coke coke self-assigned this May 18, 2024
@coke coke modified the milestones: 2024-Quarter-2, 2024-Quarter-3 Jul 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docs Documentation issue (primary issue type) RFE Request for enhancement. Try to use alternative wording that explain the concept more clearly
Projects
None yet
Development

No branches or pull requests

4 participants