• yum13241@lemm.ee
    link
    fedilink
    arrow-up
    0
    ·
    9 months ago

    Why the FUCK did they make characters that look the same have different codepointers in UNICODE? They should’ve done what they did in CJK and make duplicates have the same codepointer.

    Unicode needs a redo.

    • Trantarius@programming.dev
      link
      fedilink
      arrow-up
      0
      ·
      9 months ago

      Well letters don’t really have a single canonical shape. There are many acceptable ways of rendering each. While two letters might usually look the same, it is very possible that some shape could be acceptable for one but not the other. So, it makes sense to distinguish between them in binary representation. That allows the interpreting software to determine if it cares about the difference or not.

      Also, the Unicode code tables do mention which characters look (nearly) identical, so it’s definitely possible to make a program interpret something like a Greek question mark the same as a semicolon. I guess it’s just that no one has bothered, since it’s such a rare edge case.

        • mrpants@midwest.social
          link
          fedilink
          English
          arrow-up
          1
          ·
          9 months ago

          In cases where something looks stupid but your knowledge on it is almost zero it’s entirely possible that it’s not.

          The people that maintain Unicode have put a lot of thought and effort into this. Might be helpful to research why rather than assuming you have a better way despite little knowledge of the subject.