[Bug 43073] New: Cyrillic/ russian characters displays incorrectly in Final Fantasy XIV

https://bugs.winehq.org/show_bug.cgi?id=43073

Bug ID: 43073
           Summary: Cyrillic/russian characters displays incorrectly in
                    Final Fantasy XIV
           Product: Wine
           Version: 2.8
          Hardware: x86-64
                OS: Linux
            Status: UNCONFIRMED
          Severity: normal
          Priority: P2
         Component: mlang
          Assignee: [e-mail]
          Reporter: [e-mail]
      Distribution: ---

Created attachment 58256
  --> https://bugs.winehq.org/attachment.cgi?id=58256
launcher and UI screenshots

Cyrillic/russian characters displays incorrectly in Final Fantasy XIV.
It affects a game launcher, in-game UI, and a chat.
It's impossible to play, when you can't talk with other people and can't read
the chat.

The text used as example in screenshots is "привет hello".

[Bug 43073] Cyrillic/ russian characters displays incorrectly in Final Fantasy XIV

https://bugs.winehq.org/show_bug.cgi?id=43073

[e-mail] changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[e-mail]

--- Comment #1 from [e-mail] ---
Have you tried winetricks -q corefonts or winetricks -q allfonts?

https://ubuntuforums.org/showthread.php?t=665485

According to this starting the game like this LANG=ru_RU.UTF-8 wine game.exe
might work. It may require some of those fonts, I really don't know.

[Bug 43073] Cyrillic/ russian characters displays incorrectly in Final Fantasy XIV

https://bugs.winehq.org/show_bug.cgi?id=43073

Nikolay Sivov  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
          Component|mlang                       |-unknown

[Bug 43073] Cyrillic/ russian characters displays incorrectly in Final Fantasy XIV

https://bugs.winehq.org/show_bug.cgi?id=43073

--- Comment #2 from Nikolay Sivov  ---
If you have access to Windows machine with en_US default localization, you
could as well verify if same issue happens there. But yes, first thing to try
is to set LANG=ru_RU.UTF-8 before starting the game.

[Bug 43073] Cyrillic/ russian characters displays incorrectly in Final Fantasy XIV

https://bugs.winehq.org/show_bug.cgi?id=43073

--- Comment #3 from Yonnji  ---
(In reply to winetest from comment #1)
> Have you tried winetricks -q corefonts or winetricks -q allfonts?
>
> https://ubuntuforums.org/showthread.php?t=665485
>
> According to this starting the game like this LANG=ru_RU.UTF-8 wine game.exe
> might work. It may require some of those fonts, I really don't know.

This doesn't helps. The game is already running with LANG=ru_RU.UTF-8.
When running in LANG=en_US.UTF-8 the cyrillic characters are displayed as
"??????".

(In reply to Nikolay Sivov from comment #2)
> If you have access to Windows machine with en_US default localization, you
> could as well verify if same issue happens there. But yes, first thing to
> try is to set LANG=ru_RU.UTF-8 before starting the game.

There are no issues in the game on Windows.

But there are some issues in the launcher: when "BrowserType" is set to "2" in
FFXIV_BOOT.cfg (which is only working option for Wine), cyrillic characters are
displayed in the same way as in Wine. Anyway it's not a problem, because you
can't use cyrillic characters in login or password.

[Bug 43073] Cyrillic/russian characters displays incorrectly in Final Fantasy XIV

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=43073

[e-mail] changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[e-mail]

--- Comment #4 from [e-mail] ---
Got same issue with cyrillic text. I can see what others write in chat but if I
trying to answe  see some odd symbols. It feels like the issue with character
encoding for me.

[Bug 43073] Cyrillic/russian characters displays incorrectly in Final Fantasy XIV

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=43073

--- Comment #5 from [e-mail] ---
Few additions to my previous comment. I've tried some other non-latin keyboard
layouts like Greek and Japanese (kana), and got similar result. In these two
cases question marks appeared in input fields instead. So issue is broader than
described initially.
Input works correctly in launcher, so issue left only in-game.
Tested on Proton Experimental. Unfortunatelly unable to test with latest wine
release because license is tied to steam.

[Bug 43073] Cyrillic/russian characters displays incorrectly in Final Fantasy XIV

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=43073

--- Comment #6 from [e-mail] ---
Sorry for bothering again but I got another detail that might narrow down
searches of issue cause. Pasting text into a chat field works just fine. So
only direct input works incorrectly.
This issue is pesent on wine-6.10 (Staging) as well.

[Bug 43073] Cyrillic/russian characters displays incorrectly in Final Fantasy XIV

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=43073

--- Comment #7 from Anton  ---
Still present in wine-staging 6.12.

[Bug 43073] Cyrillic/russian characters displays incorrectly in Final Fantasy XIV

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=43073

--- Comment #8 from Anton  ---
Occurs on wine 6.13 as well.

Are there any wine logs I can collect to narrow down issue cause?

[Bug 43073] Cyrillic/russian characters displays incorrectly in Final Fantasy XIV

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=43073

--- Comment #9 from Anton  ---
Created attachment 70564
  --> https://bugs.winehq.org/attachment.cgi?id=70564
WINEDEBUG=-all,+keyboard,+key,+dinput,+message

Still happens on wine staging 6.16.
Also, tried to play around various locales but was unable to achieve any
positive result. I've tried ru_RU.CP1251, ru_RU.ISO-8859-5, ru_RU.KOI8-R.

[Bug 43073] Cyrillic/russian characters displays incorrectly in Final Fantasy XIV

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=43073

--- Comment #10 from Anton  ---
Present in wine-staging 6.21

[Bug 43073] Cyrillic/russian characters displays incorrectly in Final Fantasy XIV

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=43073

--- Comment #11 from Anton  ---
I found another thing about this issue. It happens only for ibus-xkb input
sources. If I use any other ibus input source (ibus-table-rustrad, ibus-m17n)
then input will work properly. However those input sources have wrong mappings
for some keys so this couldn't be used as a proper workaround.

Also, issue present if I boot from the livecd with default params. I've tried
on Ubuntu 21.10 livecd with English localization.

[Bug 43073] Cyrillic/russian characters displays incorrectly in Final Fantasy XIV

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=43073

Rémi Bernon  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[e-mail]

--- Comment #12 from Rémi Bernon  ---
Created attachment 73858
  --> https://bugs.winehq.org/attachment.cgi?id=73858
Possible fix

I believe this patch should fix the issue. The problem comes from comctl32
window subclassing which should override the ANSI window procedure with Unicode
callbacks.