[Bug 29735] New: Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

Bug #: 29735
           Summary: Wine tahoma doesn't display Chinese
           Product: Wine
           Version: 1.4-rc1
          Platform: x86
        OS/Version: Linux
            Status: UNCONFIRMED
          Severity: normal
          Priority: P2
         Component: fonts
        AssignedTo: [e-mail]
        ReportedBy: [e-mail]
    Classification: Unclassified

1. start wine notepad with LANG=zh_CN.utf8

2. type in or copy and paste some Chinese:
---
sample text:
测试中文显示
---

3. set font to "Tahoma"

expect result:
display Chinese
actual result:
display some boxes (口口)

winetricks tahoma doesn't work ,  winetricks corefont tahoma doesn't work too.

There are too many open font bugs in bugzilla, sorry if this is a dup.

Can this bug be fixed in wine-1.4, or is there any known workaround?
Thanks.

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

Qian Hong  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
           Keywords|                            |download, source

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

Dmitry Timoshkov  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|UNCONFIRMED                 |RESOLVED
         Resolution|                            |DUPLICATE

--- Comment #1 from Dmitry Timoshkov  2012-01-28 23:56:12 CST ---
Native Tahoma doesn't contain CJK glyphs either, this is a font link magic.

*** This bug has been marked as a duplicate of bug 16325 ***

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #2 from Qian Hong  2012-01-29 00:16:31 CST ---
(In reply to comment #1)
> Native Tahoma doesn't contain CJK glyphs either, this is a font link magic.
>
> *** This bug has been marked as a duplicate of bug 16325 ***

Thanks.

However, I'm still confused. CMIIW, I think there are at least two problems
mentioned in Bug 16325, one is for font link, another is for codepage, but this
bug is just for font link, and it is much more clearly than Bug 16325, only
Tahoma font is focused, does it make sense to keep this bug open?

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #3 from Dmitry Timoshkov  2012-01-29 00:23:06 CST ---
Code page problem is most likely a subsequence of wrong Linux locale, or
just a speculation. Wrong font links is a real one.

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #4 from Qian Hong  2012-01-29 00:28:43 CST ---
(In reply to comment #3)
> Code page problem is most likely a subsequence of wrong Linux locale, or
> just a speculation. Wrong font links is a real one.

Thanks, can I open new bug for code page problem if I found real world app
display Chinese incorrectly even if LANG=zh_CN.utf8?

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

Dmitry Timoshkov  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|RESOLVED                    |CLOSED

--- Comment #5 from Dmitry Timoshkov  2012-01-29 02:11:18 CST ---
(In reply to comment #4)
> Thanks, can I open new bug for code page problem if I found real world app
> display Chinese incorrectly even if LANG=zh_CN.utf8?

If it's not font links related - sure.

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #6 from Qian Hong  2012-01-31 09:38:22 CST ---
Hello, I've do some bisect and found some interesting things.
To describe clearly I'll split my test result into three comments.

According to http://bugs.winehq.org/show_bug.cgi?id=16325#c88, fontlink should
work after wine-1.1.22

Bug 16325 is original reported to wine-1.1.9, so I retested with wine-1.1.9 and
wine-1.1.22.

However, seems Tahoma (and other fonts)  fontlink don't work for Chinese, the
below result is exactly the same for wine-1.1.9 and wine-1.1.22 :
 - in Wine notepad, set font to Tahoma, Chinese characters display as some
squares, such as "口口口"
 - set font to "System", Chinese characters display as some small lines such as
"||||".  
 - set font to "MS sans serif", Chinese characters doesn't display at all, they
are empty

- If I import the registry file to override "MS sans serif" font, then all the
three fonts work perfectly in wine notepad

The mentioned registry file can be download here:
http://bugs.winehq.org/attachment.cgi?id=38583
( see also Bug 27444 )

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #7 from Qian Hong  2012-01-31 09:55:56 CST ---
This commit give us some new result:

commit 3b5e14a9b0a925052e2b1b71f76a7f1eff6d84bf
Author: Aric Stewart 
Date:   Fri Oct 21 11:29:05 2011 -0500

user32: Use Uniscribe in the multiline edit control.

As the test result above, the "MS sans serif" font link registry file could
workaround for "MS sans serif","Tahoma",and "System" fonts, until
wine-1.3.31-8-g3b5e14a .

The behaviors of "MS sans serif" and "System" fonts didn't change after this
commit, however, after wine-1.3.31-8-g3b5e14a:
 - In wine notepad, Tahoma font display as some "half square"  ( it used to
display as "square" )
 - The registry file doesn't work for Tahoma in wine notepad any more

I try to override native usp10 with wine-1.3.31-8-g3b5e14a , but it cause a
crash.
Then I try some recently wine version ( 1.3.32, 1.3.33, 1.3.36 ) , native usp10
give me a better result:
 - with both native usp10 overriding and fontlink registry file overriding,
Tahoma in notepad display Chinese correctly again, (by the way, this overriding
doesn't break "MS sans serif" and "System")
 - with native usp10 but without fontlink overriding:
   - Chinese characters in tahoma display as "half square"
   - "System" display as "|||"
   - "MS sans serif" display as some "half square" with some strange characters

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #8 from Qian Hong  2012-01-31 10:03:03 CST ---
commit 6fe14a015335eb50a5e03ae59fcc882b019479ff
Author: Aric Stewart 
Date:   Thu Dec 15 09:51:21 2011 -0600

usp10: Do not try to fallback if no fallback font is specified.

The above is another commit give us interesting result:
 - before wine-1.3.34-353-g6fe14a0, "Tahoma" in notepad display as "half
square"
 - after wine-1.3.34-353-g6fe14a0, "Tahoma" display as "square"(looks like
"口口")

The other two fonts ("System" and "MS sans serif") doesn't change after this
commit.

All these tests are with a LANG=zh_CN.utf8 setting, hopes them useful.

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

Qian Hong  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[e-mail]

--- Comment #9 from Qian Hong  2012-01-31 10:05:15 CST ---
CC Aric, no matter whether this bug is a dup, hope the test result itself is
useful.

Thanks Aric for your hard work on font issues, and thanks Dmitry too.

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #10 from Aric Stewart  2012-01-31 10:26:32 CST ---
Might be a duplicate, however.

The reason you saw the change was that for a while uniscribe in the edit
control was always falling back to Microsoft Sans Serif for fonts, that is not
the right behavior and it is correct that your font linking for Tahoma is
incorrect.

could you generate a +font log for me

also look in you ~/.wine/system.reg and copy out the contexts of your
[Software\Microsoft\Windows NT\CurrentVersion\FontLink\SystemLink] key

thanks!
-aric

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #11 from Qian Hong  2012-01-31 10:29:49 CST ---
Created attachment 38627
  --> http://bugs.winehq.org/attachment.cgi?id=38627
Screenshot: tahoma ( Chinese is displayed correctly )

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #12 from Ma Xiaojun  2012-01-31 10:33:35 CST ---
Qian Hong:

Please check using regedit
HKEY_LOCAL_MACHINE\Software\Microsoft\Windows
NT\CurrentVersion\FontLink\SystemLink

A CLI method for such checking is desirable and I find the following two
commands relevant.
http://ss64.com/nt/reg.html
http://ss64.com/nt/regedit.html

In my wine 1.3.37. (I'd try latest version later)
`reg` command is a stub while `regedit` command is not fully completed.

Anyway, try this command.
LANG=C regedit /e - "HKEY_LOCAL_MACHINE\Software\Microsoft\Windows
NT\CurrentVersion\FontLink\SystemLink"

The REG_MULTI_SZ values would be displayed as hexadecimal and thus make the
strings obscure.

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #13 from Aric Stewart  2012-01-31 10:35:33 CST ---
or, the system.reg file is actually a flat text file so you can open it in your
favorite text editor and search for the given key.

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #14 from Qian Hong  2012-01-31 10:42:22 CST ---
(In reply to comment #10)
> could you generate a +font log for me
>
> also look in you ~/.wine/system.reg and copy out the contexts of your
> [Software\Microsoft\Windows NT\CurrentVersion\FontLink\SystemLink] key

Thanks, is a +font log for wine-1.3.36 useful? Currently I have very weak
internet connection on my laptop, and I don't have wine-1.4-rc at this time.
Sorry.

If wine-1.3.36 log is useless, I'll attach the log tomorrow. Or maybe Ma
Xiaojun can help :)

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #15 from Qian Hong  2012-01-31 10:44:27 CST ---
[Software\Microsoft\Windows NT\CurrentVersion\FontLink\SystemLink]
1328028087

(wine-1.3.36)

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #16 from Aric Stewart  2012-01-31 10:45:39 CST ---
(In reply to comment #15)
> [Software\Microsoft\Windows NT\CurrentVersion\FontLink\SystemLink]
> 1328028087
>
> (wine-1.3.36)

Are there no entries below that?

I have

[Software\Microsoft\Windows NT\CurrentVersion\FontLink\SystemLink]
1328025661
"Lucida Sans Unicode"=str(7):"msgothic.ttc,MS UI Gothic\0SimSun.ttf,SimSun\0"
"Microsoft Sans Serif"=str(7):"msgothic.ttc,MS UI Gothic\0SimSun.ttf,SimSun\0"
"Tahoma"=str(7):"msgothic.ttc,MS UI Gothic\0SimSun.ttf,SimSun\0"

-aric

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #17 from Qian Hong  2012-01-31 10:48:26 CST ---
Created attachment 38629
  --> http://bugs.winehq.org/attachment.cgi?id=38629
Log: +font trace for wine-1.3.36

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #18 from Qian Hong  2012-01-31 10:51:41 CST ---
(In reply to comment #16)
> (In reply to comment #15)
> > [Software\Microsoft\Windows NT\CurrentVersion\FontLink\SystemLink]
> > 1328028087
> >
> > (wine-1.3.36)
>
> Are there no entries below that?
>
> I have
>
> [Software\Microsoft\Windows NT\CurrentVersion\FontLink\SystemLink]
> 1328025661
> "Lucida Sans Unicode"=str(7):"msgothic.ttc,MS UI Gothic\0SimSun.ttf,SimSun\0"
> "Microsoft Sans Serif"=str(7):"msgothic.ttc,MS UI Gothic\0SimSun.ttf,SimSun\0"
> "Tahoma"=str(7):"msgothic.ttc,MS UI Gothic\0SimSun.ttf,SimSun\0"
>
> -aric

No, I don't have.
Is there anything wrong with my wine build? I build it from git source.

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #19 from Aric Stewart  2012-01-31 10:55:30 CST ---
(In reply to comment #18)
> (In reply to comment #16)
> > (In reply to comment #15)
> > > [Software\Microsoft\Windows NT\CurrentVersion\FontLink\SystemLink]
> > > 1328028087
> > >
> > > (wine-1.3.36)
> >
> > Are there no entries below that?
> >
> > I have
> >
> > [Software\Microsoft\Windows NT\CurrentVersion\FontLink\SystemLink]
> > 1328025661
> > "Lucida Sans Unicode"=str(7):"msgothic.ttc,MS UI Gothic\0SimSun.ttf,SimSun\0"
> > "Microsoft Sans Serif"=str(7):"msgothic.ttc,MS UI Gothic\0SimSun.ttf,SimSun\0"
> > "Tahoma"=str(7):"msgothic.ttc,MS UI Gothic\0SimSun.ttf,SimSun\0"
> >
> > -aric
>
> No, I don't have.
> Is there anything wrong with my wine build? I build it from git source.

Still looking,  It looks like the linking for Chinese is not being setup
correctly. I will investigate more. I can reproduce the removal of the links
here.

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

Ma Xiaojun  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[e-mail]

--- Comment #20 from Ma Xiaojun  2012-01-31 11:19:34 CST ---
I currently run two Linux VMs. One is LinuxDeepin 11.12 (LinuxDeepin is based
on Ubuntu, its current focus is computer users in China) and another is Fedora
16.

Their wines both have Qian Hong's issue at beginning.

LinuxDeepin have wine 1.3.28, zh_CN locale, after appending
"wqy-microhei.ttc,WenQuanYi Micro Hei" to "Tahoma" value, font linking magic
works. However, I'm not sure whether this wine is patched or not. You know,
there is, probably dirty, patch for better Chinese support.

Fedora have wine 1.3.37, en_US locale, the same trick doesn't work. However,
the newly created "Tahoma" value would automatically disappear after I have fun
with notepad.

I tried both `notepad` and `LANG=zh_CN notepad`

The Fedora wine also suffer from "err:ntdll:RtlDeleteResource Deleting active
MRSW lock (0x11249c), expect failure" every time. So I consider this wine
broken.

I'd try latest, canonical wine later.

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #21 from Ma Xiaojun  2012-01-31 11:24:57 CST ---
Created attachment 38630
  --> http://bugs.winehq.org/attachment.cgi?id=38630
Font Linking Magic In LinuxDeepin

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #22 from Dmitry Timoshkov  2012-01-31 11:29:11 CST ---
(In reply to comment #20)
> I tried both `notepad` and `LANG=zh_CN notepad`

Make sure that zh_CN locale really exists and works, I'd suggest using
zh_CN.UTF-8 instead.
> The Fedora wine also suffer from "err:ntdll:RtlDeleteResource Deleting active
> MRSW lock (0x11249c), expect failure" every time. So I consider this wine
> broken.

That's known problem, but it's harmless, just ignore it, this message
doesn't make your Wine "broken".

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #23 from Ma Xiaojun  2012-01-31 12:08:30 CST ---
locale -a | grep zh_CN

zh_CN
zh_CN.gb18030
zh_CN.gb2312
zh_CN.gbk
zh_CN.utf8

So I guess the zh_CN locales exist.

I cannot get my Fedora wine work. It still display square blocks as in Qian
Hong's origin report. And my Font Linking values just disappear after I use
notepad.

It would be nice if someone can give me some hints on things like debugging
channels.

I'd give up temporally. It's 2AM in my local time. I have class on 8:30AM.

[Bug 29735] Wine tahoma doesn't display Chinese

http://bugs.winehq.org/show_bug.cgi?id=29735

--- Comment #24 from Aric Stewart  2012-01-31 12:27:20 CST ---
(In reply to comment #23)
> locale -a | grep zh_CN
>
> zh_CN
> zh_CN.gb18030
> zh_CN.gb2312
> zh_CN.gbk
> zh_CN.utf8
>
> So I guess the zh_CN locales exist.
>
> I cannot get my Fedora wine work. It still display square blocks as in Qian
> Hong's origin report. And my Font Linking values just disappear after I use
> notepad.
>
> It would be nice if someone can give me some hints on things like debugging
> channels.
>
> I'd give up temporally. It's 2AM in my local time. I have class on 8:30AM.

I have updated http://bugs.winehq.org/show_bug.cgi?id=16325

I will move my efforts there.