[Bug 53738] New: Cherry MIDI sequencer cannot read files with a path including CJK characters

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53738

Bug ID: 53738
           Summary: Cherry MIDI sequencer cannot read files with a path
                    including CJK characters
           Product: Wine
           Version: 7.18
          Hardware: x86-64
                OS: Linux
            Status: UNCONFIRMED
          Severity: normal
          Priority: P2
         Component: -unknown
          Assignee: [e-mail]
          Reporter: [e-mail]
      Distribution: ---

Created attachment 73180
  --> https://bugs.winehq.org/attachment.cgi?id=73180
files can be opened (bgm_02.CHY) and cannot be opened (音楽_02.CHY). these files
are same except its filename.

A MIDI sequencer application "Cherry"
(http://hp.vector.co.jp/authors/VA010012/, its UI is in Japanese because of
Japanese developer) cannot open some files with a path including CKJ
characters.

When trying to open a file with CJK path, the app Cherry shows a dialog "File
reading error or a malformed file format" (in Japanese). When launch in
terminal with like "wine cherry.exe" then reproduce that behavior, but this app
does ntnot output any logs about that.

Detailed situations are like this:

- files with a name only with ASCII characters can be opened
- files with a name including CJK characters cannot be opened
- files with a name only with ASCII but in a directory with CJK characters
cannot be opened

These behaviors are reproduced in all published versions of Cherry in that
website :

- v1.4.3
- v1.5.2 (alpha)
- v1.5.3 (alpha)

And the locale info in my machine is here:

```
locale
LANG=ja_JP.UTF-8
LANGUAGE=ja:en_US:en
LC_CTYPE="ja_JP.UTF-8"
LC_NUMERIC=ja_JP.UTF-8
LC_TIME=ja_JP.UTF-8
LC_COLLATE=en_US.UTF-8
LC_MONETARY=ja_JP.UTF-8
LC_MESSAGES="ja_JP.UTF-8"
LC_PAPER=ja_JP.UTF-8
LC_NAME=ja_JP.UTF-8
LC_ADDRESS=ja_JP.UTF-8
LC_TELEPHONE=ja_JP.UTF-8
LC_MEASUREMENT=ja_JP.UTF-8
LC_IDENTIFICATION=ja_JP.UTF-8
LC_ALL=
```

I tried some launching way below with specifying locale but these behaviors are
reproduced:

- `LC_ALL=ja_JP.UTF-8 wine cherry.exe` and open CJK path files
- `LANG=ja_JP.UTF-8 wine cherry.exe` and open CJK path files

I feel this may not be a problem about WineHQ, may be simply a problem about my
locale settings, but I cannot resolve this so report as a bug.

[Bug 53738] Cherry MIDI sequencer cannot read files with a path including CJK characters

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53738

Sagawa  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |sagawa.aki+winebugs@gmail.c
                   |                            |om

--- Comment #1 from Sagawa  ---
Hello, Tanaka-san, thanks for reporting.
However, I can't reproduce this issue with Cherry 1.5.3 on my environment
[LANG=ja_JP.UTF-8].
Could you attach WINEDEBUG=file,msgbox log?

[Bug 53738] Cherry MIDI sequencer cannot read files with a path including CJK characters

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53738

--- Comment #2 from Shinichi Tanaka  ---
Created attachment 73224
  --> https://bugs.winehq.org/attachment.cgi?id=73224
a log file when opening CJK filename file with WINEDEBUG=file,msgbox on my
machine

[Bug 53738] Cherry MIDI sequencer cannot read files with a path including CJK characters

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53738

--- Comment #3 from Shinichi Tanaka  ---
Hi Sagawa-san, thanks for trying to reproduce this.

I attached a logs opening CJK-filename file with `WINEDEBUG=file,msgbox wine
cherry.exe`.

I hope that it helps to make clear its reason.

[Bug 53738] Cherry MIDI sequencer cannot read files with a path including CJK characters

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53738

Jactry Zeng  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[e-mail]

[Bug 53738] Cherry MIDI sequencer cannot read files with a path including CJK characters

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53738

--- Comment #4 from Rafał Mużyło  ---
There is something interesting in the log:

0024:trace:file:CreateFileW
L"Z:\home\grey\app\cherry_1\cherry-files\\97f3\697d_02.CH" GENERIC_READ
FILE_SHARE_READ FILE_SHARE_WRITE  creation 3 attributes 0x1

Note the name is a letter short. While debugstr_w does truncate its output, it
still has 300 byte buffer - that's nowhere near it.

In this log there seems to be nothing in between where the path has been
retrieved correctly in unix format and when it appears truncated in Windows
format.

Perhaps add 'nls' to WINEDEBUG ?

[Bug 53738] Cherry MIDI sequencer cannot read files with a path including CJK characters

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53738

--- Comment #5 from Rafał Mużyło  ---
...though:
> LC_COLLATE=en_US.UTF-8

Try setting that to Japanese too and see if that helps.

[Bug 53738] Cherry MIDI sequencer cannot read files with a path including CJK characters

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53738

--- Comment #6 from Shinichi Tanaka  ---
Created attachment 73254
  --> https://bugs.winehq.org/attachment.cgi?id=73254
a log file running cherry with WINEDEBUG=file,msgbox,nls

[Bug 53738] Cherry MIDI sequencer cannot read files with a path including CJK characters

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53738

--- Comment #7 from Shinichi Tanaka  ---
I attached a log file with adding 'nls' to WINEDEBUG.

How to open that CJK file by me is simple: drag & drop from the nautilus
(filer) to running cherry's window. And, and..., it is an surprising thing for
me, I found an interesting fact:

I can open that file with CJK path with the way; using "wine's (windows'?)
file open dialog" from "Open" in the menu.

(I often avoid that way because a difference between listed files/directories
name's displaying positions and actual hit areas when clicking, in the wine's
file dialog. I don't know that this is known issue or it's another problem in
my environment...)

[Bug 53738] Cherry MIDI sequencer cannot read files with a path including CJK characters

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53738

--- Comment #8 from Sagawa  ---
I can confirm the issue. Using drag & drop is a key.
I'm working on this. Stay tuned.

[Bug 53738] Cherry MIDI sequencer cannot read files with a path including CJK characters

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53738

--- Comment #9 from Sagawa  ---
I sent a merge request,
https://gitlab.winehq.org/wine/wine/-/merge_requests/1186 .

[Bug 53738] Cherry MIDI sequencer cannot read files with a path including CJK characters

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53738

--- Comment #10 from Sagawa  ---
This issue should be fixed by 9f61e1e593f69dee98921f172ca1e8880442d73c. Could
you retest with Wine 7.20?
If you can confirm, please update the status as RESOLVED FIXED.
Thanks in advance.

[Bug 53738] Cherry MIDI sequencer cannot read files with a path including CJK characters

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53738

Shinichi Tanaka  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
         Resolution|---                         |FIXED
             Status|UNCONFIRMED                 |RESOLVED

--- Comment #11 from Shinichi Tanaka  ---
I confirmed that this behavior is fixed with Wine 7.20 so I changed this
ticket's status to RESOLVED/FIXED.

Thanks very much!!

[Bug 53738] Cherry MIDI sequencer cannot read files with a path including CJK characters

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53738

Gijs Vermeulen  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
      Fixed by SHA1|                            |9f61e1e593f69dee98921f172ca
                   |                            |1e8880442d73c

[Bug 53738] Cherry MIDI sequencer cannot read files with a path including CJK characters

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53738

Alexandre Julliard  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|RESOLVED                    |CLOSED

--- Comment #12 from Alexandre Julliard  ---
Closing bugs fixed in 7.21.