[Bug 50239] New: The Legend of Heroes: Trails in the Sky Xvid movie playback lags and is very slow

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=50239

Bug ID: 50239
           Summary: The Legend of Heroes: Trails in the Sky Xvid movie
                    playback lags and is very slow
           Product: Wine
           Version: 5.22
          Hardware: x86-64
                OS: Linux
            Status: UNCONFIRMED
          Severity: normal
          Priority: P2
         Component: -unknown
          Assignee: [e-mail]
          Reporter: [e-mail]
      Distribution: Debian

Created attachment 68746
  --> https://bugs.winehq.org/attachment.cgi?id=68746
21M - +amstream,+quartz,+strmbase,+gstreamer,+qedit,+devenum,+timestamp log

Not the logo video, ed6_logo.avi (mpeg1), which plays on start, but the opening
video, ed6_op.avi (Xvid), after starting a new game takes over 8 minutes to
finish playing. The duration of the file is only 3:20. The audio which is
loaded from a separate file, ED6002.ogg, seems to play back normally in the
3:20.
Playing the video via gst-play works correctly and completes in the 3:20.

Disabling winegstreamer and using native quartz xvid amstream works around it.
As an aside the movie playback is much improved with just native quartz xvid
and winegstreamer disabled finishing at about 3:40 (+20s). I assume that's not
that interesting of a case though.

This is with an older GOG build of the game before XSEED re-encoded the video.
The newer version takes even longer.

Nothing related in the default terminal output. Attached is a
+amstream,+quartz,+strmbase,+gstreamer,+qedit,+devenum,+timestamp log - 21M
uncompressed.

[Bug 50239] The Legend of Heroes: Trails in the Sky Xvid movie playback lags and is very slow

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=50239

--- Comment #1 from Aexander  ---
Video playback starts at/after line 59335 in the log.

[Bug 50239] The Legend of Heroes: Trails in the Sky Xvid movie playback lags and is very slow

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=50239

Lunknown  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[e-mail]

--- Comment #2 from Lunknown  ---
This is still an issue with wine-6.0rc3.

[Bug 50239] The Legend of Heroes: Trails in the Sky Xvid movie playback lags and is very slow

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=50239

soredake  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[e-mail]

[Bug 50239] The Legend of Heroes: Trails in the Sky Xvid movie playback lags and is very slow

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=50239

Zebediah Figura  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[e-mail]

--- Comment #3 from Zebediah Figura  ---
Things like this are a little disturbing:

1681628.412:0174:trace:gstreamer:got_data_sink 0xdabc5448 0xe82fb738
...
1681628.428:0174:trace:gstreamer:got_data_sink sending sample returned:
00000000
...
1681628.499:0178:trace:gstreamer:got_data_sink 0xdabc5448 0xe82fb738

GStreamer is taking ~59 ms to process what should be a ~30 FPS video; i.e. it
should take less than 33 ms (and ideally far less).

(separately, that 16 ms latency entirely in amstream is a little disturbing; I
wouldn't have expected it to be that high. of course the timestamps are not
very precise, but even then...)

Can you please attach a log with the same channels, but also GST_DEBUG=6? I
don't need the full video to be played, just a handful of frames; it does seem
like *every* frame is arriving way too late.

[Bug 50239] The Legend of Heroes: Trails in the Sky Xvid movie playback lags and is very slow

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=50239

--- Comment #4 from Lunknown  ---
Created attachment 68972
  --> https://bugs.winehq.org/attachment.cgi?id=68972
Trails+wine-6.0rc3+DEBUGChannels.txt

[Bug 50239] The Legend of Heroes: Trails in the Sky Xvid movie playback lags and is very slow

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=50239

--- Comment #5 from Lunknown  ---
(In reply to Zebediah Figura from comment #3)
> Things like this are a little disturbing:
>
> 1681628.412:0174:trace:gstreamer:got_data_sink 0xdabc5448 0xe82fb738
> ...
> 1681628.428:0174:trace:gstreamer:got_data_sink sending sample returned:
> 00000000
> ...
> 1681628.499:0178:trace:gstreamer:got_data_sink 0xdabc5448 0xe82fb738
>
> GStreamer is taking ~59 ms to process what should be a ~30 FPS video; i.e.
> it should take less than 33 ms (and ideally far less).
>
> (separately, that 16 ms latency entirely in amstream is a little disturbing;
> I wouldn't have expected it to be that high. of course the timestamps are
> not very precise, but even then...)
>
> Can you please attach a log with the same channels, but also GST_DEBUG=6? I
> don't need the full video to be played, just a handful of frames; it does
> seem like *every* frame is arriving way too late.

Ok i just uploaded the file.

[Bug 50239] The Legend of Heroes: Trails in the Sky Xvid movie playback lags and is very slow

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=50239

--- Comment #6 from Zebediah Figura  ---
That doesn't seem to include GStreamer debug output. What command line are you
using to create that file?

[Bug 50239] The Legend of Heroes: Trails in the Sky Xvid movie playback lags and is very slow

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=50239

Lunknown  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
  Attachment #68972|0                           |1
        is obsolete|                            |

--- Comment #7 from Lunknown  ---
Created attachment 68974
  --> https://bugs.winehq.org/attachment.cgi?id=68974
Trails+GST_DEBUG-wine-6.0rc3.txt.bz2

Sorry about that. This new attachment should be the correct. I thought that
GST_DEBUG was part of WINEDEBUG.

[Bug 50239] The Legend of Heroes: Trails in the Sky Xvid movie playback lags and is very slow

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=50239

--- Comment #8 from Lunknown  ---
(In reply to Zebediah Figura from comment #6)
> That doesn't seem to include GStreamer debug output. What command line are
> you using to create that file?

Sorry about that. This new attachment should be the correct. I thought that
GST_DEBUG was part of WINEDEBUG.

[Bug 50239] Multiple 32-bit applications have slow or lagging video due to slow YUV -> RGB conversion in GStreamer (The Legend of Heroes: Trails in the Sky, Blazblue Centralfiction)

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=50239

Zebediah Figura  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
            Summary|The Legend of Heroes:       |Multiple 32-bit
                   |Trails in the Sky Xvid      |applications have slow or
                   |movie playback lags and is  |lagging video due to slow
                   |very slow                   |YUV -> RGB conversion in
                   |                            |GStreamer (The Legend of
                   |                            |Heroes: Trails in the Sky,
                   |                            |Blazblue Centralfiction)
     Ever confirmed|0                           |1
             Status|UNCONFIRMED                 |NEW
          Component|-unknown                    |winegstreamer

--- Comment #9 from Zebediah Figura  ---
0:01:22.441406537  7455 0xf530c880 DEBUG        GST_PERFORMANCE
gstvideoconvert.c:725:gst_video_convert_transform_frame:<videoconvert3> doing
colorspace conversion from I420 -> to BGRx
0:01:22.469797927  7455 0xf530c880 LOG               GST_BUFFER
gstbuffer.c:760:_gst_buffer_dispose: release 0xe865c000 to pool 0xea29fe58

Yeah, I was afraid of something like this.

videoconvert is far too slow—28 ms per frame. It's a problem only for the
second video because it's much larger (1920x960 vs 640x320). The main reason
it's slow is that it's being done all in slow, SISD software. Normally it'd go
through SIMD via liborc—in fact, it would, in 64-bit—but the I420 -> ARGB
conversion needs more than 8 registers, and liborc can't spill them.

I think the solution is to improve liborc, either by helping it use less
registers, or by implementing spilling.

I've observed this problem in another game, Blazblue Centralfiction. In that
case the video isn't extremely slow, but it does drop many frames due to
GStreamer's internal QoS handling.

[Bug 50239] Multiple 32-bit applications have slow or lagging video due to slow YUV -> RGB conversion in GStreamer (The Legend of Heroes: Trails in the Sky, Blazblue Centralfiction)

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=50239

Bill Fleming  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[e-mail]

--- Comment #10 from Bill Fleming  ---
Created attachment 71465
  --> https://bugs.winehq.org/attachment.cgi?id=71465
Trails Sky 3rd save game to trigger video

First run the Config3_DX9.exe to setup the game and a controller. Then
afterwords you can launch the ed6_win3_DX9.exe directly to get gstreamer logs
easily.
Put the game saves in drive_c/users/bill/Saved Games. From the load menu load
save 2. Then walk to the character to the left. A fight will start. Kick their
ass with craft->mortal punishment attack or just attack command. Then hold down
right trigger and press A and B to skip dialog until the character jumps out
the window of the airship. Then turn off fast forward mode and continue the
dialog. The video will then play as the ship flys away. It should look like
this: https://www.youtube.com/watch?v=Kw1USqOL5Os
https://store.steampowered.com/app/436670/The_Legend_of_Heroes_Trails_in_the...

[Bug 50239] Multiple 32-bit applications have slow or lagging video due to slow YUV -> RGB conversion in GStreamer (The Legend of Heroes: Trails in the Sky, Blazblue Centralfiction)

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=50239

--- Comment #11 from Bill Fleming  ---
Log is too fat to fit on bug tracker. It ate too many Christmas cookies.
https://drive.google.com/file/d/1bXFv5bTeGTlgZ9iHeGIbmthAnGIgRqNE/view?usp=s...
WINEDEBUG=+quartz,+gstreamer GST_DEBUG=6 log in wine-7.0-rc3.
On Trails in the Sky the 3rd game.
Make sure to use 32-bit prefix.

[Bug 50239] Multiple 32-bit applications have slow or lagging video due to slow YUV -> RGB conversion in GStreamer (The Legend of Heroes: Trails in the Sky, Blazblue Centralfiction)

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=50239

--- Comment #12 from Zebediah Figura  ---
Thanks, but I don't think new logs are useful; the cause is known.

[Bug 50239] Multiple 32-bit applications have slow or lagging video due to slow YUV -> RGB conversion in GStreamer (The Legend of Heroes: Trails in the Sky, Blazblue Centralfiction)

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=50239

soredake  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|broaden_acid002@simplelogin |
                   |.com                        |