[Bug 34738] New: PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

Bug #: 34738
           Summary: PageFault when generating a MD5 Hash
           Product: Wine
           Version: unspecified
          Platform: x86-64
        OS/Version: Linux
            Status: UNCONFIRMED
          Severity: normal
          Priority: P2
         Component: advapi32
        AssignedTo: [e-mail]
        ReportedBy: [e-mail]
    Classification: Unclassified

Just updating my tools to be linux compatible, but this was stopping my
progress.

[Bug 34738] PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

--- Comment #1 from Glenn Chugg  2013-10-16 00:59:51 CDT ---
Created attachment 46314
  --> http://bugs.winehq.org/attachment.cgi?id=46314
Backtrace of crash

[Bug 34738] PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

Nikolay Sivov  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
            Version|unspecified                 |1.6

--- Comment #2 from Nikolay Sivov  2013-10-16 01:19:16 CDT ---
Could you attach a sample source code and +crypt trace?

[Bug 34738] PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

--- Comment #3 from Glenn Chugg  2013-10-16 03:16:01 CDT ---
I'll need to trace through someone elses code, but I'll post it as soon as I
find the causing call... It's written in AutoIt, so quite easy to work with.

Not sure what a +crypt trace is or how to capture it for you tho? maybe the
code will help, give me a hour or two to find the problem call.

[Bug 34738] PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

--- Comment #4 from Austin English  2013-10-16 03:21:04 CDT ---
(In reply to comment #3)
> I'll need to trace through someone elses code, but I'll post it as soon as I
> find the causing call... It's written in AutoIt, so quite easy to work with.
>
> Not sure what a +crypt trace is or how to capture it for you tho? maybe the
> code will help, give me a hour or two to find the problem call.

WINEDEBUG=+crypt wine foo.exe >> log.txt 2>&1

(see also http://wiki.winehq.org/FAQ#debug_trace)

[Bug 34738] PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

--- Comment #5 from Nikolay Sivov  2013-10-16 03:23:28 CDT ---
It's described here http://wiki.winehq.org/FAQ#get_log, section 10.2. Crash is
in CryptHashData() obviously. Is this a thing you're trying to run
http://www.lastos.org/tools.html?

[Bug 34738] PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

--- Comment #6 from Glenn Chugg  2013-10-16 04:00:49 CDT ---
Created attachment 46315
  --> http://bugs.winehq.org/attachment.cgi?id=46315
Test Case

The attached file is a test case, I included the Crypt.au3 so you can read the
actual api calls without needing AutoIt to run the proper test. Just run the
EXE and it'll try to calculate the hash of C:\Windows\Notepad.exe, and causes
the same crash specified in this bug report.

[Bug 34738] PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

--- Comment #7 from Glenn Chugg  2013-10-16 04:12:32 CDT ---
Created attachment 46316
  --> http://bugs.winehq.org/attachment.cgi?id=46316
Here is the +crypt trace

Hope this helps :)

[Bug 34738] PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

Glenn Chugg  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[e-mail]

[Bug 34738] PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

--- Comment #8 from Glenn Chugg  2013-10-16 04:27:14 CDT ---
Yeah the LastOS tools are what I am working on making compatible with WINE
again, I used to support Linux, but I found earlier versions of WINE to be very
temperamental with our tools, v1.6+ works great tho, I am amazed how far WINE
has come lately.

Let me know if I can do anything else to help fix this ASAP, I only code in
Basic and Scripting languages so nothing to complex.

[Bug 34738] PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

--- Comment #9 from Nikolay Sivov  2013-10-17 06:41:14 CDT ---
Could you attach a 32-bit executable for this test? I'm having troubles
building 64-bit wine at the moment.

[Bug 34738] PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

--- Comment #10 from Glenn Chugg  2013-10-17 07:54:26 CDT ---
Created attachment 46330
  --> http://bugs.winehq.org/attachment.cgi?id=46330
This has the compiled x86 .exe for the test case

[Bug 34738] PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

Nikolay Sivov  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|UNCONFIRMED                 |NEW
     Ever Confirmed|0                           |1

--- Comment #11 from Nikolay Sivov  2013-10-17 11:16:33 CDT ---
The problem is CryptHashData() call at provider side. Application calls it with
CRYPT_USERDATA flag and RSAENH provider fails if flags are not zero:

---
RSAENH_CPHashData(...)
---
    if (dwFlags)
    {
        SetLastError(NTE_BAD_FLAGS);
        return FALSE;
    }
---

If this check is removed it no longer crashes, but doesn't do anything useful
either, but after looking at script I think it's intentional.

I'll add some tests for that call first, let's see how it goes. Confirming.

[Bug 34738] PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

Nikolay Sivov  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
          Component|advapi32                    |rsaenh

[Bug 34738] PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

Nikolay Sivov  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
      Fixed by SHA1|                            |bfd2c533beef454a61b24f92790
                   |                            |f91099e607365
             Status|NEW                         |RESOLVED
         Resolution|                            |FIXED

--- Comment #12 from Nikolay Sivov  2013-10-18 15:11:15 CDT ---
This is fixed in git now, commit bfd2c533beef454a61b24f92790f91099e607365.

[Bug 34738] PageFault when generating a MD5 Hash

http://bugs.winehq.org/show_bug.cgi?id=34738

Alexandre Julliard  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|RESOLVED                    |CLOSED

--- Comment #13 from Alexandre Julliard  2013-10-25 12:54:35 CDT ---
Closing bugs fixed in 1.7.5.

[Bug 34738] PageFault when generating a MD5 Hash

https://bugs.winehq.org/show_bug.cgi?id=34738

Alexandre Julliard  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
   Target Milestone|---                         |1.6.x

[Bug 34738] PageFault when generating a MD5 Hash

https://bugs.winehq.org/show_bug.cgi?id=34738

Alexandre Julliard  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
   Target Milestone|1.6.x                       |---

--- Comment #14 from Alexandre Julliard  ---
Removing 1.6.x milestone from bugs included in 1.6.2.