[Bug 53972] New: BCryptSignHash does not support BCRYPT_PAD_PSS

[WineHQ Bugzilla]

https://bugs.winehq.org/show_bug.cgi?id=53972

Bug ID: 53972
           Summary: BCryptSignHash does not support BCRYPT_PAD_PSS
           Product: Wine
           Version: 7.21
          Hardware: x86-64
                OS: Linux
            Status: UNCONFIRMED
          Severity: normal
          Priority: P2
         Component: bcrypt
          Assignee: [e-mail]
          Reporter: [e-mail]
      Distribution: ---

Using Ubuntu 22.04 x64, from-source build as of 2022-11-23 (wine-7.21) + fix
from bug 53966 + fix from bug 53968 comment 1.

Please note that the patches from above is required to get this far in the
reproduction.

The .NET API RSA.SignData() calls into NCryptSignHash which calls into
BCryptSignHash which does not support BCRYPT_PAD_PSS. Using .NET 6.0.

Fixing this would unblock bug 53968.

See bug 53968 for more information about reproduction and terminal output from
the state before the partial fix - I hope that is okay.

This API is used in many applications signing messages with their own
cryptographic RSA keys. We ran across it when testing one of our own
applications.