Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Accuracy] MSclap model accuracy issue (CPU vs QNN EP (NPU) ) #23394

Open
mvijayakquic opened this issue Jan 16, 2025 · 0 comments
Open

[Accuracy] MSclap model accuracy issue (CPU vs QNN EP (NPU) ) #23394

mvijayakquic opened this issue Jan 16, 2025 · 0 comments
Labels
ep:QNN issues related to QNN exeution provider

Comments

@mvijayakquic
Copy link

Describe the issue

I have exported the MS Clap model into ONNX and run it on both the CPU and NPU. However, there is an accuracy discrepancy between the CPU and NPU results. Here is the setup I used:

  • Python: 3.10
  • ORT: onnxruntime-qnn version 1.20.0
  • MS Clap model: 2023

To reproduce

We have uploaded the script to export and compare the results, the model, as well as testdata.npy.
Please help us debug the issue and let me know if you

MSClap.zip

Urgency

ASAP

Platform

Windows

OS Version

11

ONNX Runtime Installation

Released Package

ONNX Runtime Version or Commit ID

ONNX Runtime QNN v1.20.0

ONNX Runtime API

Python

Architecture

ARM64

Execution Provider

Other / Unknown

Execution Provider Library Version

ONNX Runtime QNN v1.20.0

@github-actions github-actions bot added the ep:QNN issues related to QNN exeution provider label Jan 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ep:QNN issues related to QNN exeution provider
Projects
None yet
Development

No branches or pull requests

1 participant