YOLOv9-Detection: Optimized for Qualcomm Devices

Ultralytics YOLOv9 is a machine learning model that predicts bounding boxes and classes of objects in an image.

This is based on the implementation of YOLOv9-Detection found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for YOLOv9-Detection on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.object_detection

Model Stats:

  • Model checkpoint: YOLOv9-T
  • Input resolution: 640x640
  • Model size (float): 8.84 MB
  • Model size (w8a8): 3.23 MB
  • Model size (w8a8_mixed_int16): 3.74 MB
  • Model size (w8a16): 3.25 MB

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
YOLOv9-Detection ONNX float Snapdragon® 8 Elite Gen 5 Mobile 3.45 ms 1 - 224 MB NPU
YOLOv9-Detection ONNX float Snapdragon® X2 Elite 3.957 ms 207 - 207 MB NPU
YOLOv9-Detection ONNX float Snapdragon® X Elite 10.8 ms 171 - 171 MB NPU
YOLOv9-Detection ONNX float Snapdragon® 8 Gen 3 Mobile 7.68 ms 5 - 255 MB NPU
YOLOv9-Detection ONNX float Qualcomm® QCS8550 (Proxy) 10.528 ms 3 - 77 MB NPU
YOLOv9-Detection ONNX float Snapdragon® 8 Elite For Galaxy Mobile 4.438 ms 0 - 212 MB NPU
YOLOv9-Detection ONNX float Qualcomm® QCS9075 10.668 ms 2 - 50 MB NPU
YOLOv9-Detection ONNX float Qualcomm® QCS8750 4.438 ms 0 - 212 MB NPU
YOLOv9-Detection ONNX float Qualcomm® QCS7181 10.8 ms 171 - 171 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 91.542 ms 3 - 140 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® X2 Elite 90.993 ms 210 - 210 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® X Elite 309.289 ms 177 - 177 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 224.476 ms 2 - 171 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS6490 466.524 ms 81 - 87 MB CPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS8550 (Proxy) 295.102 ms 1 - 49 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 197.94 ms 81 - 94 MB CPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Elite For Galaxy Mobile 98.647 ms 0 - 133 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCM6690 217.636 ms 82 - 99 MB CPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS9075 185.166 ms 1 - 47 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS7790 197.94 ms 81 - 94 MB CPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS8750 98.647 ms 0 - 133 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS7181 309.289 ms 177 - 177 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 110.789 ms 8 - 112 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® X2 Elite 110.708 ms 211 - 211 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® X Elite 187.817 ms 154 - 154 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 136.95 ms 2 - 127 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS6490 100.9 ms 21 - 35 MB CPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS8550 (Proxy) 178.5 ms 0 - 138 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS9075 190.147 ms 0 - 47 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 56.66 ms 21 - 40 MB CPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Elite For Galaxy Mobile 113.074 ms 2 - 104 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCM6690 61.322 ms 26 - 45 MB CPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS7790 56.66 ms 21 - 40 MB CPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS8750 113.074 ms 2 - 104 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS7181 187.817 ms 154 - 154 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 2.765 ms 4 - 209 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® X2 Elite 3.504 ms 5 - 5 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® X Elite 8.736 ms 5 - 5 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Gen 3 Mobile 5.953 ms 5 - 239 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS8275 21.628 ms 1 - 204 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS8550 (Proxy) 8.083 ms 5 - 6 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA8775P 10.471 ms 0 - 207 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA8650P 10.471 ms 0 - 207 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA8255P 10.471 ms 0 - 207 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 3.146 ms 0 - 207 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS8450 (Proxy) 13.911 ms 4 - 235 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA7255P 21.628 ms 1 - 204 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS9075 8.933 ms 5 - 11 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA8295P 13.387 ms 0 - 202 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS8750 3.146 ms 0 - 207 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS7181 8.736 ms 5 - 5 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 79.722 ms 10 - 108 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® X2 Elite 80.196 ms 2 - 2 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® X Elite 224.565 ms 2 - 2 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 165.701 ms 2 - 121 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS6490 404.012 ms 1 - 5 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS8275 447.273 ms 1 - 93 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS8550 (Proxy) 214.482 ms 3 - 4 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA8775P 235.151 ms 1 - 95 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA8650P 235.151 ms 1 - 95 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA8255P 235.151 ms 1 - 95 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 285.869 ms 3 - 215 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Elite For Galaxy Mobile 114.446 ms 2 - 98 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCM6690 561.979 ms 2 - 204 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA7255P 447.273 ms 1 - 93 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA8295P 300.91 ms 2 - 98 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS9075 182.62 ms 4 - 8 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS8450 (Proxy) 357.565 ms 2 - 120 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS7790 285.869 ms 3 - 215 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS8750 114.446 ms 2 - 98 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS7181 224.565 ms 2 - 2 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 110.629 ms 1 - 66 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® X2 Elite 100.829 ms 1 - 1 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® X Elite 175.902 ms 1 - 1 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 136.066 ms 2 - 84 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS6490 407.139 ms 2 - 5 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS8550 (Proxy) 167.027 ms 1 - 5 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA8775P 170.722 ms 2 - 66 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA8650P 170.722 ms 2 - 66 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA8255P 170.722 ms 2 - 66 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS9075 189.898 ms 0 - 3 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS8450 (Proxy) 238.026 ms 1 - 81 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 176.163 ms 1 - 64 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Elite For Galaxy Mobile 133.392 ms 2 - 63 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCM6690 510.345 ms 1 - 186 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA8295P 202.944 ms 1 - 62 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS7790 176.163 ms 1 - 64 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS8750 133.392 ms 2 - 63 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS7181 175.902 ms 1 - 1 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 2.273 ms 0 - 114 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Gen 3 Mobile 5.581 ms 0 - 126 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS8275 21.058 ms 0 - 95 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS8550 (Proxy) 7.696 ms 0 - 3 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA8775P 10.222 ms 0 - 107 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA8650P 10.222 ms 0 - 107 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA8255P 10.222 ms 0 - 107 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 2.965 ms 0 - 104 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS8450 (Proxy) 11.939 ms 0 - 111 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA7255P 21.058 ms 0 - 95 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS9075 8.541 ms 0 - 14 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA8295P 12.862 ms 0 - 76 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS8750 2.965 ms 0 - 104 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 110.443 ms 0 - 65 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 136.584 ms 0 - 81 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS6490 392.652 ms 0 - 7 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS8275 347.328 ms 0 - 61 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS8550 (Proxy) 167.233 ms 0 - 2 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8775P 182.867 ms 0 - 63 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8650P 182.867 ms 0 - 63 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8255P 182.867 ms 0 - 63 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS9075 190.179 ms 0 - 7 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS8450 (Proxy) 238.036 ms 0 - 78 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 179.26 ms 0 - 59 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Elite For Galaxy Mobile 133.399 ms 1 - 61 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCM6690 500.115 ms 0 - 185 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8295P 202.782 ms 0 - 58 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA7255P 347.328 ms 0 - 61 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS7790 179.26 ms 0 - 59 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS8750 133.399 ms 1 - 61 MB NPU

License

  • The license for the original implementation of YOLOv9-Detection can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support