EdgeTAM: Optimized for Qualcomm Devices
EdgeTAM is a lightweight and efficient version of SAM 2, optimized for on-device tracking and segmenting any object in videos and low memory usage by using a novel 2D Spatial Perceiver and RepViT backbone.
This is based on the implementation of EdgeTAM found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.
Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.
Getting Started
There are two ways to deploy this model on your device:
Option 1: Download Pre-Exported Models
Below are pre-exported model assets ready for deployment.
| Runtime | Precision | Chipset | SDK Versions | Download |
|---|---|---|---|---|
| ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | Download |
| ONNX | w8a8 | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | Download |
| QNN_DLC | float | Universal | QAIRT 2.45 | Download |
| QNN_DLC | w8a8 | Universal | QAIRT 2.45 | Download |
| TFLITE | float | Universal | QAIRT 2.45 | Download |
| TFLITE | w8a8 | Universal | QAIRT 2.45 | Download |
For more device-specific assets and performance metrics, visit EdgeTAM on Qualcomm® AI Hub.
Option 2: Export with Custom Configurations
Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations
This option is ideal if you need to customize the model beyond the default configuration provided here.
See our repository for EdgeTAM on GitHub for usage instructions.
Model Details
Model Type: Model_use_case.semantic_segmentation
Model Stats:
- Model checkpoint: edgetam.pt
- Input resolution (Encoder): 1024x1024
- Number of parameters (encoder): 8.3M
- Model size (encoder) (float): 33 MB
- Number of parameters (memory_encoder): 1.2M
- Model size (memory_encoder) (float): 4.6 MB
- Number of parameters (video_decoder): 6.22M
- Model size (video_decoder) (float): 23.7 MB
Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit |
|---|---|---|---|---|---|---|
| encoder | ONNX | float | Snapdragon® X2 Elite | 8.833 ms | 70 - 70 MB | NPU |
| encoder | ONNX | float | Snapdragon® X Elite | 17.873 ms | 70 - 70 MB | NPU |
| encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 14.067 ms | 47 - 394 MB | NPU |
| encoder | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 91.154 ms | 3 - 414 MB | NPU |
| encoder | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 18.011 ms | 48 - 50 MB | NPU |
| encoder | ONNX | float | Qualcomm® QCS8450 | 91.154 ms | 3 - 414 MB | NPU |
| encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 23.122 ms | 12 - 15 MB | NPU |
| encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 17.873 ms | 70 - 70 MB | NPU |
| encoder | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 9.541 ms | 44 - 357 MB | NPU |
| encoder | ONNX | float | Snapdragon® 8 Elite Mobile | 9.541 ms | 44 - 357 MB | NPU |
| encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 7.981 ms | 44 - 381 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® X2 Elite | 3.144 ms | 18 - 18 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® X Elite | 8.268 ms | 18 - 18 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 5.368 ms | 14 - 309 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2242.426 ms | 4 - 323 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4475.73 ms | 3 - 6 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.941 ms | 10 - 16 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® QCS8450 | 2242.426 ms | 4 - 323 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 8.411 ms | 13 - 16 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 8.268 ms | 18 - 18 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 4.485 ms | 12 - 272 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 4.485 ms | 12 - 272 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.037 ms | 1 - 279 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® X2 Elite | 10.373 ms | 12 - 12 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® X Elite | 23.494 ms | 12 - 12 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 16.934 ms | 6 - 343 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 99.518 ms | 12 - 422 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8275 | 68.706 ms | 17 - 277 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 23.012 ms | 12 - 14 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® SA8775P | 27.492 ms | 0 - 258 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® SA8650P | 27.492 ms | 0 - 258 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® SA8255P | 27.492 ms | 0 - 258 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® QCS8450 | 99.518 ms | 12 - 422 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 28.948 ms | 12 - 46 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 23.494 ms | 12 - 12 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 11.663 ms | 11 - 288 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® SA7255P | 68.706 ms | 17 - 277 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® SA8295P | 53.547 ms | 0 - 335 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 11.663 ms | 11 - 288 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 8.951 ms | 12 - 314 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 4.293 ms | 3 - 3 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 11.677 ms | 3 - 3 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 7.34 ms | 3 - 302 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2266.154 ms | 3 - 325 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4540.687 ms | 3 - 12 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 20.15 ms | 3 - 260 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 10.89 ms | 3 - 5 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 11.599 ms | 3 - 259 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8650P | 11.599 ms | 3 - 259 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8255P | 11.599 ms | 3 - 259 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 2266.154 ms | 3 - 325 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 13.72 ms | 0 - 10 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 11.677 ms | 3 - 3 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 54.705 ms | 5 - 238 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 11.474 ms | 3 - 264 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 4.523 ms | 3 - 251 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 20.15 ms | 3 - 260 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2125.515 ms | 1 - 280 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 4.523 ms | 3 - 251 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.779 ms | 3 - 269 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 11.474 ms | 3 - 264 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 16.656 ms | 20 - 371 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 100.989 ms | 0 - 418 MB | NPU |
| encoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8275 | 68.748 ms | 20 - 285 MB | NPU |
| encoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 23.003 ms | 20 - 39 MB | NPU |
| encoder | TFLITE | float | Qualcomm® SA8775P | 27.589 ms | 20 - 285 MB | NPU |
| encoder | TFLITE | float | Qualcomm® SA8650P | 27.589 ms | 20 - 285 MB | NPU |
| encoder | TFLITE | float | Qualcomm® SA8255P | 27.589 ms | 20 - 285 MB | NPU |
| encoder | TFLITE | float | Qualcomm® QCS8450 | 100.989 ms | 0 - 418 MB | NPU |
| encoder | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 28.764 ms | 0 - 46 MB | NPU |
| encoder | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 11.636 ms | 19 - 306 MB | NPU |
| encoder | TFLITE | float | Qualcomm® SA7255P | 68.748 ms | 20 - 285 MB | NPU |
| encoder | TFLITE | float | Qualcomm® SA8295P | 53.506 ms | 20 - 365 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 11.636 ms | 19 - 306 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 8.952 ms | 20 - 321 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 4.799 ms | 3 - 301 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2252.678 ms | 2 - 327 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4541.95 ms | 0 - 24 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 13.689 ms | 5 - 260 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.068 ms | 5 - 7 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® SA8775P | 7.833 ms | 5 - 260 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® SA8650P | 7.833 ms | 5 - 260 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® SA8255P | 7.833 ms | 5 - 260 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® QCS8450 | 2252.678 ms | 2 - 327 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 7.529 ms | 2 - 19 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 68.192 ms | 5 - 235 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 8.209 ms | 5 - 260 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 2.964 ms | 4 - 249 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® SA7255P | 13.689 ms | 5 - 260 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® SA8295P | 2095.818 ms | 1 - 281 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 2.964 ms | 4 - 249 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 2.66 ms | 0 - 262 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 8.209 ms | 5 - 260 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® X2 Elite | 10.393 ms | 8 - 8 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® X Elite | 24.795 ms | 8 - 8 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 19.513 ms | 8 - 447 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 39.947 ms | 8 - 334 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 24.898 ms | 8 - 333 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® QCS8450 | 39.947 ms | 8 - 334 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 35.317 ms | 8 - 11 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 24.795 ms | 8 - 8 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 10.737 ms | 2 - 285 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Elite Mobile | 10.737 ms | 2 - 285 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 9.758 ms | 2 - 296 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® X2 Elite | 3.054 ms | 2 - 2 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® X Elite | 6.028 ms | 2 - 2 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 3.887 ms | 2 - 217 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 11.375 ms | 2 - 344 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 37.721 ms | 2 - 5 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 5.803 ms | 1 - 114 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® QCS8450 | 11.375 ms | 2 - 344 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 6.252 ms | 2 - 5 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 6.028 ms | 2 - 2 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 4.212 ms | 1 - 296 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 4.212 ms | 1 - 296 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.691 ms | 0 - 298 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® X2 Elite | 10.191 ms | 8 - 8 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® X Elite | 19.855 ms | 8 - 8 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 13.454 ms | 2 - 531 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 29.498 ms | 4 - 404 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8275 | 44.849 ms | 0 - 316 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 18.732 ms | 8 - 11 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® SA8775P | 20.808 ms | 0 - 357 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® SA8650P | 20.808 ms | 0 - 357 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® SA8255P | 20.808 ms | 0 - 357 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® QCS8450 | 29.498 ms | 4 - 404 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 20.881 ms | 8 - 18 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 19.855 ms | 8 - 8 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 10.58 ms | 4 - 323 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® SA7255P | 44.849 ms | 0 - 316 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® SA8295P | 23.474 ms | 0 - 366 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 10.58 ms | 4 - 323 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 9.221 ms | 4 - 315 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 3.08 ms | 2 - 2 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 6.697 ms | 2 - 2 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 4.071 ms | 0 - 236 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 7.907 ms | 0 - 198 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 37.0 ms | 1 - 5 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 11.38 ms | 2 - 168 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 6.038 ms | 2 - 4 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 6.696 ms | 2 - 169 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8650P | 6.696 ms | 2 - 169 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8255P | 6.696 ms | 2 - 169 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 7.907 ms | 0 - 198 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 6.439 ms | 1 - 4 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 6.697 ms | 2 - 2 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 47.682 ms | 2 - 324 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 7.471 ms | 1 - 312 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 3.061 ms | 1 - 173 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 11.38 ms | 2 - 168 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 7.897 ms | 2 - 183 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 3.061 ms | 1 - 173 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 2.598 ms | 1 - 189 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 7.471 ms | 1 - 312 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 19.592 ms | 0 - 364 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 37.949 ms | 0 - 321 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8275 | 53.245 ms | 0 - 310 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 24.823 ms | 0 - 3 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® SA8775P | 28.711 ms | 0 - 311 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® SA8650P | 28.711 ms | 0 - 311 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® SA8255P | 28.711 ms | 0 - 311 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® QCS8450 | 37.949 ms | 0 - 321 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 29.135 ms | 0 - 16 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 16.048 ms | 0 - 319 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® SA7255P | 53.245 ms | 0 - 310 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® SA8295P | 33.501 ms | 0 - 289 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 16.048 ms | 0 - 319 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 9.939 ms | 0 - 305 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 6.281 ms | 0 - 254 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 13.376 ms | 1 - 252 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 113.201 ms | 10 - 52 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 17.743 ms | 1 - 228 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 8.824 ms | 1 - 4 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA8775P | 10.102 ms | 1 - 228 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA8650P | 10.102 ms | 1 - 228 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA8255P | 10.102 ms | 1 - 228 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® QCS8450 | 13.376 ms | 1 - 252 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 9.589 ms | 1 - 9 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 70.994 ms | 10 - 236 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 32.376 ms | 10 - 196 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 4.657 ms | 0 - 237 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA7255P | 17.743 ms | 1 - 228 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA8295P | 12.332 ms | 1 - 231 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 4.657 ms | 0 - 237 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 4.031 ms | 1 - 241 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 32.376 ms | 10 - 196 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® X2 Elite | 3.361 ms | 16 - 16 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® X Elite | 7.135 ms | 16 - 16 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 5.062 ms | 17 - 278 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 15.432 ms | 17 - 268 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.253 ms | 16 - 20 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® QCS8450 | 15.432 ms | 17 - 268 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 8.283 ms | 16 - 19 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 7.135 ms | 16 - 16 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 3.987 ms | 3 - 218 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Elite Mobile | 3.987 ms | 3 - 218 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.473 ms | 3 - 225 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® X2 Elite | 1.627 ms | 4 - 4 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® X Elite | 3.603 ms | 4 - 4 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 2.291 ms | 4 - 221 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 4.29 ms | 4 - 171 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 14.04 ms | 4 - 7 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 3.409 ms | 2 - 163 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® QCS8450 | 4.29 ms | 4 - 171 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 4.565 ms | 4 - 7 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 3.603 ms | 4 - 4 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.844 ms | 0 - 134 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 1.844 ms | 0 - 134 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 1.544 ms | 1 - 163 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® X2 Elite | 3.406 ms | 16 - 16 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® X Elite | 6.073 ms | 16 - 16 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 4.107 ms | 3 - 249 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 9.23 ms | 4 - 229 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8275 | 13.563 ms | 16 - 239 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 5.898 ms | 10 - 13 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® SA8775P | 7.17 ms | 16 - 236 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® SA8650P | 7.17 ms | 16 - 236 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® SA8255P | 7.17 ms | 16 - 236 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® QCS8450 | 9.23 ms | 4 - 229 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 6.957 ms | 16 - 34 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 6.073 ms | 16 - 16 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 3.174 ms | 4 - 219 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® SA7255P | 13.563 ms | 16 - 239 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® SA8295P | 8.879 ms | 0 - 200 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 3.174 ms | 4 - 219 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.815 ms | 4 - 201 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 1.79 ms | 4 - 4 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 3.349 ms | 4 - 4 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.912 ms | 0 - 115 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 3.441 ms | 0 - 118 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 11.418 ms | 1 - 7 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 5.447 ms | 4 - 92 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.895 ms | 4 - 120 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 3.538 ms | 4 - 94 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8650P | 3.538 ms | 4 - 94 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8255P | 3.538 ms | 4 - 94 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 3.441 ms | 0 - 118 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 3.362 ms | 1 - 7 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 3.349 ms | 4 - 4 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 12.874 ms | 9 - 286 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 3.459 ms | 4 - 217 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.514 ms | 1 - 94 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 5.447 ms | 4 - 92 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 4.039 ms | 4 - 110 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 1.514 ms | 1 - 94 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 1.322 ms | 1 - 114 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 3.459 ms | 4 - 217 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 4.041 ms | 0 - 247 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 9.392 ms | 0 - 229 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8275 | 13.405 ms | 0 - 216 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 5.865 ms | 0 - 3 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® SA8775P | 7.224 ms | 0 - 222 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® SA8650P | 7.224 ms | 0 - 222 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® SA8255P | 7.224 ms | 0 - 222 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® QCS8450 | 9.392 ms | 0 - 229 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 6.944 ms | 0 - 31 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 3.196 ms | 0 - 215 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® SA7255P | 13.405 ms | 0 - 216 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® SA8295P | 8.747 ms | 0 - 238 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 3.196 ms | 0 - 215 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.838 ms | 0 - 191 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 5.902 ms | 0 - 250 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 9.803 ms | 0 - 246 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 40.448 ms | 12 - 59 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 15.367 ms | 0 - 215 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.546 ms | 0 - 28 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® SA8775P | 9.778 ms | 0 - 219 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® SA8650P | 9.778 ms | 0 - 219 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® SA8255P | 9.778 ms | 0 - 219 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® QCS8450 | 9.803 ms | 0 - 246 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 9.467 ms | 0 - 14 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 35.113 ms | 12 - 213 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 15.327 ms | 12 - 204 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 3.877 ms | 0 - 248 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® SA7255P | 15.367 ms | 0 - 215 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® SA8295P | 9.27 ms | 0 - 222 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 3.877 ms | 0 - 248 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.381 ms | 0 - 250 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 15.327 ms | 12 - 204 MB | NPU |
License
- The license for the original implementation of EdgeTAM can be found here.
References
Community
- Join our AI Hub Slack community to collaborate, post questions and learn more about on-device AI.
- For questions or feedback please reach out to us.
