qaihm-bot commited on
Commit
ff872a8
·
verified ·
1 Parent(s): 79b35c3

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +23 -21
README.md CHANGED
@@ -35,25 +35,27 @@ More details on model performance across various devices, can be found
35
 
36
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
- | SAMDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 7.351 ms | 0 - 33 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
39
- | SAMDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 8.997 ms | 1 - 65 MB | FP16 | NPU | [Segment-Anything-Model.onnx](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.onnx) |
40
- | SAMDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 5.236 ms | 0 - 49 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
41
- | SAMDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 6.184 ms | 4 - 74 MB | FP16 | NPU | [Segment-Anything-Model.onnx](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.onnx) |
42
- | SAMDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 4.145 ms | 0 - 43 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
43
- | SAMDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 3.618 ms | 4 - 41 MB | FP16 | NPU | Use Export Script |
44
- | SAMDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 5.516 ms | 2 - 59 MB | FP16 | NPU | [Segment-Anything-Model.onnx](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.onnx) |
45
- | SAMDecoder | SA7255P ADP | SA7255P | TFLITE | 53.049 ms | 0 - 40 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
46
- | SAMDecoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 7.365 ms | 0 - 31 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
47
- | SAMDecoder | SA8295P ADP | SA8295P | TFLITE | 9.842 ms | 0 - 36 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
48
- | SAMDecoder | SA8295P ADP | SA8295P | QNN | 7.413 ms | 0 - 17 MB | FP16 | NPU | Use Export Script |
49
- | SAMDecoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 7.376 ms | 0 - 29 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
50
- | SAMDecoder | SA8775P ADP | SA8775P | TFLITE | 10.421 ms | 0 - 40 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
51
- | SAMDecoder | QCS8275 (Proxy) | QCS8275 Proxy | TFLITE | 53.049 ms | 0 - 40 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
52
- | SAMDecoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 7.36 ms | 0 - 28 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
53
- | SAMDecoder | QCS9075 (Proxy) | QCS9075 Proxy | TFLITE | 10.421 ms | 0 - 40 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
54
- | SAMDecoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 8.957 ms | 0 - 46 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
55
- | SAMDecoder | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 7.801 ms | 4 - 41 MB | FP16 | NPU | Use Export Script |
56
- | SAMDecoder | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 10.032 ms | 12 - 12 MB | FP16 | NPU | [Segment-Anything-Model.onnx](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.onnx) |
 
 
57
 
58
 
59
 
@@ -117,8 +119,8 @@ Profiling Results
117
  SAMDecoder
118
  Device : Samsung Galaxy S23 (13)
119
  Runtime : TFLITE
120
- Estimated inference time (ms) : 7.4
121
- Estimated peak memory usage (MB): [0, 33]
122
  Total # Ops : 845
123
  Compute Unit(s) : NPU (845 ops)
124
  ```
 
35
 
36
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
+ | SAMDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 7.33 ms | 0 - 28 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
39
+ | SAMDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 6.439 ms | 4 - 16 MB | FP16 | NPU | [Segment-Anything-Model.so](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.so) |
40
+ | SAMDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 8.944 ms | 1 - 60 MB | FP16 | NPU | [Segment-Anything-Model.onnx](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.onnx) |
41
+ | SAMDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 5.154 ms | 0 - 48 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
42
+ | SAMDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 4.545 ms | 4 - 45 MB | FP16 | NPU | [Segment-Anything-Model.so](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.so) |
43
+ | SAMDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 6.25 ms | 4 - 71 MB | FP16 | NPU | [Segment-Anything-Model.onnx](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.onnx) |
44
+ | SAMDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 4.137 ms | 0 - 43 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
45
+ | SAMDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 4.355 ms | 4 - 42 MB | FP16 | NPU | Use Export Script |
46
+ | SAMDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 4.57 ms | 0 - 57 MB | FP16 | NPU | [Segment-Anything-Model.onnx](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.onnx) |
47
+ | SAMDecoder | SA7255P ADP | SA7255P | TFLITE | 53.048 ms | 0 - 39 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
48
+ | SAMDecoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 7.372 ms | 0 - 28 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
49
+ | SAMDecoder | SA8295P ADP | SA8295P | TFLITE | 9.885 ms | 0 - 37 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
50
+ | SAMDecoder | SA8295P ADP | SA8295P | QNN | 7.394 ms | 0 - 18 MB | FP16 | NPU | Use Export Script |
51
+ | SAMDecoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 7.381 ms | 0 - 28 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
52
+ | SAMDecoder | SA8775P ADP | SA8775P | TFLITE | 10.38 ms | 0 - 41 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
53
+ | SAMDecoder | QCS8275 (Proxy) | QCS8275 Proxy | TFLITE | 53.048 ms | 0 - 39 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
54
+ | SAMDecoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 7.35 ms | 0 - 28 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
55
+ | SAMDecoder | QCS9075 (Proxy) | QCS9075 Proxy | TFLITE | 10.38 ms | 0 - 41 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
56
+ | SAMDecoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 8.969 ms | 0 - 42 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
57
+ | SAMDecoder | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 7.964 ms | 4 - 44 MB | FP16 | NPU | Use Export Script |
58
+ | SAMDecoder | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 9.975 ms | 11 - 11 MB | FP16 | NPU | [Segment-Anything-Model.onnx](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.onnx) |
59
 
60
 
61
 
 
119
  SAMDecoder
120
  Device : Samsung Galaxy S23 (13)
121
  Runtime : TFLITE
122
+ Estimated inference time (ms) : 7.3
123
+ Estimated peak memory usage (MB): [0, 28]
124
  Total # Ops : 845
125
  Compute Unit(s) : NPU (845 ops)
126
  ```