Skip to content

Commit a6470f1

Browse files
Songchen XuSongchen Xu
authored andcommitted
update README (performance of ARM NEON)
1 parent 5e9fe1a commit a6470f1

1 file changed

Lines changed: 13 additions & 9 deletions

File tree

README.md

Lines changed: 13 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -42,18 +42,22 @@ To enable efficient edge CPU deployment, we replace the original Qwen2.5-7B lang
4242

4343
<div align="center">
4444

45-
| Threads | RTF | vs. Whisper.cpp |
46-
|:-------:|:---:|:---:|
47-
| 1 | 1.98 | 2.28× |
48-
| 2 | 1.08 | 2.12× |
49-
| 3 | **0.77** | 1.86× |
50-
| 4 | **0.63** | 1.86× |
51-
| 6 | **0.49** | 1.71× |
52-
| 8 | **0.42** | 1.55× |
45+
**AMD EPYC 7V13 (AVX2+FMA)**
46+
47+
| | 1T | 2T | 3T | 4T | 6T | 8T |
48+
|:---:|:---:|:---:|:---:|:---:|:---:|:---:|
49+
| RTF | 1.98 | 1.08 | **0.77** | **0.63** | **0.49** | **0.42** |
50+
| vs. Whisper.cpp | 2.28× | 2.12× | 1.86× | 1.86× | 1.71× | 1.55× |
51+
52+
**Apple M4 (ARM NEON, 4P+6E, 16GB)**
53+
54+
| | 1T | 2T | 3T | 4T | 6T | 8T |
55+
|:---:|:---:|:---:|:---:|:---:|:---:|:---:|
56+
| RTF | 1.15 | **0.66** | **0.51** | **0.42** | **0.52** | **0.45** |
5357

5458
</div>
5559

56-
> Benchmarked on AMD EPYC 7V13 (AVX2+FMA) with 20s audio input. **Bold** = RTF < 1 (real-time).
60+
> RTF (Real-Time Factor) on 20s audio input. **Bold** = RTF < 1 (real-time).
5761
5862
### Accuracy (WER%)
5963

0 commit comments

Comments
 (0)