This is a port of NVIDIA's Parakeet model family that runs end-to-end on the JVM.
And it's fast, competitive with the native engines on CPUs.
Steve Jobs' 15-minutes Stanford speech transcribes in ~15s in my laptop, ~5s on my workstation, using the 110M Q4_K model.
This is a port of NVIDIA's Parakeet model family that runs end-to-end on the JVM. And it's fast, competitive with the native engines on CPUs. Steve Jobs' 15-minutes Stanford speech transcribes in ~15s in my laptop, ~5s on my workstation, using the 110M Q4_K model.