Parakeet.cpp – Parakeet ASR inference in pure C++ with Metal GPU acceleration

 (github.com)

26 points | by noahkay13 3 hours ago

2 comments

  • noahkay13 3 hours ago
    I built a C++ inference engine for NVIDIA's Parakeet speech recognition models using Axiom(https://github.com/Frikallo/axiom) my tensor library.

    What it does: - Runs 7 model families: offline transcription (CTC, RNNT, TDT, TDT-CTC), streaming (EOU, Nemotron), and speaker diarization (Sortformer) - Word-level timestamps - Streaming transcription from microphone input - Speaker diarization detecting up to 4 speakers

  • ghostpepper 2 hours ago
    Off topic but if anyone is looking for a nice web-GUI frontend for a locally-hosted transcription engine, Scriberr is nice

    https://github.com/rishikanthc/Scriberr