Ls Eend Coreml

LS-EEND CoreML Models CoreML exports of LS-EEND, a long-form streaming end-to-end neural diarization model with online attractor extraction. This repository contains non-quantized CoreML step models for four LS-EEND variants: - - - - These models are intended for stateful streaming inference. Each package runs one LS-EEND step at a time with explicit recurrent/cache tensors, rather than processing an entire utterance in a single call. ## Included files Each variant directory contains: - : the CoreML model package - : metadata needed by the runtime - : a compiled CoreML bundle generated locally for convenience Variant directories: - - - - ## Variants | Variant | Package | Configured max speakers | Model output capacity | | --- | --- | ---: | ---: | | AMI | | 4 | 6 | | CALLHOME | | 7 | 9 | | DIHARD II | | 10 | 12 | | DIHARD III | | 10 | 12 | The metadata JSON distinguishes between: - : the dataset/config speaker setting from the LS-EEND infer YAML - : the exported model's full decode/output capacity ## Frontend and runtime assumptions All four non-quantized exports in this repo use the same frontend settings: - sample rate: - window length: samples - hop length: samples - FFT size: - mel bins: - context receptive field: - subsampling: - feature type: - output frame rate: - compute precision: These are step-wise streaming models. A runtime must maintain and feed the recurrent state tensors between calls: - - - - - - The CoreML inputs and outputs follow the LS-EEND step export used by the reference Python and Swift runtimes. ## Intended usage Use these packages with a runtime that: 1. Resamples audio to mono 2. Extracts LS-EEND features with the settings above 3. Preserves model state across step calls 4. Uses / control inputs to handle the encoder delay and final tail flush 5. Applies postprocessing such as sigmoid, thresholding, optional median filtering, and RTTM conversion outside the CoreML graph This repository is not a drop-in replacement for generic Hugging Face inference. It is meant for custom CoreML runtimes, such as: - the Python LS-EEND CoreML runtime from the FS-EEND project - the Swift/macOS runtime used for the LS-EEND CoreML microphone demo ## Minimal metadata example Each variant ships a sidecar JSON with fields like: Check the variant-specific file for the exact state tensor shapes and output dimensions. ## Credits - : by Di Liang & Xiaofei Li (Westlake University). Paper: (IEEE TASLP 2025). The original model is not hosted on HuggingFace; pretrained weights are available on . - : . Original repo: . ## Source project These CoreML exports were produced from the LS-EEND code in the FS-EEND repository: - GitHub: The export path is based on the LS-EEND CoreML step exporter and variant batch exporter in that project. ## Training and evaluation context From the source project, the reported real-world diarization error rates are: | Dataset | DER (%) | | --- | ---: | | CALLHOME | 12.11 | | DIHARD II | 27.58 | | DIHARD III | 19.61 | | AMI Dev | 20.97 | | AMI Eval | 20.76 | These numbers come from the upstream LS-EEND project README and reflect the original training/evaluation setup, not a Hugging Face evaluation pipeline. ## Limitations - These models are exported for Apple CoreML runtimes, not for PyTorch or ONNX consumers. - They are stateful streaming step models, so they require a custom driver loop. - They assume an 8 kHz LS-EEND frontend and will not produce matching results if you use a different spectrogram pipeline. - Speaker identities are output as activity tracks/slots and still require downstream diarization postprocessing and speaker-slot alignment where appropriate. ## License and dataset constraints The upstream LS-EEND model/codebase used for these CoreML exports is MIT-licensed, and this repository is published as MIT accordingly. The underlying evaluation and fine-tuning datasets still have their own access and usage terms: - AMI - CALLHOME - DIHARD II - DIHARD III This repository redistributes CoreML exports of the LS-EEND model variants. Dataset licensing and access requirements remain governed by the original dataset providers. ## Citation If you use LS-EEND, cite the original paper: