Loading
Have a ComfyUI workflow? Get a readable Workflow Doc in your browser.Make a workflow readable.Try it now ↗
This model was trained by wyz based on the universalsev1 recipe in espnet. More information can be found at
Model source
Source excerpt
This model was trained by wyz based on the universalsev1 recipe in espnet. More information can be found at
Sources
1 sourceVerified Sep 18
Model artifacts
2 artifactsexp_vctk_dns20_whamr/enh_tfgridnet_xtiny_raw/91epoch.pth
pth · 1.82 MB · SHA-256 5a76d6e60895…1cc5 · Hugging Face
Downloadexp_vctk_dns20_whamr/enh_tfgridnet_xtiny_raw/valid.loss.best.pth
pth · 11 B · Hugging Face
Source excerpts
2 excerpts--- tags: - espnet - audio - audio-to-audio language: en datasets: - VCTK_DEMAND - DNS2020 - WHAMR license: cc-by-4.0 --- ## ESPnet2 ENH model ### `wyz/vctk_dns2020_whamr_tfgridnet_xtiny` This model was trained by wyz based on the universal_se_v1 recipe in [espnet](https://github.com/espnet/espnet/). More information can be found at https://github.com/Emrys365/se-scaling. ### Demo: How to use in ESPnet2 Follow the [ESPnet installation instructions](https://espnet.github.io/espnet/installation.html) if you haven't done that already. To use the model in the Python interface, you could use the following code: ```python import soundfile as sf from espnet2.bin.enh_inference import SeparateSpeech # For model downloading + loading model = SeparateSpeech.from_pretrained( model_tag="wyz/vctk_dns2020_whamr_tfgridnet_xtiny", normalize_output_wav=True, device="cuda", ) # For loading a downloaded model # model = SeparateSpeech( # train_config="exp_vctk_dns20_whamr/enh_tfgridnet_xtiny_raw/config.yaml", # model_file="exp_vctk_dns20_whamr/enh_tfgridnet_xtiny_raw/xxxx.pth", # normalize_output_wav=True, # device="cuda", # ) audio, fs = sf.read("/path/to/noisy/utt1.flac") enhanced = model(audio[None, :], fs=fs)[0] ``` <!-- Generated by scripts/utils/show_enh_score.sh --> # RESULTS ## Environments - date: `Fri Mar 1 15:56:53 EST 2024` - python version: `3.8.16 (default, Mar 2 2023, 03:21:46) [GCC 11.2.0]` - espnet version: `espnet 202304` - pytorch version: `pytorch 2.0.1+cu118` - Git hash: `443028662106472c60fe8bd892cb277e5b488651` - Commit date: `Thu May 11 03:32:59 2023 +0000` ## enhanced_test_16k |dataset|PESQ_WB|STOI|SAR|SDR|SIR|SI_SNR|OVRL|SIG|BAK|P808_MOS| |---|---|---|---|---|---|---|---|---|---|---| |chime4_et05_real_isolated_6ch_track|1.22|54.42|-2.34|-2.34|0.00|-30.90|2.99|3.36|3.77|3.70| |chime4_et05_simu_isolated_6ch_track|1.53|84.20|9.02|9.02|0.00|2.19|2.82|3.19|3.73|3.28| |dns20_tt_synthetic_no_reverb|3.10|97.40|18.73|18.73|0.00|18.79|3.29|3.56|4.05|3.99| |reverb_et_real_8ch_multich|1.14|68.58|2.35|2.35|0.00|-0.37|3.14|3.44|3.96|3.86| |reverb_et_simu_8ch_multich|2.37|94.32|11.14|11.14|0.00|-8.16|3.20|3.49|4.00|3.89| |whamr_tt_mix_single_reverb_max_16k|2.08|92.85|10.74|10.74|0.00|9.35|3.19|3.46|4.05|3.76| ## enhanced_test_48k |dataset|STOI|SAR|SDR|SIR|SI_SNR|OVRL|SIG|BAK|P808_MOS| |---|---|---|---|---|---|---|---|---|---| |vctk_noisy_tt_2spk|9...
Source context: 2 downloads · 0 likes · Pipeline audio-to-audio · Library espnet · Repo wyz/vctk_dns2020_whamr_tfgridnet_xtiny
