DiffVox: A Differentiable Model for Capturing and Analysing Professional Effects Distributions
Abstract
This study introduces a novel and interpretable model, DiffVox, for matching vocal effects in music production. DiffVox, short for ``Differentiable Vocal Fx", integrates parametric equalisation, dynamic range control, delay, and reverb with efficient differentiable implementations to enable gradient-based optimisation for parameter estimation. Vocal presets are retrieved from two datasets, comprising 70 tracks from MedleyDB and 365 tracks from a private collection. Analysis of parameter correlations highlights strong relationships between effects and parameters, such as the high-pass and low-shelf filters often behaving together to shape the low end, and the delay time correlates with the intensity of the delayed signals. Principal component analysis reveals connections to McAdams' timbre dimensions, where the most crucial component modulates the perceived spaciousness while the secondary components influence spectral brightness. Statistical testing confirms the non-Gaussian nature of the parameter distribution, highlighting the complexity of the vocal effects space. These initial findings on the parameter distributions set the foundation for future research in vocal effects modelling and automatic mixing. Our source code and datasets are accessible at https://github.com/SonyResearch/diffvox.
Community
This paper proposes a differentiable implementation of audio effects for vocals that are fast to train and capable of real-time processing. In addition, 435 vocal presets from the MedleyDB dataset and a private collection of multi-track mixes based on DiffVox are given. Correlation and principal component analysis are performed to reveal more insight into the effect parameter distributions.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Designing Neural Synthesizers for Low Latency Interaction (2025)
- WaveFM: A High-Fidelity and Efficient Vocoder Based on Flow Matching (2025)
- Score-informed Music Source Separation: Improving Synthetic-to-real Generalization in Classical Music (2025)
- Towards Generalizability to Tone and Content Variations in the Transcription of Amplifier Rendered Electric Guitar Audio (2025)
- Pitch Contour Exploration Across Audio Domains: A Vision-Based Transfer Learning Approach (2025)
- Accompaniment Prompt Adherence: A Measure for Evaluating Music Accompaniment Systems (2025)
- Activation Patching for Interpretable Steering in Music Generation (2025)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment:
@librarian-bot
recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper