Papers
arxiv:2505.13138

Neurosymbolic Diffusion Models

Published on May 19
ยท Submitted by HEmile on May 21

Abstract

Neurosymbolic diffusion models address limitations of standard neurosymbolic predictors by modeling dependencies between symbols using discrete diffusion, leading to improved accuracy and calibration.

AI-generated summary

Neurosymbolic (NeSy) predictors combine neural perception with symbolic reasoning to solve tasks like visual reasoning. However, standard NeSy predictors assume conditional independence between the symbols they extract, thus limiting their ability to model interactions and uncertainty - often leading to overconfident predictions and poor out-of-distribution generalisation. To overcome the limitations of the independence assumption, we introduce neurosymbolic diffusion models (NeSyDMs), a new class of NeSy predictors that use discrete diffusion to model dependencies between symbols. Our approach reuses the independence assumption from NeSy predictors at each step of the diffusion process, enabling scalable learning while capturing symbol dependencies and uncertainty quantification. Across both synthetic and real-world benchmarks - including high-dimensional visual path planning and rule-based autonomous driving - NeSyDMs achieve state-of-the-art accuracy among NeSy predictors and demonstrate strong calibration.

Community

Paper author Paper submitter

We integrated neurosymbolic (NeSy) methods with discrete diffusion models.
Diffusion for discrete data is massively successful: Just yesterday, Google announced a diffusion LLM!

We find diffusion is especially compelling for NeSy, combining powerful visual understanding with symbolic reasoning ๐Ÿš€

Code at https://github.com/HEmile/neurosymbolic-diffusion

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend

Sign up or log in to comment

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2505.13138 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2505.13138 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2505.13138 in a Space README.md to link it from this page.

Collections including this paper 1