We put probabilistic circuits into diffusion language models and got a big boost in reasoning performance!
@guyvdb
π CS Prof at UCLA π§ Researching reasoning and learning in artificial intelligence: tactable deep generative models, probabilistic circuits, probabilistic programming, neurosymbolic AI https://web.cs.ucla.edu/~guyvdb/
We put probabilistic circuits into diffusion language models and got a big boost in reasoning performance!
"He is from [MASK] [MASK]" β "San York"? dLLMs fail because they ignore token dependencies. This Factorization Barrier arises from a structural misspecification: models are restricted to fully factorized outputs. We break this barrier with CoDD, enabling coherent parallel generation. π
For those on hiring committees: do you push back against this? What do you do?
What is wild to me is the defense, BY THE NEURIPS BOARD, that fabricated citations do not mean "the content of the papers themselves [is] necessarily invalidated"
It does. It very much does. What do you think citing other work is for? What do you think writing a paper is for? What do you *think*?
π¨π¨π¨
I have a #postdoc (1+1 yrs) at the School of Informatics, The University of Edinburgh to work on π₯ #reliable #LLM #agents with #neurosymbolic #nesy layers π₯ with Huawei Trustworthy Technology and Engineering Laboratory Munich
π elxw.fa.em3.oraclecloud.com/hcmUI/Candid...
π please share!
Recordings of the NeSy 2025 keynotes are now available! π₯
Check out insightful talks from @guyvdb.bsky.social, @tkipf.bsky.social and D McGuinness on our new Youtube channel www.youtube.com/@NeSyconfere...
Topics include using symbolic reasoning for LLM, and object-centric representations!
I gave a keynote at @nesyconf.org on
"Symbolic Reasoning in the Age of Large Language Models"
Check out the recording if you are curious about neurosymbolic generative AI:
www.youtube.com/watch?v=Otmi...
Now, @guyvdb.bsky.social is giving the opening keynote arguing why symbolic AI is still relevant in the age of LLMs...
With the help of Shrek!
How can reverend Bayes help us to incorporate constraints?
With NeSy of course π With applications in non-toxic LLM generation and safe AI driving!
@guyvdb.bsky.social
Did you know Neurosymbolic methods can beat 'the other's turf'?
Just use a 100x smaller LM with symbolic constraints integrated via Ctrl-G to wipe the floor with GPT!π§Ή
arxiv.org/abs/2406.13892
@guyvdb.bsky.social
It is almost time to welcome you all in Santa Cruz! π¦
We will start with an exciting and timely keynote by
@guyvdb.bsky.social
on "Symbolic Reasoning in the Age of Large Language Models" π
π Full conference schedule: 2025.nesyconf.org/schedule/
Grants, awards, fellowships, etc. should really be upfront about their acceptance rate. Some of them are just abundantly not worth the effort
A great start to TPM 2025! @auai.org
#UAI2025 #TPM
If you've seen recent claims on genAI doing well at math exams read the commentary by the greatest living mathematician, who uses tech a lot in math. (Tao & I graduated from the same math dept & had the same profs. He is way younger than me and way, way, way better!!!) mathstodon.xyz/@tao/1148814...
Wish LM could planβnot just guess the next word?
TRACE lets LM see all endings before each move.
β Global control at inference time
β Tractable lookahead via an HMM LM-proxy
β Linear classifier per constraint
Outperform RL, DPO, FUDGEβat just +20% decoding over base LM.
#ICML2025 @guyvdb.bsky.social
π¨ First Call for Participation β NeSy 2025
π Sept 8β10 | Santa Cruz, CA
Join the longest-running conference on neurosymbolic AI!
Our keynote speakers:
@guyvdb.bsky.social
@tkipf.bsky.social
Deborah McGuinness
@garymarcus.bsky.social
More info π
this exact paper has been in my scholar inbox every day for the past two months. i've been wondering if the author somehow re-uploads it every day, or if there is a bug in scholar inbox
Announcing the 2025 IJCAI Computers and Thought Award winner β¨Aditya Grover, InceptionAILabs & UCLA. Dr. Grover is honored for uniting deep generative models, representation learning & RL to advance scientific reasoning.
Congratulations!
www.ijcai.org/awards
I wrote about @jessejdavis.bsky.social, an American computer science professor running an influential soccer analytics research team at an ancient university in Belgium.
Much of the leading data analysis is still being done outside soccer. Why?
@theguardian.com
www.theguardian.com/football/202...
Interesting thread. But what's the difference between Bayesian conditioning and learning a new skill? Every distribution can be achieved by Bayesian conditioning the uniform distribution!
π£ Call for Paper Alert: TokShop @ ICML 2025
TokShop explores tokenization across all data modalities. Topics include: subword NLP techniques, multimodal approaches, multilingual challenges, post-training modification, alternative representations, and statistical perspectives.
ποΈ Deadline extended: π₯2nd June 2025!π₯
We are looking forward to your works on:
π #circuits and #tensor #networks πΈοΈ
β³ normalizing #flows π¨
βοΈ scaling #NeSy #AI π¦
π
fast and #reliable inference π
...& more!
please share π
π Looking for PhD students, postdocs & interns!
Iβm recruiting for my new lab at NUS School of Computing, focusing on generative modeling, reasoning, and tractable inference.
π‘ Interested? Learn more here: liuanji.github.io
ποΈ PhD application deadline: June 15, 2025
Anji is an amazing mentor and colleague. If I could go for another PhD in CS I would apply!
Just under 10 days left to submit your latest endeavours in #tractable probabilistic models!
Join us at TPM @auai.org #UAI2025 and show how to build #neurosymbolic / #probabilistic AI that is both fast and trustworthy!
Last time I had this problem it only got unstuck by tweeting about the problem.
This year I am co-organizing the 8th iteration of the Tractable Probabilistic Modeling #TPM workshop at #UAI2025 π΄ Rio de Janeiro edition π΄
π lnkd.in/dDK8T5Au
β° Submission deadline: May 23th AoE
π΄ Date: July 15th
π§΅π
Bit blasting! Nice