Paul Vicol's Avatar

Paul Vicol

@paulvicol

Research Scientist at Google DeepMind. Working on Gemini reasoning models. PhD from UofT and Vector Institute www.paulvicol.com

719
Followers
170
Following
36
Posts
14.11.2024
Joined
Posts Following

Latest posts by Paul Vicol @paulvicol

TMLR Beyond PDF is a new submission format for TMLR that supports interactive figures and videos.

TMLR Beyond PDF is a new submission format for TMLR that supports interactive figures and videos.

🌐 Check out TMLR Beyond PDF at tmlr-beyond-pdf.org!

πŸ’» Submissions are made on OpenReview just like standard TMLR submissions.

🎨 Create your TMLR Beyond PDF submission today!

25.11.2025 16:11 πŸ‘ 6 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Video thumbnail

πŸš€ Introducing TMLR Beyond PDF!

🎬 This is a new, HTML-based submission format for TMLR, that supports interactive figures and videos, along with the usual LaTeX and images.

πŸŽ‰ Thanks to TMLR Editors in Chief: Hugo Larochelle, @gautamkamath.com, Naila Murray, Nihar B. Shah, and Laurent Charlin!

25.11.2025 16:11 πŸ‘ 75 πŸ” 22 πŸ’¬ 1 πŸ“Œ 3
Video thumbnail

πŸš€ All this and more in our paper!

arXiv: arxiv.org/abs/2509.20328

By
@thwiedemer.bsky.social, Yuxuan Li, @paulvicol.bsky.social, @nmatares.bsky.social, Been Kim, Kevin Swersky, Priyank Jaini, and Robert Geirhos.

26.09.2025 03:34 πŸ‘ 2 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Video thumbnail

Veo 3 understands material properties, including buoyancy, reflections, flammability, and soft body physics.

26.09.2025 03:34 πŸ‘ 2 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Video thumbnail

Veo 3 can understand which objects fit in a backpack, and can categorize objects (putting all the toys in a bucket). Veo 3 can also draw, and understands the effects of gravity and air resistance on falling objects.

26.09.2025 03:34 πŸ‘ 2 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Video thumbnail

Veo 3 can reason, filling in the next element in a sequence of images.

26.09.2025 03:34 πŸ‘ 2 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

πŸ”₯Veo 3 has emergent zero-shot learning and reasoning capabilities!

This multitalented model can do a huge range of interesting tasks.

It understands physical properties, can manipulate objects, and can even reason.

arxiv.org/abs/2509.20328
video-zero-shot.github.io

Examples in this thread!

26.09.2025 03:34 πŸ‘ 9 πŸ” 3 πŸ’¬ 1 πŸ“Œ 0
Post image

βš™οΈ Tong Chen presented "Generative Adapter: Contextualizing Language Models in Parameters with a Single Forward Pass"

openreview.net/forum?id=fk5...

Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Benjamin Van Durme, @lukezettlemoyer.bsky.social, Jianfeng Gao, Hao Cheng

#NeurIPS2024

19.12.2024 04:59 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image

πŸ“° Amelia Hui Dai presented "Are LLMs Prescient? A Continuous Evaluation using Daily News as the Oracle"

openreview.net/forum?id=cgi...

Hui Dai, Ryan Teehan, Mengye Ren

#NeurIPS2024 #AdaptiveFoundationModels

19.12.2024 04:59 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

πŸ‘€ Wen-Tse Chen presented "Fine-tuning LLM Agents with Retrospective In-Context Online Learning"

openreview.net/forum?id=dSZ...

Wen-Tse Chen, Jiayu Chen, Fahim Tajwar, Hao Zhu, Xintong Duan, @rsalakhu.bsky.social, Jeff Schneider

#NeurIPS2024 #AdaptiveFoundationModels

19.12.2024 04:59 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

πŸƒ Zhepei Wei presented "Fast and Accurate Language Model Decoding via Parallel Token Processing"

openreview.net/forum?id=coZ...

@zhepei.bsky.social @wlchen.bsky.social, Xinyu Zhu, Yu Meng

#NeurIPS2024 #AdaptiveFoundationModels

19.12.2024 04:59 πŸ‘ 3 πŸ” 2 πŸ’¬ 1 πŸ“Œ 0
Post image

▢️ Yue Wu presented "Self-Play Preference Optimization for Language Model Alignment"

openreview.net/forum?id=Z1P...

Yue Wu, Zhiqing Sun, @angelahzyuan.bsky.social, Kaixuan Ji, Yiming Yang, @quanquangu.bsky.social

#NeurIPS2024 #AdaptiveFoundationModels

19.12.2024 04:59 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

🎾 Jennifer Hsia presented "RAGGED: Towards Informed Design of Retrieval Augmented Generation Systems"

openreview.net/forum?id=SX1...

Jennifer Hsia, Afreen Shaikh, Zhiruo Wang, @gneubig.bsky.social

#NeurIPS2024 #AdaptiveFoundationModels

19.12.2024 04:59 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

πŸ₯£ Seungone Kim presented "Personalized Soups"

openreview.net/forum?id=EMr...

Joel Jang, Seungone Kim, @billyuchenlin.bsky.social @yizhongw.bsky.social @jmhessel.bsky.social @lukezettlemoyer.bsky.social @hanna-nlp.bsky.social @yejinchoinka.bsky.social @rajammanabrolu.bsky.social

#NeurIPS2024

19.12.2024 04:59 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

πŸ’Ž Lukas Hauzenberger presented "One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation"

openreview.net/forum?id=tjZ...

Fabian Paischer, Lukas Hauzenberger, Thomas Schmied, Benedikt Alkin, Marc Peter Deisenroth, Sepp Hochreiter

#NeurIPS2024 #AdaptiveFoundationModels

19.12.2024 04:59 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image Post image Post image Post image

πŸ–¨οΈ We also had two exciting poster sessions.

πŸ‘• Some presenters already put on their Adaptive Foundation Models T-shirts! Thanks Jianan Zhao Zhaocheng Zhu!

🧡 Oral paper presentations next!

#NeurIPS2024 #AdaptiveFoundationModels

19.12.2024 04:59 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

☁️ Tianqi Chen from CMU (@scsatcmu.bsky.social) gave a very interesting talk on Enabling Large Language Model Deployment Across Cloud and Edge with ML Compilation.

Timestamp 7:48:30 in neurips.cc/virtual/2024...

#NeurIPS2024 #AdaptiveFoundationModels

19.12.2024 04:59 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

πŸͺ Bing Liu from the University of Illinois at Chicago gave a great talk on Continual Learning with Large Language Models.

Timestamp 7:08:17 in neurips.cc/virtual/2024...

#NeurIPS2024 #AdaptiveFoundationModels

19.12.2024 04:59 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

⚑ Minjoon Seo from KAIST AI gave a great talk On the Knowledge Adaptability of Language Models.

Timestamp 5:42:00 in neurips.cc/virtual/2024...

#NeurIPS2024 #AdaptiveFoundationModels

19.12.2024 04:59 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

♾️ Matthias Bethge from University of Tuebingen (@unituebingen.bsky.social) had a talk on Continual Foundation Model Learning, presented by his amazing PhD student, Vishaal Udandarao (@vishaalurao.bsky.social).

Timestamp 5:06:39 in neurips.cc/virtual/2024...

#NeurIPS2024 #AdaptiveFoundationModels

19.12.2024 04:59 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

πŸ”‘ Kate Saenko from Meta and Boston University (@bostonu.bsky.social) gave a very interesting talk titled "Is pretraining the key to successful domain generalization?"

Timestamp 1:55:39 in neurips.cc/virtual/2024...

πŸ“Ž arxiv.org/abs/2412.02856

#NeurIPS2024 #AdaptiveFoundationModels

19.12.2024 04:59 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

πŸ’‘ Sander Dieleman (@sedielem.bsky.social) from Google DeepMind gave a thought-provoking talk on Multimodal Iterative Refinement.

Timestamp 1:10:45 in neurips.cc/virtual/2024...

#NeurIPS2024 #AdaptiveFoundationModels

19.12.2024 04:59 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

🌲 Ruslan Salakhutdinov (@rsalakhu.bsky.social) from CMU (@scsatcmu.bsky.social) opened the workshop with a talk on Tree Search for Language Model Agents.

Timestamp 36:20 in neurips.cc/virtual/2024...

πŸ“Ž arxiv.org/abs/2407.01476

#NeurIPS2024 #AdaptiveFoundationModels

19.12.2024 04:59 πŸ‘ 1 πŸ” 1 πŸ’¬ 1 πŸ“Œ 0
Post image

Our workshop in numbers:
πŸ–‡οΈ 128 Papers
πŸ’¬ 8 Orals
πŸ–‹οΈ 564 Authors
βœ… 40 Reviewers
πŸ”Š 7 Invited Speakers
πŸ‘• 100 T-Shirts

πŸ”₯ Organizers: Paul Vicol, Mengye Ren, Renjie Liao, Naila Murray, Wei-Chiu Ma, Beidi Chen

#NeurIPS2024 #AdaptiveFoundationModels

19.12.2024 04:59 πŸ‘ 1 πŸ” 1 πŸ’¬ 1 πŸ“Œ 0
Post image

πŸŽ‰ Had fun at #NeurIPS2024 Workshop on #AdaptiveFoundationModels!

πŸš€ Speakers: @rsalakhu.bsky.social @sedielem.bsky.social Kate Saenko, Matthias Bethge / @vishaalurao.bsky.social Minjoon Seo, Bing Liu, Tianqi Chen

🌐Posters: adaptive-foundation-models.org/papers

🎬 neurips.cc/virtual/2024...

🧡Recap!

19.12.2024 04:59 πŸ‘ 10 πŸ” 2 πŸ’¬ 1 πŸ“Œ 0

The recording of my #NeurIPS2024 workshop talk on multimodal iterative refinement is now available to everyone who registered: neurips.cc/virtual/2024...

My talk starts at 1:10:45 into the recording.

I believe this will be made publicly available eventually, but I'm not sure when exactly!

18.12.2024 04:38 πŸ‘ 36 πŸ” 4 πŸ’¬ 1 πŸ“Œ 0
Post image

Afternoon poster session at the Adaptive Foundation Models workshop!

15.12.2024 01:18 πŸ‘ 3 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image

Tianqi Chen speaking now at the Adaptive Foundation Models workshop!

14.12.2024 23:41 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image

Another batch of T-shirts for the Adaptive Foundation Models workshop!

14.12.2024 21:55 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image

Poster session at the Adaptive Foundation Models workshop!

14.12.2024 19:53 πŸ‘ 4 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0