Chengkun Li's Avatar

Chengkun Li

@ckli

PhD student @ EPFL πŸ‡¨πŸ‡­ | Prev: research intern @ Google DeepMind, ByteDance AI Lab | https://charlieleee.github.io

331
Followers
128
Following
41
Posts
16.11.2024
Joined
Posts Following

Latest posts by Chengkun Li @ckli

πŸ˜…

08.11.2025 22:55 πŸ‘ 0 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

and of course a good base policy!

08.11.2025 22:40 πŸ‘ 0 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Video thumbnail

Training another musculoskeletal system @xiaotiansu.bsky.social for tennis, after having trained other musculoskeletal systems for soccer and pingpong.

With cognitive function, reward learning, and some sort of teacher distillation, this system learns a quite robust forehand within 36,000 stepsπŸ‘

08.11.2025 22:37 πŸ‘ 1 πŸ” 0 πŸ’¬ 2 πŸ“Œ 0
Post image

Something exciting just left the gym -- meet Arnold the first generalist musculoskeletal control policy!

The human body has 600+ muscles, yet we seamlessly coordinate them for everything from whispering a syllable to felling a forrest. How? www.arxiv.org/abs/2508.18066

04.09.2025 08:45 πŸ‘ 81 πŸ” 20 πŸ’¬ 3 πŸ“Œ 4

Interesting study, do check this out πŸ’ͺ

09.08.2025 15:46 πŸ‘ 0 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

The more you use JAX, the more you feel its power.. like wielding the sharpest knife in your toolbox πŸ—‘οΈ

30.07.2025 22:06 πŸ‘ 3 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

glad to see distill.pub revived at anthropic :)

28.03.2025 20:19 πŸ‘ 4 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

It’s pretty strange they don’t have this in zurich. At EPFL, all stem master’s students have a mandatory internship, and we get the chance to intern at big tech companies

26.02.2025 15:34 πŸ‘ 2 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image Post image Post image Post image

Quick life update: I recently started my PhD back in the beautiful Lac LΓ©man region at EPFL Campus Biotech.

Just wanted to show off the office a bit! 😎

More nature views coming soon…

18.02.2025 20:42 πŸ‘ 4 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Preview
Conversation with Urs HΓΆlzle Podcast Episode Β· Inside AI Β· 01/29/2025 Β· 1h 7m

Ep 2 of #InsideAI is out! πŸŽ™οΈπŸŽ‰
We sat with Google Fellow Urs HΓΆlzle. From optimizing data centers to AI efficiency, AGI, autonomous vehicles & Europe’s AI outlookβ€”don’t miss this insightful conversation.
On Spotify: open.spotify.com/episode/5Tu9...
or Apple Podcast: podcasts.apple.com/us/podcast/c...

29.01.2025 17:15 πŸ‘ 8 πŸ” 2 πŸ’¬ 0 πŸ“Œ 0
Post image Post image Post image Post image

Stopped by BAAI (Beijing Academy of AI) to visit a friend! β˜•οΈ The coffee was great, and it’s right between China’s top two universities. Sadly, the hanging garden is closed for now. Overall a quite nice place to do research
#Beijing

29.01.2025 06:10 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

Awesome work, congrats!

17.01.2025 11:42 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Picture of the SusTec research group at ETH Zurich with all its members standing in front of the Geneva lake on a sunny summer afternoon. There is text saying: We're hiring! 1 PhD student: Modelling net-zero supply chains.

Picture of the SusTec research group at ETH Zurich with all its members standing in front of the Geneva lake on a sunny summer afternoon. There is text saying: We're hiring! 1 PhD student: Modelling net-zero supply chains.

We are hiring 1 PhD in energy modeling!

The PhD investigates policies to accelerate supply chain development for net-zero technologies like hydrogen through agent-based and energy system modeling.

Details: emea2.softfactors.com/job-opening/...

Apply until 31.01.2025.

Please share!

06.01.2025 09:12 πŸ‘ 4 πŸ” 5 πŸ’¬ 0 πŸ“Œ 0

I've put together a starter pack of EPFL researchers across all labs and domains! πŸ‡¨πŸ‡­ Would love to expand this list and showcase more amazing work happening at EPFL. Drop a reply to be added!
#EPFL #academicsky

go.bsky.app/73zdbtp

22.11.2024 14:41 πŸ‘ 10 πŸ” 3 πŸ’¬ 7 πŸ“Œ 1
Post image

πŸš€ Introducing PICLe: a framework for in-context named-entity detection (NED) using pseudo-annotated demonstrations.
🎯 No human labeling neededβ€”yet it outperforms few-shot learning with human annotations!
#AI #NLProc #LLMs #ICL #NER

17.12.2024 14:51 πŸ‘ 12 πŸ” 8 πŸ’¬ 1 πŸ“Œ 1

Super interesting example! The trained model seems to understand the colliding better than rolling (the colliding part looks more natural)

16.12.2024 21:54 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

the benchmark section looks amazing! congrats! πŸ‘

16.12.2024 17:41 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image Post image Post image Post image

Goodbye sunny Barcelona
Hello again ZΓΌrich

#photography #barcelona

16.12.2024 16:28 πŸ‘ 5 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

Another interesting project I worked on at @icepfl.bsky.social Kudos to @sjaved.bsky.social and all the co-authors!

The findings in MQAT highlight the potential of exploiting modularity in neural networks for efficient and performant compression/adaptation.

Check out the #TMLR paper for details!

16.12.2024 13:14 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

Congrats Saqib! Enjoyed working with you!

16.12.2024 13:08 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
pre-training as we know it will end
pre-training as we know it will end YouTube video by Charlie Li

Ilya’s full talk at neurips 2024 "pre-training as we know it will end" at #NeurIPS

youtu.be/6gTjxQLwK4o?...

source: Vincent Weisser

14.12.2024 01:01 πŸ‘ 3 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

Yeah, back in the day interns at bd had some serious access permissions, but this is taking it too far;

still imo retracting the paper is unlikely, I wonder how neurips will react

12.12.2024 11:27 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

Last chance! #AMLDEPFL2025 early bird ticket sales end tomorrow December 11. Get yoursπŸ‘‰https://buff.ly/3UYv8Cr. Join us for inspiring speakers, comprehensive tracks, cutting-edge exhibition, hands-on workshops, and unmatched networking. February 11-14, 2025 SwissTech Convention Center EPFL Lausanne

10.12.2024 09:05 πŸ‘ 0 πŸ” 1 πŸ’¬ 0 πŸ“Œ 0

Perhaps instead of solely focusing on preventing forgetting in AI systems, we should be asking: How can we implement more selective, adaptive forgetting mechanisms similar in a continual learning framework? [4/4]

Thoughts?
#continual

09.12.2024 19:01 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

So probably, the real challenge isn't preventing ALL forgetting - it's developing mechanisms to identify which patterns should be preserved vs. discarded. This is where biological systems could excel through social feedback, interactions, expert guidance, and iterative refinement. [3/4]

09.12.2024 19:01 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

In both natural and artificial learning systems, selective forgetting (perturbation/regularization) could help escape local optima and unlearn inefficient or corrupted patterns (especially relevant given concerns about poisoned training data) [2/4]

09.12.2024 19:01 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

πŸ’­When reading continual learning literature, there's always the term 'catastrophic forgetting' being discussed as a major challenge. But looking at some efficient learning systems (e.g. biological-based ones), it's hard to not notice forgetting isn't necessarily a bug - it's sometimes a merit. [1/4]

09.12.2024 18:59 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
TMLR + Bluesky

TMLR + Bluesky

Introducing the @tmlr-pub.bsky.social account, that is now posting the latest TMLR published papers! Check it out!

08.12.2024 18:22 πŸ‘ 52 πŸ” 20 πŸ’¬ 1 πŸ“Œ 1

Three days left to apply for a PhD in my group! ⬇️⬇️

Come join us to work on the forefront of adaptive AI & lifelong machine learning. We’ve got lots of exciting ideas in store πŸ€—

07.12.2024 13:49 πŸ‘ 11 πŸ” 9 πŸ’¬ 0 πŸ“Œ 0