X collections

Tracking a collection of slightly more notable milestone posts, announcements and thoughts etc on X. Chronologically sorted.

1. First selfie back at Google (Great to be back!)

2. Returning to Google DeepMind

3. Archetype of AI researchers/Engineers (fun post)

4. Model Architecture Blogpost: Encoders/Prefixlm

5. Latentspace Podcast with Swyx

6. Architecture vs Data

7. Reka Core Launch

8. Day in my life

9. Training LLMs in the wild

10. Reka Flash launch

11. Singapore and LLMs

12. Efficiency comparisons of LLMs

13. Reka’s multimodal assistant

14. Reka coming out of stealth

15. Hot take on new OSS models

16. Notable works that use UL2

17. Misconceptions of LLM architectures

18. Notable Singaporean AI researchers

19. Leaving Google Brain

20. Flan-UL2 release

Podcasts & Interviews

I don’t do these very often but here are some notable podcasts / interviews and talks I’ve done.

1) Latentspace Podcast / Interview

2) Talk at NUS on Differentiable Search Index

3) Yannic Kilcher Youtube channel (Author interview on DSI)