Collections of thoughts

Tracking a collection of slightly more notable milestone posts, announcements and thoughts etc on X. Chronologically sorted and roughly into arcs.

Arc 7: “Return to GDM arc”

1. On being an individual contributor

2. First selfie back at Google (Great to be back!)

3. Returning to Google DeepMind

Arc 6: “Reka / Startup Arc”

1. Archetype of AI researchers/Engineers (fun post)

2. Model Architecture Blogpost: Encoders/Prefixlm

3. Latentspace Podcast with Swyx

4. Architecture vs Data

5. Reka Core Launch

6. Day in my life

7. Training LLMs in the wild

8. Reka Flash launch

9. Singapore and LLMs

10. Efficiency comparisons of LLMs

11. Reka’s multimodal assistant

12. Reka coming out of stealth

Arc-5 “Leaving Google Brain Arc”

1. Hot take on new OSS models

2. Notable works that use UL2

3. Misconceptions of LLM architectures

4. Notable Singaporean AI researchers

5. Leaving Google Brain

6. Flan-UL2 release

Why starting at arc-5? I don’t know, but I probably should fill up the earlier days of my career at some point so i’m reserving 4 arcs for that. :)

Podcasts & Interviews

I don’t do these very often but here are some notable podcasts / interviews and talks I’ve done.

1) Latentspace Podcast / Interview

2) Talk at NUS on Differentiable Search Index

3) Yannic Kilcher Youtube channel (Author interview on DSI)