2025 introspections: my year back at Google
Reflecting on 2025 and my one year back at Google Deepmind’s Gemini team. From being back to research to winning the historic IMO gold medal, along with starting GDM Singapore, I reflect on what a wild year it has been.
Returning to Google DeepMind
Returning to Google and recounting my experiences as a startup co-founder.
What happened to BERT & T5? On Transformer Encoders, PrefixLM and Denoising Objectives
A Blogpost series about Model Architectures Part 1: What happened to BERT and T5? Thoughts on Transformer Encoders, PrefixLM and Denoising objectives
Training great LLMs entirely from ground up in the wilderness as a startup
Chronicles of training strong LLMs from scratch in the wild
2022 in Review: Top language AI research papers + interesting papers to read
Here are some of the best language AI / NLP papers of 2022!
On Emergence, Scaling and Inductive Bias
Some thoughts on emergent abilities and scaling language models.