|
Akshat Gupta
I am a fourth-year PhD Candidate at UC Berkeley, advised by Gopala Anumanchipalli, affiliated with BAIR and Berkeley Speech Group. I'm also a Research Scientist Intern at Meta Superintelligence Labs. The main focus of my research is Continual Learning.
Research Goal: "To make parameter modification a normal part of model use."
Some of my representative ideas and works can be found below:
As an AI researcher, I'm tired of the model weights being frozen during use. However, changing weights during use will introduce new types of safety and security concerns. The problem of continual learning therefore must be solved in a very careful and wholistic manner.
Email  / 
Google Scholar  / 
Twitter  / 
Linkedin  / 
CV (Updated Aug 2026)
|
|
Experience
Meta Superintelligence Labs
Research Scientist Intern
October 2026 – Present
Continual learning
Google
Student Researcher
Apr 2026 – Aug 2026
Automated discovery, multi-agent systems
IBM Research
Research Scientist Intern
May 2025 – Aug 2025
Latent reasoning
JPMorgan Chase
Senior Associate, AI Research
Jun 2021 – Aug 2023
Relation extraction, knowledge graphs
Blogs
- I wrote a blog on how we're slowly getting ready for continual learning agents - From Thinking Models to Learning Agents.
- I recently wrote a blog about looking at Humans from the lens of AI, called "Un-Anthropomorphizing Humans".
- The blog contains some of my thoughts on continual learning and the future of AI and humans. I'd love to hear thoughts about it!
- I reviewed one of the AI generated papers by Sakana AI. If you're interest, here's the link.
News
- Oct 12, 2026 - Started at Meta as a Research Scientist Intern.
- Jul 30, 2026 - Advanced to Candidacy!
- July 2026 - I will be attending ACL 2026 in San Diego from July 2-7.
- April 28, 2026 - "Evolutionary Strategies lead to Catastrophic Forgetting in LLMs" accepted to ACL 2026 Main Conference for an Oral Presentation.
- April 28, 2026 - "Weight Tying Biases Token Embeddings Towards the Output Space" accepted to ACL 2026 Findings.
- April 13, 2026 - Started at Google as a Student Researcher.
- March 3, 2026 - SkyDiscover is released.
- Feb 23, 2026 - "AdaEvolve: Adaptive LLM Driven Zeroth-Order Optimization" is released on Arxiv.
- Jan 28, 2026 - "Evolutionary Strategies lead to Catastrophic Forgetting in LLMs" is released on Arxiv.
- Jan 4, 2026 - "Geometric Interpretation of Layer Normalization and a Comparative Analysis with RMSNorm" accepted to EACL 2026 Findings.
- Oct 22, 2025 - "How LLMs use their Depth?" is released on Arxiv. This AI-generated video does a great job summarizing our work.
- Aug 20, 2025 - "Lifelong Knowledge Editing requires Better Regularization" accepted to EMNLP 2025 Findings
- May 19, 2025 - Started internship at IBM Research as a Research Scientist Intern.
- May 15, 2025 - "Efficient Knowledge Editing via Minimal Precomputation" accepted to ACL 2025 Main Conference
- March 4, 2025 - Outstanding Paper Award at the KnowFM Workshop @ AAAI 2025. (Paper Link)
- Feb 2025 - I will be attending AAAI 2025 in Philadephia from Feb 26 - March 4.
- Jan 22, 2025 - "Sylber: Syllabic Embedding Representation of Speech from Raw Audio" accepted to ICLR 2025
- Dec 9, 2024 - "PokerBench: Training LLMs to become Professional Poker Players" accepted to AAAI 2025
- Nov 2024 - I will be attending EMNLP 2024 in Miami from November 11 - 16.
- Sep 20, 2024 - "Rebuilding ROME : Resolving Model Collapse during Sequential Editing" accepted to EMNLP 2024 Main Conference
- Sep 20, 2024 - "A Unified Framework for Model Editing" accepted to EMNLP 2024 Findings
- Sep 20, 2024 - "Self-Assessment Tests are Unreliable Measures of LLM Personality" accepted to BlackboxNLP 2024, co-located with EMNLP 2024
- August 12, 2024 - Attending ACL 2024 in Bangkok.
- May 15, 2024 - "Model Editing at Scale leads to Gradual and Catastrophic Forgetting" accepted to ACL 2024 Findings
Some of my other interests I've spent a lot of my natural compute on:
- Pickleball: I'm slowly becoming a regular in the East Bay pickleball scene. Happy to introduce people to the game and spots to play at. Goal for end of 2026 is to reach 4.5 level.
- Poker: Spent a lot of time studying poker, not as much playing. Wish I could play more often!
- Badminton: Played competitively in my undergraduate years. Some of my fondest memories are of competing in InterIIT Sports Meets.
- Guitar: Picked up the guitar early in my school days. Still play occasionally.
- Cricket: Represented my middle school team. Haven't played it properly in many years, yet somehow the only sport I watch.
|