Zain Sarwar
Applied Researcher, LLM Core & Agentic AI · Capital One
I’m an Applied Researcher on the LLM Core team at Capital One. I recently completed my PhD in Computer Science at the University of Chicago, advised by Michael Maire.
My research is about making large language models more capable and more efficient. During my PhD I worked on Mixture-of-Experts (sparse and low-rank experts, dense routing gradients, continual pre-training), memory, and efficient reasoning (structured thoughts and context pruning for reasoning models). Earlier in my PhD I worked on security and machine learning, including deepfake text detection and keystroke inference attacks.
news
| Oct 25, 2026 | Launched my new website! |
|---|
selected publications
- Preprint
- NeurIPS WorkshopDense Backpropagation Improves Routing for Sparsely-Gated Mixture-of-ExpertsIn Workshop on Machine Learning and Compression, NeurIPS, 2024
- USENIX Security
Can Virtual Reality Protect Users from Keystroke Inference Attacks?In 33rd USENIX Security Symposium (USENIX Security 24)Press: New Scientist , 2024 - IEEE S&P
Deepfake Text Detection: Limitations and OpportunitiesIn IEEE Symposium on Security and Privacy (S&P)Press: CACM, TechXplore , 2023