PhD, Technion (2026)
Deep learning researcher
I currently work on LLM inference and post-training as an AI Researcher at a stealth company.
During my PhD at the Technion (2026), with Alex Bronstein and Reuven Cohen, I worked on a wide range of problems: instantaneous VO₂ from smartwatches and from 3D pose in video, differentiable eikonal solvers for wildfire spread, encrypted network traffic as time series, and diagnostics of what large language models actually compute. The common thread was real-world data that is noisy, partly missing, and collected far from the lab, and models that build in the structure of the domain. From May to October 2026 I worked as an independent contractor with Apple's Video Engineering group.
Selected work
All 13 publications
Invertible Query-Key Coupling Composes with Attention Mechanisms
An identity-initialized, invertible coupling applied before scoring that adds 0.3% parameters and composes with Differential Attention, with significant gains at 150M and 455M parameters.
The Residual Stream's Effective Depth
A calibrated scalar for how much of a transformer's depth is distinct computation: fifteen of sixteen decoder-only models fall below the orthogonal-update reference, and matched controls trace the gap to correlated residual updates.
Differentiable Randers-Finsler Eikonal Solvers
A GPU fast-sweeping solver made exactly differentiable through implicit differentiation, used to recover anisotropic metrics from sparse arrival times and learn spread models on real wildfire perimeters.
From Lab to Wrist: Bridging Metabolic Monitoring and Consumer Wearables for Heart Rate and Oxygen Consumption Modeling
Full VO₂ trajectories from smartwatch and chest-strap data alone: a physiologically constrained ODE with a neural Kalman filter for heart rate, and a one-second-calibration VO₂ model at about 11% MAPE.
Research themes
More about my researchWhat transformers actually compute
Calibration-free diagnostics that audit a model instead of trusting its headline scores: how much of its depth is distinct computation, whether a personalized model conditions on the user at all, and where pre-scoring query-key geometry helps attention.
Differentiable physics and inverse problems
Classical solvers kept inside the learning loop. Implicit differentiation through fast sweeping turns anisotropic Eikonal distance fields into trainable models of wildfire spread.
Physiology from low-friction signals
Instantaneous VO₂ and cardiovascular load estimated from smartwatches, chest straps and monocular 3D pose in video, with neural ODE and Kalman structure and four datasets collected in the field.
Encrypted network traffic as time series
QUIC traces rendered as image sequences and multi-operator cellular links as multivariate series, from a 100,000-trace public dataset to real-time network selection for teleoperated vehicles.
News
All news- Started as an AI Researcher at a stealth company, working on LLM inference and post-training.
- Completed my independent contract with Apple's Video Engineering group, where I modeled instantaneous VO₂ from 3D human pose in video.
- "Invertible Query-Key Coupling Composes with Attention Mechanisms" has been accepted to the Asian Conference on Machine Learning (ACML 2026).
- "The Residual Stream's Effective Depth" has been accepted to the Asian Conference on Machine Learning (ACML 2026).
- New paper under review: "Predicting Cardiovascular Drift from 3D Running Pose via Spatio-Temporal Graph Attention" (led by my student Yuval David).
- "Differentiable Randers-Finsler Eikonal Solvers" (presented at SGP 2026) is now published online in Computer Graphics Forum, doi 10.1111/cgf.70489.
- New paper under review: "Invertible Query-Key Coupling Composes with Attention Mechanisms".
- Submitted my PhD thesis at the Technion.