LoRDO: Distributed Low-Rank Optimization with Infrequent Communication
Paper • 2602.04396 • Published
Andrej Jovanovic
maddox-j
AI & ML interests
None yet
Recent Activity
authored a paper 23 days ago
LoRDO: Distributed Low-Rank Optimization with Infrequent Communication authored a paper 7 months ago
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training
Foundation Models authored a paper 7 months ago
MT-DAO: Multi-Timescale Distributed Adaptive Optimizers with Local
UpdatesOrganizations
None yet
authored a
paper 23 days ago
authored 2
papers 7 months ago
upvoted 2
papers 9 months ago
upvoted 3
papers about 1 year ago
SVD-Free Low-Rank Adaptive Gradient Optimization for Large Language Models
Paper • 2505.17967 • Published • 17
Quartet: Native FP4 Training Can Be Optimal for Large Language Models
Paper • 2505.14669 • Published • 79
Hogwild! Inference: Parallel LLM Generation via Concurrent Attention
Paper • 2504.06261 • Published • 110
upvoted 3
papers over 1 year ago
Panza: A Personalized Text Writing Assistant via Data Playback and Local Fine-Tuning
Paper • 2407.10994 • Published • 2
HALO: Hadamard-Assisted Lossless Optimization for Efficient Low-Precision LLM Training and Fine-Tuning
Paper • 2501.02625 • Published • 15
QuEST: Stable Training of LLMs with 1-Bit Weights and Activations
Paper • 2502.05003 • Published • 44