Termsslug: gradient-descent

Gradient Descent

梯度下降

An optimization method that iteratively updates parameters along the negative gradient of a loss to minimize an objective, centr

Curated Intelligence

1 items · Page 1/1
新智元 (微信公众号)T2·Models
72 pts
MIT CSAIL Proposes Weight-Space Programming, LLM Rewrites Small Model Weights for 6x Math Gain

MIT CSAIL introduces "weight-space programming": instead of training or computing gradients, GPT-6 Astra directly rewrites roughly 0.016% of another small model's weights, reportedly boosting its math performance about sixfold. The work shifts capability transfer from data and gradient-based training to direct editing in weight space, potentially offering a low-cost route for model adaptation if the results replicate.