@gerardsans
Unpopular opinion: Gradient descent and sampling won’t reach AGI. Meta’s PDR paper quiet admissions behind shiny evals: The workspace is not persistent. Long-context failure modes. “Manual” steering. Why is the transformer failing at every turn? Read: https://t.co/T4ib3pgCVg https://t.co/WlRx4Lo5D5