🐦 Twitter Post Details

Viewing enriched Twitter post

@jcz42

We made Muon run up to 2x faster for free! Introducing Gram Newton-Schulz: a mathematically equivalent but computationally faster Newton-Schulz algorithm for polar decomposition. Gram Newton-Schulz rewrites Newton-Schulz such that instead of iterating on the expensive rectangular X matrix, we iterate on the small, square, symmetric XX^T Gram matrix to reduce FLOPs. This allows us to make more use of fast symmetric GEMM kernels on Hopper and Blackwell, halving the FLOPs of each of those GEMMs. Gram Newton-Schulz is a drop-in replacement of Newton-Schulz for your Muon use case: we see validation perplexity preserved within 0.01, and share our (long!) journey stabilizing this algorithm and ensuring that training quality is preserved above all else. This was a super fun project with @noahamsel, @berlinchen, and @tri_dao that spanned theory, numerical analysis, and ML systems! Blog and codebase linked below 🧵

Media 1
View on Twitter

📊 Media Metadata

{
  "media": [
    {
      "url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/2038660309968208028/media_0.jpg",
      "media_url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/2038660309968208028/media_0.jpg",
      "type": "photo",
      "filename": "media_0.jpg"
    }
  ],
  "processed_at": "2026-03-30T17:22:52.263005",
  "pipeline_version": "2.0"
}

🔧 Raw API Response

{
  "type": "tweet",
  "id": "2038660309968208028",
  "url": "https://x.com/jcz42/status/2038660309968208028",
  "twitterUrl": "https://twitter.com/jcz42/status/2038660309968208028",
  "text": "We made Muon run up to 2x faster for free!\n\nIntroducing Gram Newton-Schulz: a mathematically equivalent but computationally faster Newton-Schulz algorithm for polar decomposition.\n\nGram Newton-Schulz rewrites Newton-Schulz such that instead of iterating on the expensive rectangular X matrix, we iterate on the small, square, symmetric XX^T Gram matrix to reduce FLOPs. This allows us to make more use of fast symmetric GEMM kernels on Hopper and Blackwell, halving the FLOPs of each of those GEMMs.\n\nGram Newton-Schulz is a drop-in replacement of Newton-Schulz for your Muon use case: we see validation perplexity preserved within 0.01, and share our (long!) journey stabilizing this algorithm and ensuring that training quality is preserved above all else.\n\nThis was a super fun project with @noahamsel, @berlinchen, and @tri_dao that spanned theory, numerical analysis, and ML systems! Blog and codebase linked below 🧵",
  "source": "Twitter for iPhone",
  "retweetCount": 6,
  "replyCount": 1,
  "likeCount": 15,
  "quoteCount": 2,
  "viewCount": 547,
  "createdAt": "Mon Mar 30 16:51:09 +0000 2026",
  "lang": "en",
  "bookmarkCount": 5,
  "isReply": false,
  "inReplyToId": null,
  "conversationId": "2038660309968208028",
  "displayTextRange": [
    0,
    270
  ],
  "inReplyToUserId": null,
  "inReplyToUsername": null,
  "author": {
    "type": "user",
    "userName": "jcz42",
    "url": "https://x.com/jcz42",
    "twitterUrl": "https://twitter.com/jcz42",
    "id": "1812253076025389056",
    "name": "Jack Zhang",
    "isVerified": false,
    "isBlueVerified": true,
    "verifiedType": null,
    "profilePicture": "https://pbs.twimg.com/profile_images/1884023729371635713/EkuKCv20_normal.jpg",
    "coverPicture": "",
    "description": "",
    "location": "Princeton, NJ",
    "followers": 85,
    "following": 341,
    "status": "",
    "canDm": false,
    "canMediaTag": false,
    "createdAt": "Sat Jul 13 22:29:50 +0000 2024",
    "entities": {
      "description": {
        "urls": []
      },
      "url": {}
    },
    "fastFollowersCount": 0,
    "favouritesCount": 486,
    "hasCustomTimelines": true,
    "isTranslator": false,
    "mediaCount": 3,
    "statusesCount": 24,
    "withheldInCountries": [],
    "affiliatesHighlightedLabel": {},
    "possiblySensitive": false,
    "pinnedTweetIds": [],
    "profile_bio": {
      "description": "",
      "entities": {
        "description": {
          "hashtags": [],
          "symbols": [],
          "urls": [],
          "user_mentions": []
        }
      }
    },
    "isAutomated": false,
    "automatedBy": null
  },
  "extendedEntities": {
    "media": [
      {
        "allow_download_status": {
          "allow_download": true
        },
        "display_url": "pic.twitter.com/SE9T8GDN9F",
        "expanded_url": "https://twitter.com/jcz42/status/2038660309968208028/photo/1",
        "ext_media_availability": {
          "status": "Available"
        },
        "features": {
          "large": {
            "faces": []
          },
          "orig": {
            "faces": []
          }
        },
        "id_str": "2038659105305567232",
        "indices": [
          271,
          294
        ],
        "media_key": "3_2038659105305567232",
        "media_results": {
          "id": "QXBpTWVkaWFSZXN1bHRzOgwAAQoAARxKxaet2qAACgACHErGwClXwJwAAA==",
          "result": {
            "__typename": "ApiMedia",
            "id": "QXBpTWVkaWE6DAABCgABHErFp63aoAAKAAIcSsbAKVfAnAAA",
            "media_key": "3_2038659105305567232"
          }
        },
        "media_url_https": "https://pbs.twimg.com/media/HErFp63aoAAS6U3.png",
        "original_info": {
          "focus_rects": [
            {
              "h": 1126,
              "w": 2011,
              "x": 0,
              "y": 0
            },
            {
              "h": 1126,
              "w": 1126,
              "x": 0,
              "y": 0
            },
            {
              "h": 1126,
              "w": 988,
              "x": 0,
              "y": 0
            },
            {
              "h": 1126,
              "w": 563,
              "x": 68,
              "y": 0
            },
            {
              "h": 1126,
              "w": 2799,
              "x": 0,
              "y": 0
            }
          ],
          "height": 1126,
          "width": 2799
        },
        "sizes": {
          "large": {
            "h": 824,
            "w": 2048
          }
        },
        "type": "photo",
        "url": "https://t.co/SE9T8GDN9F"
      }
    ]
  },
  "card": null,
  "place": {},
  "entities": {
    "hashtags": [],
    "symbols": [],
    "urls": [],
    "user_mentions": [
      {
        "id_str": "1677141799968681984",
        "indices": [
          794,
          804
        ],
        "name": "noahamsel",
        "screen_name": "noahamsel"
      },
      {
        "id_str": "23850116",
        "indices": [
          806,
          817
        ],
        "name": "Berlinette",
        "screen_name": "berlinchen"
      },
      {
        "id_str": "568879807",
        "indices": [
          823,
          831
        ],
        "name": "Tri Dao",
        "screen_name": "tri_dao"
      }
    ]
  },
  "quoted_tweet": null,
  "retweeted_tweet": null,
  "isLimitedReply": false,
  "article": null
}