Viewing enriched Twitter post
The Case for Muon 1) We can descend 'faster' in non-Euclidean spaces 2) Adam/Shampoo/SOAP/etc. dynamically learn the preconditioner and, equivalently, the norm & space to descend in 3) Muon saves a lot of compute by simply letting the norm to vary within a fixed range https://t.co/PKpXrKSYpT
{
"user": {
"created_at": "2018-11-06T20:25:19.000Z",
"default_profile_image": false,
"description": "Math @ AdMU • soon Research Engineer @ ████ • prev ML @ Expedock • 2x IOI & 2x ICPC World Finalist • Non-Euclidean Geom, VLMs, Info Retrieval, Structured Gen",
"fast_followers_count": 0,
"favourites_count": 43455,
"followers_count": 2832,
"friends_count": 3640,
"has_custom_timelines": true,
"is_translator": false,
"listed_count": 36,
"location": "",
"media_count": 556,
"name": "leloy!",
"normal_followers_count": 2832,
"possibly_sensitive": false,
"profile_banner_url": "https://pbs.twimg.com/profile_banners/1059904581604270080/1701300468",
"profile_image_url_https": "https://pbs.twimg.com/profile_images/1789971317669896192/LkRHORmv_normal.jpg",
"screen_name": "leloykun",
"statuses_count": 7448,
"translator_type": "none",
"url": "https://t.co/680orkaaOD",
"verified": true,
"withheld_in_countries": [],
"id_str": "1059904581604270080"
},
"id": "1846842883967692926",
"conversation_id": "1846842883967692926",
"full_text": "The Case for Muon\n\n1) We can descend 'faster' in non-Euclidean spaces\n2) Adam/Shampoo/SOAP/etc. dynamically learn the preconditioner and, equivalently, the norm & space to descend in\n3) Muon saves a lot of compute by simply letting the norm to vary within a fixed range https://t.co/PKpXrKSYpT",
"reply_count": 9,
"retweet_count": 28,
"favorite_count": 442,
"hashtags": [],
"symbols": [],
"user_mentions": [],
"urls": [],
"media": [
{
"media_url": "https://pbs.twimg.com/media/GaFI4hFaUAA2GHy.jpg",
"type": "photo"
}
],
"url": "https://twitter.com/leloykun/status/1846842883967692926",
"created_at": "2024-10-17T09:17:10.000Z",
"#sort_index": "1847919153589735700",
"view_count": 193257,
"quote_count": 6,
"is_quote_tweet": true,
"is_retweet": false,
"is_pinned": false,
"is_truncated": false,
"startUrl": "https://x.com/leloykun/status/1847919153589735705"
}