🐦 Twitter Post Details

Viewing enriched Twitter post

@rasbt

Now we know: The popular Ox Alpha LLM was GLM-5.3-Flash... Compared to GLM-5.2, this new GLM-5.3-Flash model uses: - a Kimi Linear-style 3:1 (super*) hybrid attention pattern with 34 Kimi Delta Attention layers (KDA) and 11 Multi-heat Latent Attention (MLA) / DeepSeek Sparse Attention (DSA) layers; - a scaled-down GLM-5.2-style sparse MoE backbone, going from 744B-A40B to 320B-A18B; - a DeepSeek V4-style mHC residual path with four parallel streams; - plus a native vision encoder (not shown). * "Super hybrid" because both KDA and MLA/DSA are "efficient" components. E.g., Kimi only uses KDA + full attention GQA, DeepSeek V3.2 uses DSA + full attention MLA. PS: Sry for the excessive tech jargon. Explainers on all these components (MLA, DSA, KDA, mhC, etc.) in my LLM Architecture Gallery PPS: Haha, maybe justification for getting that pricey Mac Studio M5 Ultra 256 GB / 512 GB to run this locally...

Media 1
View on Twitter

📊 Media Metadata

{
  "media": [
    {
      "type": "photo",
      "url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/2092629415813365899/media_0.jpg",
      "filename": "media_0.jpg"
    }
  ],
  "processed_at": "2026-08-26T19:04:47.245893",
  "pipeline_version": "2.0"
}

🔧 Raw API Response

{
  "type": "tweet",
  "id": "2092629415813365899",
  "url": "https://x.com/rasbt/status/2092629415813365899",
  "twitterUrl": "https://twitter.com/rasbt/status/2092629415813365899",
  "text": "Now we know: The popular Ox Alpha LLM was GLM-5.3-Flash...\n\nCompared to GLM-5.2, this new GLM-5.3-Flash model uses:\n\n- a Kimi Linear-style 3:1 (super*) hybrid attention pattern with 34 Kimi Delta Attention layers (KDA) and 11 Multi-heat Latent Attention (MLA) / DeepSeek Sparse Attention (DSA) layers;\n- a scaled-down GLM-5.2-style sparse MoE backbone, going from 744B-A40B to 320B-A18B;\n- a DeepSeek V4-style mHC residual path with four parallel streams;\n- plus a native vision encoder (not shown).\n\n* \"Super hybrid\" because both KDA and MLA/DSA are \"efficient\" components. E.g., Kimi only uses KDA + full attention GQA, DeepSeek V3.2 uses DSA + full attention MLA.\n\nPS: Sry for the excessive tech jargon. Explainers on all these components (MLA, DSA, KDA, mhC, etc.) in my LLM Architecture Gallery\n\nPPS: Haha, maybe justification for getting that pricey Mac Studio M5 Ultra 256 GB / 512 GB to run this locally...",
  "source": "Twitter for iPhone",
  "retweetCount": 84,
  "replyCount": 25,
  "likeCount": 917,
  "quoteCount": 4,
  "viewCount": 53455,
  "createdAt": "Wed Aug 26 15:05:06 +0000 2026",
  "lang": "en",
  "bookmarkCount": 433,
  "isReply": false,
  "inReplyToId": null,
  "conversationId": "2092629415813365899",
  "displayTextRange": [
    0,
    277
  ],
  "inReplyToUserId": null,
  "inReplyToUsername": null,
  "author": {
    "type": "user",
    "userName": "rasbt",
    "url": "https://x.com/rasbt",
    "twitterUrl": "https://twitter.com/rasbt",
    "id": "865622395",
    "name": "Sebastian Raschka",
    "isVerified": false,
    "isBlueVerified": true,
    "verifiedType": null,
    "profilePicture": "https://pbs.twimg.com/profile_images/1661187442043486209/a3E4t1eV_normal.jpg",
    "coverPicture": "https://pbs.twimg.com/profile_banners/865622395/1742309979",
    "description": "",
    "location": "United States",
    "followers": 497543,
    "following": 1183,
    "status": "",
    "canDm": false,
    "canMediaTag": true,
    "createdAt": "Sun Oct 07 02:06:16 +0000 2012",
    "entities": {
      "description": {
        "urls": []
      },
      "url": {}
    },
    "fastFollowersCount": 0,
    "favouritesCount": 25728,
    "hasCustomTimelines": true,
    "isTranslator": false,
    "mediaCount": 2164,
    "statusesCount": 20099,
    "withheldInCountries": [],
    "affiliatesHighlightedLabel": {},
    "possiblySensitive": false,
    "pinnedTweetIds": [
      "2078471977237450829"
    ],
    "profile_bio": {
      "description": "ML/AI research engineer. Ex stats professor.\nAuthor of \"Build a Large Language Model From Scratch\" (https://t.co/O8LAAMRzzW) & reasoning (https://t.co/5TueQKx2Fk)",
      "entities": {
        "description": {
          "urls": [
            {
              "display_url": "amzn.to/4fqvn0D",
              "expanded_url": "https://amzn.to/4fqvn0D",
              "indices": [
                100,
                123
              ],
              "url": "https://t.co/O8LAAMRzzW"
            },
            {
              "display_url": "mng.bz/lZ5B",
              "expanded_url": "https://mng.bz/lZ5B",
              "indices": [
                138,
                161
              ],
              "url": "https://t.co/5TueQKx2Fk"
            }
          ]
        },
        "url": {
          "urls": [
            {
              "display_url": "sebastianraschka.com",
              "expanded_url": "https://sebastianraschka.com",
              "indices": [
                0,
                23
              ],
              "url": "https://t.co/HrtQQ5tgJl"
            }
          ]
        }
      }
    },
    "isAutomated": false,
    "automatedBy": null
  },
  "extendedEntities": {
    "media": [
      {
        "allow_download_status": {
          "allow_download": true
        },
        "display_url": "pic.x.com/87WZhS9bBw",
        "expanded_url": "https://x.com/rasbt/status/2092629415813365899/photo/1",
        "ext_master_playlist_only": [],
        "ext_media_availability": {
          "status": "Available"
        },
        "ext_playlists": [],
        "features": {
          "large": {
            "faces": []
          },
          "orig": {
            "faces": []
          }
        },
        "id_str": "2092628864962838528",
        "indices": [
          278,
          301
        ],
        "media_key": "3_2092628864962838528",
        "media_results": {
          "id": "QXBpTWVkaWFSZXN1bHRzOgwAAQoAAR0Kgt2O1sAACgACHQqDXdAWwIsAAA==",
          "result": {
            "__typename": "ApiMedia",
            "id": "QXBpTWVkaWE6DAABCgABHQqC3Y7WwAAKAAIdCoNd0BbAiwAA",
            "media_key": "3_2092628864962838528"
          }
        },
        "media_url_https": "https://pbs.twimg.com/media/HQqC3Y7WwAAL92J.jpg",
        "original_info": {
          "focus_rects": [
            {
              "h": 2195,
              "w": 3920,
              "x": 0,
              "y": 0
            },
            {
              "h": 3308,
              "w": 3308,
              "x": 0,
              "y": 0
            },
            {
              "h": 3308,
              "w": 2902,
              "x": 0,
              "y": 0
            },
            {
              "h": 3308,
              "w": 1654,
              "x": 0,
              "y": 0
            },
            {
              "h": 3308,
              "w": 3920,
              "x": 0,
              "y": 0
            }
          ],
          "height": 3308,
          "width": 3920
        },
        "sizes": {
          "large": {
            "h": 1728,
            "w": 2048
          }
        },
        "type": "photo",
        "url": "https://t.co/87WZhS9bBw"
      }
    ]
  },
  "card": null,
  "place": {},
  "entities": {
    "hashtags": [],
    "symbols": [],
    "urls": [],
    "user_mentions": []
  },
  "quoted_tweet": {
    "type": "tweet",
    "id": "2092616204787626030",
    "url": "https://x.com/Zai_org/status/2092616204787626030",
    "twitterUrl": "https://twitter.com/Zai_org/status/2092616204787626030",
    "text": "Introducing GLM-5.3-Flash\n\n- Leading capabilities at a highly competitive price\n- Natively multimodal with a 1M-token context window\n- A 320B-A18B model released under the MIT License\n- Previously previewed as Ox Alpha, running entirely on Chinese AI chips\n\nBlog: https://t.co/tzOmB7gdZP\n\nAvailable now across all official platforms:\n\nWeights: https://t.co/9LRMahY9Wa\nAPI: https://t.co/VcaQnzYmS9\nCoding Plan: https://t.co/Nk8Y98HNhU\nZCode: https://t.co/Peepqv4XSx\nChat: https://t.co/WCqWT0qCQb\nAutoClaw: https://t.co/aGEG5HqTTb",
    "source": "Twitter for iPhone",
    "retweetCount": 1896,
    "replyCount": 756,
    "likeCount": 17270,
    "quoteCount": 1534,
    "viewCount": 2409732,
    "createdAt": "Wed Aug 26 14:12:36 +0000 2026",
    "lang": "en",
    "bookmarkCount": 2840,
    "isReply": false,
    "inReplyToId": null,
    "conversationId": "2092616204787626030",
    "displayTextRange": [
      0,
      263
    ],
    "inReplyToUserId": null,
    "inReplyToUsername": null,
    "author": {
      "type": "user",
      "userName": "Zai_org",
      "url": "https://x.com/Zai_org",
      "twitterUrl": "https://twitter.com/Zai_org",
      "id": "1726486879456096256",
      "name": "Z.ai",
      "isVerified": false,
      "isBlueVerified": false,
      "verifiedType": "Business",
      "profilePicture": "https://pbs.twimg.com/profile_images/1970775077181411328/W8XKaUIh_normal.jpg",
      "coverPicture": "https://pbs.twimg.com/profile_banners/1726486879456096256/1786708959",
      "description": "",
      "location": "user_feedback@z.ai",
      "followers": 146506,
      "following": 268,
      "status": "",
      "canDm": true,
      "canMediaTag": true,
      "createdAt": "Mon Nov 20 06:25:51 +0000 2023",
      "entities": {
        "description": {
          "urls": []
        },
        "url": {}
      },
      "fastFollowersCount": 0,
      "favouritesCount": 1465,
      "hasCustomTimelines": true,
      "isTranslator": false,
      "mediaCount": 234,
      "statusesCount": 1236,
      "withheldInCountries": [],
      "affiliatesHighlightedLabel": {},
      "possiblySensitive": false,
      "pinnedTweetIds": [
        "2092616204787626030"
      ],
      "profile_bio": {
        "description": "The AI Lab behind GLM models, dedicated to inspiring the development of AGI to benefit humanity.\nhttps://t.co/gOw7WpwkJt\nhttps://t.co/ot9sGVXU8x",
        "entities": {
          "description": {
            "urls": [
              {
                "display_url": "huggingface.co/zai-org",
                "expanded_url": "http://huggingface.co/zai-org",
                "indices": [
                  97,
                  120
                ],
                "url": "https://t.co/gOw7WpwkJt"
              },
              {
                "display_url": "discord.com/invite/QR7SARH…",
                "expanded_url": "http://discord.com/invite/QR7SARHRxK",
                "indices": [
                  121,
                  144
                ],
                "url": "https://t.co/ot9sGVXU8x"
              }
            ]
          }
        }
      },
      "isAutomated": false,
      "automatedBy": null
    },
    "extendedEntities": {
      "media": [
        {
          "allow_download_status": {
            "allow_download": true
          },
          "display_url": "pic.x.com/KOCG4dkay3",
          "expanded_url": "https://x.com/Zai_org/status/2092616204787626030/photo/1",
          "ext_master_playlist_only": [],
          "ext_media_availability": {
            "status": "Available"
          },
          "ext_playlists": [],
          "features": {
            "large": {
              "faces": [
                {
                  "h": 100,
                  "w": 100,
                  "x": 1602,
                  "y": 776
                }
              ]
            },
            "orig": {
              "faces": [
                {
                  "h": 200,
                  "w": 200,
                  "x": 3204,
                  "y": 1552
                }
              ]
            }
          },
          "id_str": "2092613463491104768",
          "indices": [
            264,
            287
          ],
          "media_key": "3_2092613463491104768",
          "media_results": {
            "id": "QXBpTWVkaWFSZXN1bHRzOgwAAQoAAR0KdNufllAACgACHQp3WeGXsC4AAA==",
            "result": {
              "__typename": "ApiMedia",
              "id": "QXBpTWVkaWE6DAABCgABHQp025+WUAAKAAIdCndZ4ZewLgAA",
              "media_key": "3_2092613463491104768"
            }
          },
          "media_url_https": "https://pbs.twimg.com/media/HQp025-WUAAmoxY.jpg",
          "original_info": {
            "focus_rects": [
              {
                "h": 2294,
                "w": 4096,
                "x": 0,
                "y": 0
              },
              {
                "h": 2554,
                "w": 2554,
                "x": 0,
                "y": 0
              },
              {
                "h": 2554,
                "w": 2240,
                "x": 0,
                "y": 0
              },
              {
                "h": 2554,
                "w": 1277,
                "x": 0,
                "y": 0
              },
              {
                "h": 2554,
                "w": 4096,
                "x": 0,
                "y": 0
              }
            ],
            "height": 2554,
            "width": 4096
          },
          "sizes": {
            "large": {
              "h": 1277,
              "w": 2048
            }
          },
          "type": "photo",
          "url": "https://t.co/KOCG4dkay3"
        }
      ]
    },
    "card": null,
    "place": {},
    "entities": {
      "hashtags": [],
      "symbols": [],
      "urls": [
        {
          "display_url": "z.ai/blog/glm-5.3-f…",
          "expanded_url": "http://z.ai/blog/glm-5.3-flash",
          "indices": [
            264,
            287
          ],
          "url": "https://t.co/tzOmB7gdZP"
        },
        {
          "display_url": "huggingface.co/zai-org/GLM-5.…",
          "expanded_url": "http://huggingface.co/zai-org/GLM-5.3-Flash",
          "indices": [
            344,
            367
          ],
          "url": "https://t.co/9LRMahY9Wa"
        },
        {
          "display_url": "docs.z.ai/guides/llm/glm…",
          "expanded_url": "http://docs.z.ai/guides/llm/glm-5.3-flash",
          "indices": [
            373,
            396
          ],
          "url": "https://t.co/VcaQnzYmS9"
        },
        {
          "display_url": "z.ai/subscribe",
          "expanded_url": "http://z.ai/subscribe",
          "indices": [
            410,
            433
          ],
          "url": "https://t.co/Nk8Y98HNhU"
        },
        {
          "display_url": "zcode.z.ai/en",
          "expanded_url": "http://zcode.z.ai/en",
          "indices": [
            441,
            464
          ],
          "url": "https://t.co/Peepqv4XSx"
        },
        {
          "display_url": "chat.z.ai",
          "expanded_url": "http://chat.z.ai",
          "indices": [
            471,
            494
          ],
          "url": "https://t.co/WCqWT0qCQb"
        },
        {
          "display_url": "autoclaw.z.ai",
          "expanded_url": "http://autoclaw.z.ai",
          "indices": [
            505,
            528
          ],
          "url": "https://t.co/aGEG5HqTTb"
        }
      ],
      "user_mentions": []
    },
    "quoted_tweet": null,
    "retweeted_tweet": null,
    "isLimitedReply": false,
    "communityInfo": null,
    "article": null
  },
  "retweeted_tweet": null,
  "isLimitedReply": false,
  "communityInfo": null,
  "article": null
}