{
  "type": "tweet",
  "id": "2115844430871597430",
  "url": "https://x.com/Tim_Dettmers/status/2115844430871597430",
  "twitterUrl": "https://twitter.com/Tim_Dettmers/status/2115844430871597430",
  "text": "RT @_albertgu: I've always believed that intelligence should come from simple, general building blocks that learn their own abstractions di…",
  "source": "",
  "retweetCount": 705,
  "replyCount": 228,
  "likeCount": 6524,
  "quoteCount": 257,
  "viewCount": 792345,
  "createdAt": "Thu Oct 29 16:33:17 +0000 2026",
  "lang": "en",
  "bookmarkCount": 5517,
  "isReply": false,
  "inReplyToId": null,
  "conversationId": "2115844430871597430",
  "displayTextRange": [
    0,
    140
  ],
  "inReplyToUserId": null,
  "inReplyToUsername": null,
  "author": {
    "type": "user",
    "userName": "Tim_Dettmers",
    "url": "https://x.com/Tim_Dettmers",
    "twitterUrl": "https://twitter.com/Tim_Dettmers",
    "id": "872274950",
    "name": "Tim Dettmers",
    "isVerified": false,
    "isBlueVerified": true,
    "verifiedType": null,
    "profilePicture": "https://pbs.twimg.com/profile_images/1998431471304876032/BhUl3uX9_normal.jpg",
    "coverPicture": "https://pbs.twimg.com/profile_banners/872274950/1738601851",
    "description": "",
    "location": "Pittsburgh, PA",
    "followers": 50082,
    "following": 919,
    "status": "",
    "canDm": true,
    "canMediaTag": true,
    "createdAt": "Wed Oct 10 18:18:30 +0000 2012",
    "entities": {
      "description": {
        "urls": []
      },
      "url": {}
    },
    "fastFollowersCount": 0,
    "favouritesCount": 4402,
    "hasCustomTimelines": true,
    "isTranslator": false,
    "mediaCount": 143,
    "statusesCount": 3958,
    "withheldInCountries": [],
    "affiliatesHighlightedLabel": {},
    "possiblySensitive": false,
    "pinnedTweetIds": [
      "1818282778057941042"
    ],
    "profile_bio": {
      "description": "Creator of bitsandbytes. Professor @CarnegieMellon and Research Scientist @allen_ai .  I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.",
      "entities": {
        "description": {
          "urls": [
            {
              "display_url": "timdettmers.com",
              "expanded_url": "http://timdettmers.com",
              "indices": [
                130,
                153
              ],
              "url": "https://t.co/Y78KDJJFE7"
            }
          ],
          "user_mentions": [
            {
              "id_str": "",
              "indices": [
                35,
                50
              ],
              "name": "",
              "screen_name": "CarnegieMellon"
            },
            {
              "id_str": "",
              "indices": [
                74,
                83
              ],
              "name": "",
              "screen_name": "allen_ai"
            }
          ]
        },
        "url": {
          "urls": [
            {
              "display_url": "timdettmers.com/about",
              "expanded_url": "http://timdettmers.com/about",
              "indices": [
                0,
                23
              ],
              "url": "https://t.co/H5HgSvHWXO"
            }
          ]
        }
      }
    },
    "isAutomated": false,
    "automatedBy": null,
    "protected": false
  },
  "extendedEntities": {},
  "card": null,
  "place": {},
  "entities": {
    "user_mentions": [
      {
        "id_str": "1076265378118959104",
        "indices": [
          3,
          13
        ],
        "name": "Albert Gu",
        "screen_name": "_albertgu"
      }
    ]
  },
  "quoted_tweet": null,
  "retweeted_tweet": {
    "type": "tweet",
    "id": "2115502110578290900",
    "url": "https://x.com/_albertgu/status/2115502110578290900",
    "twitterUrl": "https://twitter.com/_albertgu/status/2115502110578290900",
    "text": "I've always believed that intelligence should come from simple, general building blocks that learn their own abstractions directly from raw data; in other words, the bitter lesson. I think we're finally seeing a real step towards AI that can learn from all data.\n\nLanguage modeling on raw bytes is a microcosm of this ideal, and to me it's a central problem in AI: if we can't build LLMs that learn end-to-end from bytes, how will we handle the rest of the world's data that we understand even less?\n\nLast year we introduced hierarchical networks (H-Nets) as a first step. Our new version finds up to 3-5x efficiency gains in controlled scaling law experiments, and at larger scale matches an open-source model trained on 11T tokens with ~10x less data and compute. The posts below walk through what we found and why we think it works.",
    "source": "",
    "retweetCount": 705,
    "replyCount": 228,
    "likeCount": 6524,
    "quoteCount": 257,
    "viewCount": 792345,
    "createdAt": "Wed Oct 28 17:53:01 +0000 2026",
    "lang": "en",
    "bookmarkCount": 5517,
    "isReply": false,
    "inReplyToId": null,
    "conversationId": "2115502110578290900",
    "displayTextRange": [
      0,
      272
    ],
    "inReplyToUserId": null,
    "inReplyToUsername": null,
    "author": {
      "type": "user",
      "userName": "_albertgu",
      "url": "https://x.com/_albertgu",
      "twitterUrl": "https://twitter.com/_albertgu",
      "id": "1076265378118959104",
      "name": "Albert Gu",
      "isVerified": false,
      "isBlueVerified": true,
      "verifiedType": null,
      "profilePicture": "https://pbs.twimg.com/profile_images/2011884912593551360/voG84B15_normal.jpg",
      "coverPicture": "",
      "description": "",
      "location": "",
      "followers": 25964,
      "following": 78,
      "status": "",
      "canDm": true,
      "canMediaTag": true,
      "createdAt": "Fri Dec 21 23:57:16 +0000 2018",
      "entities": {
        "description": {
          "urls": []
        },
        "url": {}
      },
      "fastFollowersCount": 0,
      "favouritesCount": 3662,
      "hasCustomTimelines": true,
      "isTranslator": false,
      "mediaCount": 62,
      "statusesCount": 645,
      "withheldInCountries": [],
      "affiliatesHighlightedLabel": {
        "label": {
          "badge": {
            "url": "https://pbs.twimg.com/profile_images/2059814192769830912/AlZscu52_bigger.jpg"
          },
          "description": "Cartesia",
          "url": {
            "url": "https://twitter.com/cartesia",
            "url_type": "DeepLink"
          },
          "user_label_display_type": "Badge",
          "user_label_type": "BusinessLabel"
        }
      },
      "possiblySensitive": false,
      "pinnedTweetIds": [
        "2115502110578290900"
      ],
      "profile_bio": {
        "description": "assistant prof @mldcmu. chief scientist @cartesia. leading the ssm revolution.",
        "entities": {
          "description": {
            "user_mentions": [
              {
                "id_str": "",
                "indices": [
                  15,
                  22
                ],
                "name": "",
                "screen_name": "mldcmu"
              },
              {
                "id_str": "",
                "indices": [
                  40,
                  49
                ],
                "name": "",
                "screen_name": "cartesia"
              }
            ]
          }
        }
      },
      "isAutomated": false,
      "automatedBy": null,
      "protected": false
    },
    "extendedEntities": {
      "media": [
        {
          "additional_media_info": {
            "monetizable": false
          },
          "allow_download_status": {},
          "display_url": "pic.x.com/aEUoLCTPB3",
          "expanded_url": "https://x.com/_albertgu/status/2115502110578290900/video/1",
          "ext_master_playlist_only": [],
          "ext_media_availability": {
            "status": "Available"
          },
          "ext_playlists": [],
          "id_str": "2115501577012461568",
          "indices": [
            273,
            296
          ],
          "media_key": "13_2115501577012461568",
          "media_results": {
            "id": "QXBpTWVkaWFSZXN1bHRzOgwABAoAAR1bxXnTm0AAAAA=",
            "result": {
              "__typename": "ApiMedia",
              "id": "QXBpTWVkaWE6DAAECgABHVvFedObQAAAAA==",
              "media_key": "13_2115501577012461568"
            }
          },
          "media_url_https": "https://pbs.twimg.com/media/HVvH33RaQAE6DlQ.jpg",
          "original_info": {
            "focus_rects": [],
            "height": 1080,
            "width": 1920
          },
          "sizes": {
            "large": {
              "h": 1080,
              "w": 1920
            }
          },
          "type": "video",
          "url": "https://t.co/aEUoLCTPB3",
          "video_info": {
            "aspect_ratio": [
              16,
              9
            ],
            "duration_millis": 78912,
            "variants": [
              {
                "content_type": "application/x-mpegURL",
                "url": "https://video.twimg.com/amplify_video/2115501577012461568/pl/W6wjNNAgbONoqJpr.m3u8?tag=29&v=bf4"
              },
              {
                "bitrate": 256000,
                "content_type": "video/mp4",
                "url": "https://video.twimg.com/amplify_video/2115501577012461568/vid/avc1/480x270/Xnh8jW3qGz3z06Sc.mp4?tag=29"
              },
              {
                "bitrate": 832000,
                "content_type": "video/mp4",
                "url": "https://video.twimg.com/amplify_video/2115501577012461568/vid/avc1/640x360/tpviwSUqqflv7aab.mp4?tag=29"
              },
              {
                "bitrate": 2176000,
                "content_type": "video/mp4",
                "url": "https://video.twimg.com/amplify_video/2115501577012461568/vid/avc1/1280x720/zeatz9JaTYGqZ0H2.mp4?tag=29"
              },
              {
                "bitrate": 10368000,
                "content_type": "video/mp4",
                "url": "https://video.twimg.com/amplify_video/2115501577012461568/vid/avc1/1920x1080/Yjs4MoGlnchqw209.mp4?tag=29"
              }
            ]
          }
        }
      ]
    },
    "card": null,
    "place": {},
    "entities": {
      "hashtags": [],
      "symbols": [],
      "timestamps": [],
      "urls": [],
      "user_mentions": []
    },
    "quoted_tweet": null,
    "retweeted_tweet": null,
    "isLimitedReply": false,
    "communityInfo": null,
    "article": null
  },
  "isLimitedReply": false,
  "communityInfo": null,
  "article": null
}