🐦 Twitter Post Details

Viewing enriched Twitter post

@LiorOnAI

You now convert any LLM into a faster one without retraining from scratch. NVIDIA just did this to their 30B model. Here's the trick: 1. Duplicate the model into two copies 2. Freeze one copy, it just reads the prompt and remembers context 3. Train the other copy to write chunks of text at once instead of one word at a time 4. Run them together The frozen copy barely costs anything (it's already trained). The new copy only needed ~8% of the original training data to learn the new trick. Result: 2.4x faster generation, keeping ~99% of the original quality.

📊 Media Metadata

{
  "score": 0.42,
  "score_components": {
    "author": 0.09,
    "engagement": 0.0,
    "quality": 0.12,
    "source": 0.135,
    "nlp": 0.05,
    "recency": 0.025
  },
  "scored_at": "2026-07-01T20:02:06.853715",
  "import_source": "api_import",
  "source_tagged_at": "2026-07-01T20:02:06.853727",
  "enriched": true,
  "enriched_at": "2026-07-01T20:02:06.853730"
}

🔧 Raw API Response

{
  "type": "tweet",
  "id": "2072402904867365167",
  "url": "https://x.com/LiorOnAI/status/2072402904867365167",
  "twitterUrl": "https://twitter.com/LiorOnAI/status/2072402904867365167",
  "text": "You now convert any LLM into a faster one without retraining from scratch.\n\nNVIDIA just did this to their 30B model. Here's the trick:\n\n1. Duplicate the model into two copies\n\n2. Freeze one copy, it just reads the prompt and remembers context\n\n3. Train the other copy to write chunks of text at once instead of one word at a time\n\n4. Run them together\n\nThe frozen copy barely costs anything (it's already trained). The new copy only needed ~8% of the original training data to learn the new trick.\n\nResult: 2.4x faster generation, keeping ~99% of the original quality.",
  "source": "Twitter for iPhone",
  "retweetCount": 2,
  "replyCount": 2,
  "likeCount": 10,
  "quoteCount": 0,
  "viewCount": 1546,
  "createdAt": "Wed Jul 01 19:32:10 +0000 2026",
  "lang": "en",
  "bookmarkCount": 8,
  "isReply": false,
  "inReplyToId": null,
  "conversationId": "2072402904867365167",
  "displayTextRange": [
    0,
    276
  ],
  "inReplyToUserId": null,
  "inReplyToUsername": null,
  "author": {
    "type": "user",
    "userName": "LiorOnAI",
    "url": "https://x.com/LiorOnAI",
    "twitterUrl": "https://twitter.com/LiorOnAI",
    "id": "931470139",
    "name": "Lior Alexander",
    "isVerified": false,
    "isBlueVerified": true,
    "verifiedType": null,
    "profilePicture": "https://pbs.twimg.com/profile_images/2032256308196564993/ozddLZ2O_normal.jpg",
    "coverPicture": "https://pbs.twimg.com/profile_banners/931470139/1761077189",
    "description": "",
    "location": "San Francisco, CA",
    "followers": 115949,
    "following": 2391,
    "status": "",
    "canDm": true,
    "canMediaTag": false,
    "createdAt": "Wed Nov 07 07:19:36 +0000 2012",
    "entities": {
      "description": {
        "urls": []
      },
      "url": {}
    },
    "fastFollowersCount": 0,
    "favouritesCount": 7002,
    "hasCustomTimelines": true,
    "isTranslator": false,
    "mediaCount": 665,
    "statusesCount": 3813,
    "withheldInCountries": [],
    "affiliatesHighlightedLabel": {},
    "possiblySensitive": false,
    "pinnedTweetIds": [],
    "profile_bio": {
      "description": "Founder @AlphaSignalAI • MIT Lecturer • ex-MILA researcher • In AI for the last 10 years.",
      "entities": {
        "description": {
          "user_mentions": [
            {
              "id_str": "",
              "indices": [
                8,
                22
              ],
              "name": "",
              "screen_name": "AlphaSignalAI"
            }
          ]
        },
        "url": {
          "urls": [
            {
              "display_url": "alphasignal.ai",
              "expanded_url": "https://alphasignal.ai",
              "indices": [
                0,
                23
              ],
              "url": "https://t.co/AyubevaLcb"
            }
          ]
        }
      }
    },
    "isAutomated": false,
    "automatedBy": null
  },
  "extendedEntities": {},
  "card": null,
  "place": {},
  "entities": {
    "hashtags": [],
    "symbols": [],
    "urls": [],
    "user_mentions": []
  },
  "quoted_tweet": {
    "type": "tweet",
    "id": "2072394812301480067",
    "url": "https://x.com/NVIDIAAI/status/2072394812301480067",
    "twitterUrl": "https://twitter.com/NVIDIAAI/status/2072394812301480067",
    "text": "We took a 30B model and split it in two to write tokens in parallel instead of one at a time.\n\nIntroducing Nemotron-Labs-TwoTower: a diffusion language model from NVIDIA Research adapted from Nemotron-3-Nano-30B-A3B. Here’s how it works: one half holds the context, the other writes the tokens, with both reusing the pretrained model instead of training a new one from scratch.\n\nWe found it kept 98.7% of the original model’s quality at 2.42× faster generation.",
    "source": "Twitter for iPhone",
    "retweetCount": 87,
    "replyCount": 31,
    "likeCount": 822,
    "quoteCount": 38,
    "viewCount": 37719,
    "createdAt": "Wed Jul 01 19:00:01 +0000 2026",
    "lang": "en",
    "bookmarkCount": 386,
    "isReply": false,
    "inReplyToId": null,
    "conversationId": "2072394812301480067",
    "displayTextRange": [
      0,
      275
    ],
    "inReplyToUserId": null,
    "inReplyToUsername": null,
    "author": {
      "type": "user",
      "userName": "NVIDIAAI",
      "url": "https://x.com/NVIDIAAI",
      "twitterUrl": "https://twitter.com/NVIDIAAI",
      "id": "740238495952736256",
      "name": "NVIDIA AI",
      "isVerified": false,
      "isBlueVerified": true,
      "verifiedType": "Business",
      "profilePicture": "https://pbs.twimg.com/profile_images/2055340743552831488/me-KUIug_normal.png",
      "coverPicture": "https://pbs.twimg.com/profile_banners/740238495952736256/1780334859",
      "description": "",
      "location": "Santa Clara, CA",
      "followers": 315591,
      "following": 879,
      "status": "",
      "canDm": true,
      "canMediaTag": true,
      "createdAt": "Tue Jun 07 17:46:25 +0000 2016",
      "entities": {
        "description": {
          "urls": []
        },
        "url": {}
      },
      "fastFollowersCount": 0,
      "favouritesCount": 7063,
      "hasCustomTimelines": true,
      "isTranslator": false,
      "mediaCount": 6173,
      "statusesCount": 13139,
      "withheldInCountries": [],
      "affiliatesHighlightedLabel": {},
      "possiblySensitive": false,
      "pinnedTweetIds": [
        "2062521325076299981"
      ],
      "profile_bio": {
        "description": "Teaching your AI new tricks.",
        "entities": {
          "description": {},
          "url": {
            "urls": [
              {
                "display_url": "developer.nvidia.com",
                "expanded_url": "https://developer.nvidia.com/",
                "indices": [
                  0,
                  23
                ],
                "url": "https://t.co/Cv3zwlWufE"
              }
            ]
          }
        }
      },
      "isAutomated": false,
      "automatedBy": null
    },
    "extendedEntities": {
      "media": [
        {
          "additional_media_info": {
            "monetizable": false
          },
          "display_url": "pic.twitter.com/Uza5QAO7N9",
          "expanded_url": "https://twitter.com/NVIDIAAI/status/2072394812301480067/video/1",
          "ext_master_playlist_only": [],
          "ext_media_availability": {
            "status": "Available"
          },
          "ext_playlists": [],
          "id_str": "2072381487169642496",
          "indices": [
            276,
            299
          ],
          "media_key": "13_2072381487169642496",
          "media_results": {
            "id": "QXBpTWVkaWFSZXN1bHRzOgwABAoAARzCk/uN16AAAAA=",
            "result": {
              "__typename": "ApiMedia",
              "id": "QXBpTWVkaWE6DAAECgABHMKT+43XoAAAAA==",
              "media_key": "13_2072381487169642496"
            }
          },
          "media_url_https": "https://pbs.twimg.com/amplify_video_thumb/2072381487169642496/img/FRr8WMcAP454KM_l.jpg",
          "original_info": {
            "focus_rects": [],
            "height": 1080,
            "width": 1080
          },
          "sizes": {
            "large": {
              "h": 1080,
              "w": 1080
            }
          },
          "type": "video",
          "url": "https://t.co/Uza5QAO7N9",
          "video_info": {
            "aspect_ratio": [
              1,
              1
            ],
            "duration_millis": 13200,
            "variants": [
              {
                "content_type": "application/x-mpegURL",
                "url": "https://video.twimg.com/amplify_video/2072381487169642496/pl/7yzWbN8Iq5QJKD6W.m3u8?tag=14&v=cfc"
              },
              {
                "bitrate": 432000,
                "content_type": "video/mp4",
                "url": "https://video.twimg.com/amplify_video/2072381487169642496/vid/avc1/320x320/KHibt0lECLT82fms.mp4?tag=14"
              },
              {
                "bitrate": 832000,
                "content_type": "video/mp4",
                "url": "https://video.twimg.com/amplify_video/2072381487169642496/vid/avc1/540x540/MOsPh3Sb0BfKOj0K.mp4?tag=14"
              },
              {
                "bitrate": 1280000,
                "content_type": "video/mp4",
                "url": "https://video.twimg.com/amplify_video/2072381487169642496/vid/avc1/720x720/Eo4KD556anaIq14g.mp4?tag=14"
              }
            ]
          }
        }
      ]
    },
    "card": null,
    "place": {},
    "entities": {
      "hashtags": [],
      "symbols": [],
      "timestamps": [],
      "urls": [],
      "user_mentions": []
    },
    "quoted_tweet": null,
    "retweeted_tweet": null,
    "isLimitedReply": false,
    "communityInfo": null,
    "article": null
  },
  "retweeted_tweet": null,
  "isLimitedReply": false,
  "communityInfo": null,
  "article": null
}