{
  "type": "tweet",
  "id": "2026995823536751072",
  "url": "https://x.com/ariG23498/status/2026995823536751072",
  "twitterUrl": "https://twitter.com/ariG23498/status/2026995823536751072",
  "text": "The Mixture of Experts (MoE) inside 🤗 Transformers is out now!\n\nThis is going to be a long tweet, so if you just want to jump to the blog, the link is in the thread.\n\nWe already had a great blog post on MoEs (which has more than 1k upvotes 😯 at the time of writing). The reason we wanted to build another blog post altogether was just noticing how far we have come in the realm.\n\nThis blog post is not meant to be another \"What is MoEs and how to implement them\". Rather talk about how the transformers team at @huggingface made MoEs the \"first class citizen\" of the library and the Hub.\n\nThe transformers library and the entire ecosystem was built around dense architectures, but now with the rapid growth of MoEs, it was inevitible to build around MoEs and not consider them as \"just another model addition\".\n\nIn the post we talk about better model loading, expert backend, expert parallelism, and also @UnslothAI and out collaboration on training MoEs faster!\n\nIn the process of building the blog post, I also understood how beautiful the ideas are, and ended up making my first YouTube video on the routing algorithm alone.\n\nI am very proud of this project and I think it shows in some paragraphs of the blog post. I am also very thankful to all the people who helped me in the project, I am really happy to be in the team that helps me flourish! Glad to be alive.\n\nPS: I owe you all an apology for delaying the release. I hope I (and the team) could make it worth the wait.",
  "source": "Twitter for iPhone",
  "retweetCount": 41,
  "replyCount": 7,
  "likeCount": 306,
  "quoteCount": 6,
  "viewCount": 43254,
  "createdAt": "Thu Feb 26 12:20:38 +0000 2026",
  "lang": "en",
  "bookmarkCount": 297,
  "isReply": false,
  "inReplyToId": null,
  "conversationId": "2026995823536751072",
  "displayTextRange": [
    0,
    277
  ],
  "inReplyToUserId": null,
  "inReplyToUsername": null,
  "author": {
    "type": "user",
    "userName": "ariG23498",
    "url": "https://x.com/ariG23498",
    "twitterUrl": "https://twitter.com/ariG23498",
    "id": "767383106408091648",
    "name": "Aritra 🤗",
    "isVerified": false,
    "isBlueVerified": true,
    "verifiedType": null,
    "profilePicture": "https://pbs.twimg.com/profile_images/1993610813199069186/mPm9kDQ__normal.jpg",
    "coverPicture": "https://pbs.twimg.com/profile_banners/767383106408091648/1652174283",
    "description": "",
    "location": "OOMs",
    "followers": 5101,
    "following": 1086,
    "status": "",
    "canDm": true,
    "canMediaTag": false,
    "createdAt": "Sun Aug 21 15:29:24 +0000 2016",
    "entities": {
      "description": {
        "urls": []
      },
      "url": {}
    },
    "fastFollowersCount": 0,
    "favouritesCount": 15918,
    "hasCustomTimelines": true,
    "isTranslator": false,
    "mediaCount": 847,
    "statusesCount": 8351,
    "withheldInCountries": [],
    "affiliatesHighlightedLabel": {},
    "possiblySensitive": false,
    "pinnedTweetIds": [],
    "profile_bio": {
      "description": "MLE at @huggingface",
      "entities": {
        "description": {
          "hashtags": [],
          "symbols": [],
          "urls": [],
          "user_mentions": [
            {
              "id_str": "0",
              "indices": [
                7,
                19
              ],
              "name": "",
              "screen_name": "huggingface"
            }
          ]
        },
        "url": {
          "urls": [
            {
              "display_url": "arig23498.github.io",
              "expanded_url": "https://arig23498.github.io/",
              "indices": [
                0,
                23
              ],
              "url": "https://t.co/mcytQxVNjz"
            }
          ]
        }
      }
    },
    "isAutomated": false,
    "automatedBy": null
  },
  "extendedEntities": {},
  "card": null,
  "place": {},
  "entities": {
    "hashtags": [],
    "symbols": [],
    "urls": [],
    "user_mentions": [
      {
        "id_str": "778764142412984320",
        "indices": [
          511,
          523
        ],
        "name": "Hugging Face",
        "screen_name": "huggingface"
      },
      {
        "id_str": "1730159888402395136",
        "indices": [
          905,
          915
        ],
        "name": "Unsloth AI",
        "screen_name": "UnslothAI"
      }
    ]
  },
  "quoted_tweet": null,
  "retweeted_tweet": null,
  "isLimitedReply": false,
  "article": null
}