🐦 Twitter Post Details

Viewing enriched Twitter post

@arankomatsuzaki

Scaling Laws for Fine-Grained Mixture of Experts - MoE models consistently outperform dense Transformers - The efficiency gap between dense and MoE models widens as we scale up the model size and training budget https://t.co/BnFe0EjgkN https://t.co/qcIViMcg6c

🔧 Raw API Response

{
  "user": {
    "created_at": "2016-11-04T06:57:37.000Z",
    "default_profile_image": false,
    "description": "ML research & startup with @EnricoShippole",
    "fast_followers_count": 0,
    "favourites_count": 9746,
    "followers_count": 86608,
    "friends_count": 79,
    "has_custom_timelines": true,
    "is_translator": false,
    "listed_count": 1174,
    "location": "",
    "media_count": 1789,
    "name": "Aran Komatsuzaki",
    "normal_followers_count": 86608,
    "possibly_sensitive": false,
    "profile_image_url_https": "https://pbs.twimg.com/profile_images/1561220982328754176/JOYS5kab_normal.jpg",
    "screen_name": "arankomatsuzaki",
    "statuses_count": 4388,
    "translator_type": "none",
    "url": "https://t.co/aZGCShnLYq",
    "verified": true,
    "withheld_in_countries": [],
    "id_str": "794433401591693312"
  },
  "id": "1757229323126243620",
  "conversation_id": "1757229323126243620",
  "full_text": "Scaling Laws for Fine-Grained Mixture of Experts\n\n- MoE models consistently outperform dense Transformers\n- The efficiency gap between dense and MoE models widens as we scale up the model size and training budget\n\nhttps://t.co/BnFe0EjgkN https://t.co/qcIViMcg6c",
  "reply_count": 4,
  "retweet_count": 59,
  "favorite_count": 275,
  "hashtags": [],
  "symbols": [],
  "user_mentions": [],
  "urls": [
    {
      "url": "https://t.co/BnFe0EjgkN",
      "expanded_url": "https://arxiv.org/abs/2402.07871",
      "display_url": "arxiv.org/abs/2402.07871"
    }
  ],
  "media": [
    {
      "media_url": "https://pbs.twimg.com/media/GGLum3HXEAAABF7.jpg",
      "type": "photo"
    }
  ],
  "url": "https://twitter.com/arankomatsuzaki/status/1757229323126243620",
  "created_at": "2024-02-13T02:24:53.000Z",
  "#sort_index": "1757229323126243620",
  "view_count": 27191,
  "quote_count": 6,
  "is_quote_tweet": false,
  "is_retweet": false,
  "is_pinned": false,
  "is_truncated": false,
  "startUrl": "https://twitter.com/arankomatsuzaki/status/1757229323126243620"
}