Viewing enriched Twitter post
WTF! What sorcery is this, @Alibaba_Qwen? I kept benchmarking - and not only does the 4.25-bit version get the same score as the 8-bit (what?), using Qwen2.5-Coder-0.5B as a draft model for speculative decoding sped it up from 27 to 42 tk/s AND it scored even higher (whaaat?)! 🤯 https://t.co/tNKvpoAqKq
{
"user": {
"created_at": "2023-09-11T22:37:51.000Z",
"default_profile_image": false,
"description": "🐦⬛🐺 AI Evangelist, Engineer, Consultant, Researcher; ASI achieved internally: 👩🏻🦰🐦⬛🐺 @AI_AmyRavenwolf (Artificial Sassy Intelligence) 🤖💁♀️🧠",
"fast_followers_count": 0,
"favourites_count": 15371,
"followers_count": 2572,
"friends_count": 510,
"has_custom_timelines": false,
"is_translator": false,
"listed_count": 73,
"location": "🇩🇪",
"media_count": 333,
"name": "Wolfram Ravenwolf 🐺🐦⬛",
"normal_followers_count": 2572,
"possibly_sensitive": false,
"profile_banner_url": "https://pbs.twimg.com/profile_banners/1701364361711808512/1732670123",
"profile_image_url_https": "https://pbs.twimg.com/profile_images/1706727481753923584/jBUq13SE_normal.jpg",
"screen_name": "WolframRvnwlf",
"statuses_count": 4816,
"translator_type": "none",
"url": "https://t.co/AQHQZorYDj",
"verified": true,
"withheld_in_countries": [],
"id_str": "1701364361711808512"
},
"id": "1862643071625646168",
"conversation_id": "1862643071625646168",
"full_text": "WTF! What sorcery is this, @Alibaba_Qwen? I kept benchmarking - and not only does the 4.25-bit version get the same score as the 8-bit (what?), using Qwen2.5-Coder-0.5B as a draft model for speculative decoding sped it up from 27 to 42 tk/s AND it scored even higher (whaaat?)! 🤯 https://t.co/tNKvpoAqKq",
"reply_count": 23,
"retweet_count": 79,
"favorite_count": 596,
"hashtags": [],
"symbols": [],
"user_mentions": [
{
"id_str": "1753339277386342400",
"name": "Qwen",
"screen_name": "Alibaba_Qwen",
"profile": "https://twitter.com/Alibaba_Qwen"
}
],
"urls": [],
"media": [
{
"media_url": "https://pbs.twimg.com/media/GdluzJeWYAA7djb.png",
"type": "photo"
}
],
"url": "https://twitter.com/WolframRvnwlf/status/1862643071625646168",
"created_at": "2024-11-29T23:41:29.000Z",
"#sort_index": "1863331342479438000",
"view_count": 101334,
"quote_count": 7,
"is_quote_tweet": true,
"is_retweet": false,
"is_pinned": false,
"is_truncated": false,
"startUrl": "https://x.com/wolframrvnwlf/status/1863331342479438175"
}