@rasbt
Gemma 3 270M! Great to see another awesome, small open-weight LLM for local tinkering. Here's a side-by-side comparison with Qwen3. Biggest surprise that it only has 4 attention heads! https://t.co/Iy7O0DsQGu
Viewing enriched Twitter post
Gemma 3 270M! Great to see another awesome, small open-weight LLM for local tinkering. Here's a side-by-side comparison with Qwen3. Biggest surprise that it only has 4 attention heads! https://t.co/Iy7O0DsQGu
{
"media": [
{
"type": "photo",
"url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/1956130338431713307/media_0.jpg?",
"filename": "media_0.jpg"
}
],
"processed_at": "2025-08-15T08:10:55.319785",
"pipeline_version": "2.0"
} {
"type": "tweet",
"id": "1956130338431713307",
"url": "https://x.com/rasbt/status/1956130338431713307",
"twitterUrl": "https://twitter.com/rasbt/status/1956130338431713307",
"text": "Gemma 3 270M! Great to see another awesome, small open-weight LLM for local tinkering.\nHere's a side-by-side comparison with Qwen3. Biggest surprise that it only has 4 attention heads! https://t.co/Iy7O0DsQGu",
"source": "Twitter for iPhone",
"retweetCount": 72,
"replyCount": 11,
"likeCount": 592,
"quoteCount": 10,
"viewCount": 54476,
"createdAt": "Thu Aug 14 23:06:30 +0000 2025",
"lang": "en",
"bookmarkCount": 269,
"isReply": false,
"inReplyToId": null,
"conversationId": "1956130338431713307",
"inReplyToUserId": null,
"inReplyToUsername": null,
"author": {
"type": "user",
"userName": "rasbt",
"url": "https://x.com/rasbt",
"twitterUrl": "https://twitter.com/rasbt",
"id": "865622395",
"name": "Sebastian Raschka",
"isVerified": false,
"isBlueVerified": true,
"verifiedType": null,
"profilePicture": "https://pbs.twimg.com/profile_images/1661187442043486209/a3E4t1eV_normal.jpg",
"coverPicture": "https://pbs.twimg.com/profile_banners/865622395/1742309979",
"description": "",
"location": "",
"followers": 349788,
"following": 1046,
"status": "",
"canDm": false,
"canMediaTag": true,
"createdAt": "Sun Oct 07 02:06:16 +0000 2012",
"entities": {
"description": {
"urls": []
},
"url": {}
},
"fastFollowersCount": 0,
"favouritesCount": 22139,
"hasCustomTimelines": true,
"isTranslator": false,
"mediaCount": 1942,
"statusesCount": 18146,
"withheldInCountries": [],
"affiliatesHighlightedLabel": {},
"possiblySensitive": false,
"pinnedTweetIds": [
"1946549778319339931"
],
"profile_bio": {
"description": "ML/AI researcher & former stats professor turned LLM research engineer. Author of \"Build a Large Language Model From Scratch\" (https://t.co/O8LAAMRzzW).",
"entities": {
"description": {
"urls": [
{
"display_url": "amzn.to/4fqvn0D",
"expanded_url": "https://amzn.to/4fqvn0D",
"indices": [
127,
150
],
"url": "https://t.co/O8LAAMRzzW"
}
]
},
"url": {
"urls": [
{
"display_url": "sebastianraschka.com",
"expanded_url": "https://sebastianraschka.com",
"indices": [
0,
23
],
"url": "https://t.co/HrtQQ5tgJl"
}
]
}
}
},
"isAutomated": false,
"automatedBy": null
},
"extendedEntities": {
"media": [
{
"allow_download_status": {
"allow_download": true
},
"display_url": "pic.twitter.com/Iy7O0DsQGu",
"expanded_url": "https://twitter.com/rasbt/status/1956130338431713307/photo/1",
"ext_media_availability": {
"status": "Available"
},
"features": {
"large": {},
"orig": {}
},
"id_str": "1956130173750837248",
"indices": [
185,
208
],
"media_key": "3_1956130173750837248",
"media_results": {
"id": "QXBpTWVkaWFSZXN1bHRzOgwAAQoAARslkgds14AACgACGyWSLcSWQBsAAA==",
"result": {
"__typename": "ApiMedia",
"id": "QXBpTWVkaWE6DAABCgABGyWSB2zXgAAKAAIbJZItxJZAGwAA",
"media_key": "3_1956130173750837248"
}
},
"media_url_https": "https://pbs.twimg.com/media/GyWSB2zXgAA9INg.jpg",
"original_info": {
"focus_rects": [
{
"h": 2294,
"w": 4096,
"x": 0,
"y": 204
},
{
"h": 2498,
"w": 2498,
"x": 1598,
"y": 0
},
{
"h": 2498,
"w": 2191,
"x": 1905,
"y": 0
},
{
"h": 2498,
"w": 1249,
"x": 2847,
"y": 0
},
{
"h": 2498,
"w": 4096,
"x": 0,
"y": 0
}
],
"height": 2498,
"width": 4096
},
"sizes": {
"large": {
"h": 1249,
"w": 2048
}
},
"type": "photo",
"url": "https://t.co/Iy7O0DsQGu"
}
]
},
"card": null,
"place": {},
"entities": {},
"quoted_tweet": {
"type": "tweet",
"id": "1956024223773663291",
"url": "https://x.com/osanseviero/status/1956024223773663291",
"twitterUrl": "https://twitter.com/osanseviero/status/1956024223773663291",
"text": "Introducing Gemma 3 270M 🔥\n\n🤏A tiny model! Just 270 million parameters\n🧠 Very strong instruction following\n🤖 Fine-tune in just a few minutes, with a large vocabulary to serve as a high-quality foundation\n\nhttps://t.co/E0BB5nlI1k https://t.co/XntprMBqSC",
"source": "Twitter for iPhone",
"retweetCount": 262,
"replyCount": 105,
"likeCount": 2094,
"quoteCount": 83,
"viewCount": 408465,
"createdAt": "Thu Aug 14 16:04:50 +0000 2025",
"lang": "en",
"bookmarkCount": 903,
"isReply": false,
"inReplyToId": null,
"conversationId": "1956024223773663291",
"inReplyToUserId": null,
"inReplyToUsername": null,
"author": {
"type": "user",
"userName": "osanseviero",
"url": "https://x.com/osanseviero",
"twitterUrl": "https://twitter.com/osanseviero",
"id": "207744565",
"name": "Omar Sanseviero",
"isVerified": false,
"isBlueVerified": true,
"verifiedType": null,
"profilePicture": "https://pbs.twimg.com/profile_images/1676696716693700608/t4kv-MrC_normal.jpg",
"coverPicture": "https://pbs.twimg.com/profile_banners/207744565/1559310065",
"description": "",
"location": "Zurich",
"followers": 49335,
"following": 2601,
"status": "",
"canDm": true,
"canMediaTag": false,
"createdAt": "Mon Oct 25 23:29:03 +0000 2010",
"entities": {
"description": {
"urls": []
},
"url": {}
},
"fastFollowersCount": 0,
"favouritesCount": 24673,
"hasCustomTimelines": true,
"isTranslator": false,
"mediaCount": 1348,
"statusesCount": 10562,
"withheldInCountries": [],
"affiliatesHighlightedLabel": {},
"possiblySensitive": false,
"pinnedTweetIds": [],
"profile_bio": {
"description": "Making ML go brr at Google\n\nex-Chief Llama Officer @huggingface 🦙\nFounder @AI_Learners.\n100% Hacker Llama🇵🇪🇲🇽",
"entities": {
"description": {
"user_mentions": [
{
"id_str": "0",
"indices": [
51,
63
],
"name": "",
"screen_name": "huggingface"
},
{
"id_str": "0",
"indices": [
74,
86
],
"name": "",
"screen_name": "AI_Learners"
}
]
},
"url": {
"urls": [
{
"display_url": "osanseviero.github.io/hackerllama/",
"expanded_url": "https://osanseviero.github.io/hackerllama/",
"indices": [
0,
23
],
"url": "https://t.co/3LrSRqlhYK"
}
]
}
}
},
"isAutomated": false,
"automatedBy": null
},
"extendedEntities": {
"media": [
{
"display_url": "pic.twitter.com/XntprMBqSC",
"expanded_url": "https://twitter.com/osanseviero/status/1956024223773663291/photo/1",
"ext_media_availability": {
"status": "Available"
},
"features": {
"large": {},
"orig": {}
},
"id_str": "1956009233977131011",
"indices": [
229,
252
],
"media_key": "3_1956009233977131011",
"media_results": {
"id": "QXBpTWVkaWFSZXN1bHRzOgwAAQoAARslJAjwl0ADCgACGyUxqwYWoDsAAA==",
"result": {
"__typename": "ApiMedia",
"id": "QXBpTWVkaWE6DAABCgABGyUkCPCXQAMKAAIbJTGrBhagOwAA",
"media_key": "3_1956009233977131011"
}
},
"media_url_https": "https://pbs.twimg.com/media/GyUkCPCXQAMpxqW.jpg",
"original_info": {
"focus_rects": [
{
"h": 963,
"w": 1719,
"x": 0,
"y": 4
},
{
"h": 967,
"w": 967,
"x": 75,
"y": 0
},
{
"h": 967,
"w": 848,
"x": 134,
"y": 0
},
{
"h": 967,
"w": 484,
"x": 316,
"y": 0
},
{
"h": 967,
"w": 1719,
"x": 0,
"y": 0
}
],
"height": 967,
"width": 1719
},
"sizes": {
"large": {
"h": 967,
"w": 1719
}
},
"type": "photo",
"url": "https://t.co/XntprMBqSC"
}
]
},
"card": null,
"place": {},
"entities": {
"urls": [
{
"display_url": "developers.googleblog.com/en/introducing…",
"expanded_url": "https://developers.googleblog.com/en/introducing-gemma-3-270m",
"indices": [
205,
228
],
"url": "https://t.co/E0BB5nlI1k"
}
]
},
"quoted_tweet": null,
"retweeted_tweet": null,
"article": null
},
"retweeted_tweet": null,
"article": null
}