@HamelHusain
Yes! binary judges are far more practical for most people, because likert scales (or scores) have too many footguns All the flashcards are here (inspired by @chrisalbon ‘s flashcards) https://t.co/qfB4WJgX5n https://t.co/OvSdVi5rbB
Viewing enriched Twitter post
Yes! binary judges are far more practical for most people, because likert scales (or scores) have too many footguns All the flashcards are here (inspired by @chrisalbon ‘s flashcards) https://t.co/qfB4WJgX5n https://t.co/OvSdVi5rbB
{
"media": [
{
"type": "photo",
"url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/2071049082723020900/media_0.jpg",
"filename": "media_0.jpg"
}
],
"processed_at": "2026-06-29T15:13:58.984407",
"pipeline_version": "2.0"
} {
"type": "tweet",
"id": "2071049082723020900",
"url": "https://x.com/HamelHusain/status/2071049082723020900",
"twitterUrl": "https://twitter.com/HamelHusain/status/2071049082723020900",
"text": "Yes! binary judges are far more practical for most people, because likert scales (or scores) have too many footguns \n\nAll the flashcards are here (inspired by @chrisalbon ‘s flashcards) https://t.co/qfB4WJgX5n https://t.co/OvSdVi5rbB",
"source": "Twitter for iPhone",
"retweetCount": 23,
"replyCount": 17,
"likeCount": 206,
"quoteCount": 3,
"viewCount": 32956,
"createdAt": "Sun Jun 28 01:52:34 +0000 2026",
"lang": "en",
"bookmarkCount": 260,
"isReply": false,
"inReplyToId": null,
"conversationId": "2071049082723020900",
"displayTextRange": [
0,
210
],
"inReplyToUserId": null,
"inReplyToUsername": null,
"author": {
"type": "user",
"userName": "HamelHusain",
"url": "https://x.com/HamelHusain",
"twitterUrl": "https://twitter.com/HamelHusain",
"id": "825766640",
"name": "Hamel Husain",
"isVerified": false,
"isBlueVerified": true,
"verifiedType": null,
"profilePicture": "https://pbs.twimg.com/profile_images/1287206199088173057/ixE4fKy1_normal.jpg",
"coverPicture": "https://pbs.twimg.com/profile_banners/825766640/1758993452",
"description": "",
"location": "Looking at the data",
"followers": 49759,
"following": 2568,
"status": "",
"canDm": true,
"canMediaTag": false,
"createdAt": "Sat Sep 15 18:45:02 +0000 2012",
"entities": {
"description": {
"urls": []
},
"url": {}
},
"fastFollowersCount": 0,
"favouritesCount": 18114,
"hasCustomTimelines": true,
"isTranslator": false,
"mediaCount": 1570,
"statusesCount": 16678,
"withheldInCountries": [],
"affiliatesHighlightedLabel": {},
"possiblySensitive": false,
"pinnedTweetIds": [
"2037184894540054974"
],
"profile_bio": {
"description": "Evals Evals Evals - https://t.co/Zrmp6LRd9c\n\nAbout Me: https://t.co/P6WyeKkyTa",
"entities": {
"description": {
"urls": [
{
"display_url": "evals.info",
"expanded_url": "http://evals.info",
"indices": [
21,
44
],
"url": "https://t.co/Zrmp6LRd9c"
},
{
"display_url": "hamel.dev",
"expanded_url": "https://hamel.dev",
"indices": [
56,
79
],
"url": "https://t.co/P6WyeKkyTa"
}
]
},
"url": {
"urls": [
{
"display_url": "evals.info",
"expanded_url": "http://evals.info",
"indices": [
0,
23
],
"url": "https://t.co/Zrmp6LRd9c"
}
]
}
}
},
"isAutomated": false,
"automatedBy": null
},
"extendedEntities": {
"media": [
{
"display_url": "pic.twitter.com/OvSdVi5rbB",
"expanded_url": "https://twitter.com/HamelHusain/status/2071049082723020900/photo/1",
"ext_master_playlist_only": [],
"ext_media_availability": {
"status": "Available"
},
"ext_playlists": [],
"features": {
"large": {
"faces": []
},
"orig": {
"faces": []
}
},
"id_str": "2071049080567209984",
"indices": [
211,
234
],
"media_key": "3_2071049080567209984",
"media_results": {
"id": "QXBpTWVkaWFSZXN1bHRzOgwAAQoAARy92Cp3m6AACgACHL3YKvgasGQAAA==",
"result": {
"__typename": "ApiMedia",
"id": "QXBpTWVkaWE6DAABCgABHL3YKneboAAKAAIcvdgq+BqwZAAA",
"media_key": "3_2071049080567209984"
}
},
"media_url_https": "https://pbs.twimg.com/media/HL3YKneboAAYPjB.jpg",
"original_info": {
"focus_rects": [
{
"h": 672,
"w": 1200,
"x": 0,
"y": 0
},
{
"h": 1200,
"w": 1200,
"x": 0,
"y": 0
},
{
"h": 1368,
"w": 1200,
"x": 0,
"y": 0
},
{
"h": 1500,
"w": 750,
"x": 450,
"y": 0
},
{
"h": 1500,
"w": 1200,
"x": 0,
"y": 0
}
],
"height": 1500,
"width": 1200
},
"sizes": {
"large": {
"h": 1500,
"w": 1200
}
},
"type": "photo",
"url": "https://t.co/OvSdVi5rbB"
}
]
},
"card": null,
"place": {},
"entities": {
"urls": [
{
"display_url": "maven.com/parlance-labs/…",
"expanded_url": "https://maven.com/parlance-labs/o/540bd8",
"indices": [
187,
210
],
"url": "https://t.co/qfB4WJgX5n"
}
],
"user_mentions": [
{
"id_str": "11518572",
"indices": [
159,
170
],
"name": "Chris Albon",
"screen_name": "chrisalbon"
}
]
},
"quoted_tweet": {
"type": "tweet",
"id": "2070942495832470001",
"url": "https://x.com/omarsar0/status/2070942495832470001",
"twitterUrl": "https://twitter.com/omarsar0/status/2070942495832470001",
"text": "If you use LLM-as-judge, this one is worth reading.\n\n(bookmark it)\n\nIt's actually one of the most effective ways to use LLM-as-a-Judge for evals.\n\nHolistic judge scores hide both their reasoning and their ceiling effects.\n\nBINEVAL decomposes each evaluation criterion into atomic yes-or-no questions, answers each independently per output, then aggregates the verdicts into calibrated multi-dimensional scores.\n\nEvery question-level verdict is inspectable, so you can diagnose exactly why an output scored low, and the same verdicts feed straight back as targeted prompt-improvement signal.\n\nAcross SummEval, Topical-Chat, and QAGS, it matches or beats UniEval and G-Eval, training-free, with especially strong results on factual consistency.\n\nPaper: https://t.co/oar6BZcasm\n\nLearn to build effective AI agents in our academy: https://t.co/1e8RZKs4uX",
"source": "Twitter for iPhone",
"retweetCount": 219,
"replyCount": 47,
"likeCount": 1908,
"quoteCount": 15,
"viewCount": 185626,
"createdAt": "Sat Jun 27 18:49:01 +0000 2026",
"lang": "en",
"bookmarkCount": 3479,
"isReply": false,
"inReplyToId": null,
"conversationId": "2070942495832470001",
"displayTextRange": [
0,
279
],
"inReplyToUserId": null,
"inReplyToUsername": null,
"author": {
"type": "user",
"userName": "omarsar0",
"url": "https://x.com/omarsar0",
"twitterUrl": "https://twitter.com/omarsar0",
"id": "3448284313",
"name": "elvis",
"isVerified": false,
"isBlueVerified": true,
"verifiedType": null,
"profilePicture": "https://pbs.twimg.com/profile_images/939313677647282181/vZjFWtAn_normal.jpg",
"coverPicture": "https://pbs.twimg.com/profile_banners/3448284313/1565974901",
"description": "",
"location": "DAIR.AI Academy",
"followers": 309164,
"following": 882,
"status": "",
"canDm": true,
"canMediaTag": true,
"createdAt": "Fri Sep 04 12:59:26 +0000 2015",
"entities": {
"description": {
"urls": []
},
"url": {}
},
"fastFollowersCount": 0,
"favouritesCount": 37079,
"hasCustomTimelines": true,
"isTranslator": true,
"mediaCount": 4752,
"statusesCount": 18503,
"withheldInCountries": [],
"affiliatesHighlightedLabel": {},
"possiblySensitive": false,
"pinnedTweetIds": [
"2071595490454434214"
],
"profile_bio": {
"description": "Building self-improving AI @dair_ai • Prev: Meta AI | PhD • Learn about AI Agents for FREE here: https://t.co/P5SA9u54xO",
"entities": {
"description": {
"urls": [
{
"display_url": "academy.dair.ai/courses/elemen…",
"expanded_url": "https://academy.dair.ai/courses/elements-of-ai-agents",
"indices": [
97,
120
],
"url": "https://t.co/P5SA9u54xO"
}
],
"user_mentions": [
{
"id_str": "",
"indices": [
27,
35
],
"name": "",
"screen_name": "dair_ai"
}
]
},
"url": {
"urls": [
{
"display_url": "dair.ai",
"expanded_url": "https://www.dair.ai/",
"indices": [
0,
23
],
"url": "https://t.co/XQto5ypkSM"
}
]
}
}
},
"isAutomated": false,
"automatedBy": null
},
"extendedEntities": {
"media": [
{
"display_url": "pic.twitter.com/LnahHd5uxH",
"expanded_url": "https://twitter.com/omarsar0/status/2070942495832470001/photo/1",
"ext_master_playlist_only": [],
"ext_media_availability": {
"status": "Available"
},
"ext_playlists": [],
"features": {
"large": {
"faces": [
{
"h": 99,
"w": 99,
"x": 781,
"y": 1417
},
{
"h": 121,
"w": 121,
"x": 164,
"y": 737
}
]
},
"orig": {
"faces": [
{
"h": 99,
"w": 99,
"x": 781,
"y": 1417
},
{
"h": 121,
"w": 121,
"x": 164,
"y": 737
}
]
}
},
"id_str": "2070942492221132800",
"indices": [
280,
303
],
"media_key": "3_2070942492221132800",
"media_results": {
"id": "QXBpTWVkaWFSZXN1bHRzOgwAAQoAARy9dzlvGlAACgACHL13OkZa8fEAAA==",
"result": {
"__typename": "ApiMedia",
"id": "QXBpTWVkaWE6DAABCgABHL13OW8aUAAKAAIcvXc6Rlrx8QAA",
"media_key": "3_2070942492221132800"
}
},
"media_url_https": "https://pbs.twimg.com/media/HL13OW8aUAANOPA.png",
"original_info": {
"focus_rects": [
{
"h": 898,
"w": 1604,
"x": 0,
"y": 0
},
{
"h": 1604,
"w": 1604,
"x": 0,
"y": 0
},
{
"h": 1828,
"w": 1604,
"x": 0,
"y": 0
},
{
"h": 1828,
"w": 914,
"x": 319,
"y": 0
},
{
"h": 1828,
"w": 1604,
"x": 0,
"y": 0
}
],
"height": 1828,
"width": 1604
},
"sizes": {
"large": {
"h": 1828,
"w": 1604
}
},
"type": "photo",
"url": "https://t.co/LnahHd5uxH"
}
]
},
"card": null,
"place": {},
"entities": {
"hashtags": [],
"symbols": [],
"urls": [
{
"display_url": "arxiv.org/abs/2606.27226",
"expanded_url": "https://arxiv.org/abs/2606.27226",
"indices": [
751,
774
],
"url": "https://t.co/oar6BZcasm"
},
{
"display_url": "academy.dair.ai",
"expanded_url": "https://academy.dair.ai/",
"indices": [
827,
850
],
"url": "https://t.co/1e8RZKs4uX"
}
],
"user_mentions": []
},
"quoted_tweet": null,
"retweeted_tweet": null,
"isLimitedReply": false,
"communityInfo": null,
"article": null
},
"retweeted_tweet": null,
"isLimitedReply": false,
"communityInfo": null,
"article": null
}