@omarsar0
RT @omarsar0: Learn to build evals, folks. Highly recommended reading on using decision models for evals. From our internal evals, Syste…
🐦 Twitter Post Details
Viewing enriched Twitter post
📊 Media Metadata
{
"score": 0.34,
"score_components": {
"author": 0.09,
"engagement": 0.0,
"quality": 0.04000000000000001,
"source": 0.135,
"nlp": 0.05,
"recency": 0.025
},
"scored_at": "2026-10-21T04:02:20.488179",
"import_source": "api_import",
"source_tagged_at": "2026-10-21T04:02:20.488194",
"enriched": true,
"enriched_at": "2026-10-21T04:02:20.488196"
}🔧 Raw API Response
{
"type": "tweet",
"id": "2112752737163296894",
"url": "https://x.com/omarsar0/status/2112752737163296894",
"twitterUrl": "https://twitter.com/omarsar0/status/2112752737163296894",
"text": "RT @omarsar0: Learn to build evals, folks.\n\nHighly recommended reading on using decision models for evals. \n\nFrom our internal evals, Syste…",
"source": "",
"retweetCount": 69,
"replyCount": 34,
"likeCount": 724,
"quoteCount": 3,
"viewCount": 54868,
"createdAt": "Wed Oct 21 03:48:00 +0000 2026",
"lang": "en",
"bookmarkCount": 1467,
"isReply": false,
"inReplyToId": null,
"conversationId": "2112752737163296894",
"displayTextRange": [
0,
140
],
"inReplyToUserId": null,
"inReplyToUsername": null,
"author": {
"type": "user",
"userName": "omarsar0",
"url": "https://x.com/omarsar0",
"twitterUrl": "https://twitter.com/omarsar0",
"id": "3448284313",
"name": "elvis",
"isVerified": false,
"isBlueVerified": true,
"verifiedType": null,
"profilePicture": "https://pbs.twimg.com/profile_images/939313677647282181/vZjFWtAn_normal.jpg",
"coverPicture": "https://pbs.twimg.com/profile_banners/3448284313/1565974901",
"description": "",
"location": "DAIR.AI Academy",
"followers": 325414,
"following": 1297,
"status": "",
"canDm": true,
"canMediaTag": true,
"createdAt": "Fri Sep 04 12:59:26 +0000 2015",
"entities": {
"description": {
"urls": []
},
"url": {}
},
"fastFollowersCount": 0,
"favouritesCount": 41791,
"hasCustomTimelines": true,
"isTranslator": true,
"mediaCount": 5185,
"statusesCount": 20887,
"withheldInCountries": [],
"affiliatesHighlightedLabel": {},
"possiblySensitive": false,
"pinnedTweetIds": [
"2112632133357346889"
],
"profile_bio": {
"description": "Building the frontier @dair_ai • Prev: Meta AI | PaperswithCode | Elastic | PhD",
"entities": {
"description": {
"user_mentions": [
{
"id_str": "",
"indices": [
22,
30
],
"name": "",
"screen_name": "dair_ai"
}
]
},
"url": {
"urls": [
{
"display_url": "academy.dair.ai",
"expanded_url": "https://www.academy.dair.ai/",
"indices": [
0,
23
],
"url": "https://t.co/R5bOTNbyJW"
}
]
}
}
},
"isAutomated": false,
"automatedBy": null
},
"extendedEntities": {},
"card": null,
"place": {},
"entities": {
"user_mentions": [
{
"id_str": "3448284313",
"indices": [
3,
12
],
"name": "elvis",
"screen_name": "omarsar0"
}
]
},
"quoted_tweet": null,
"retweeted_tweet": {
"type": "tweet",
"id": "2112632133357346889",
"url": "https://x.com/omarsar0/status/2112632133357346889",
"twitterUrl": "https://twitter.com/omarsar0/status/2112632133357346889",
"text": "Learn to build evals, folks.\n\nHighly recommended reading on using decision models for evals. \n\nFrom our internal evals, System One models like Jev are a great fit for LLM Judges.\n\nIf you want to go beyond Hamel's great write-up, I've also put together a few resources on applying decision models to LLM judges. \n\n(bookmark it)\n\n1) Jev-as-a-Judge for Agent Evaluations - https://t.co/SkXGd4uA2J\n\n2) Jev-as-a-Judge: Evaluating Agents with a Decision Model - https://t.co/SqGSzlMFut\n\nBonus paper I would recommend, with a few other ideas that combine System One and System Two models: Jev-as-a-Judge paper - https://t.co/8Oi6oBEt2A",
"source": "",
"retweetCount": 69,
"replyCount": 34,
"likeCount": 724,
"quoteCount": 3,
"viewCount": 54868,
"createdAt": "Tue Oct 20 19:48:46 +0000 2026",
"lang": "en",
"bookmarkCount": 1467,
"isReply": false,
"inReplyToId": null,
"conversationId": "2112632133357346889",
"displayTextRange": [
0,
279
],
"inReplyToUserId": null,
"inReplyToUsername": null,
"author": {
"type": "user",
"userName": "omarsar0",
"url": "https://x.com/omarsar0",
"twitterUrl": "https://twitter.com/omarsar0",
"id": "3448284313",
"name": "elvis",
"isVerified": false,
"isBlueVerified": true,
"verifiedType": null,
"profilePicture": "https://pbs.twimg.com/profile_images/939313677647282181/vZjFWtAn_normal.jpg",
"coverPicture": "https://pbs.twimg.com/profile_banners/3448284313/1565974901",
"description": "",
"location": "DAIR.AI Academy",
"followers": 325414,
"following": 1297,
"status": "",
"canDm": true,
"canMediaTag": true,
"createdAt": "Fri Sep 04 12:59:26 +0000 2015",
"entities": {
"description": {
"urls": []
},
"url": {}
},
"fastFollowersCount": 0,
"favouritesCount": 41791,
"hasCustomTimelines": true,
"isTranslator": true,
"mediaCount": 5185,
"statusesCount": 20887,
"withheldInCountries": [],
"affiliatesHighlightedLabel": {},
"possiblySensitive": false,
"pinnedTweetIds": [
"2112632133357346889"
],
"profile_bio": {
"description": "Building the frontier @dair_ai • Prev: Meta AI | PaperswithCode | Elastic | PhD",
"entities": {
"description": {
"user_mentions": [
{
"id_str": "",
"indices": [
22,
30
],
"name": "",
"screen_name": "dair_ai"
}
]
},
"url": {
"urls": [
{
"display_url": "academy.dair.ai",
"expanded_url": "https://www.academy.dair.ai/",
"indices": [
0,
23
],
"url": "https://t.co/R5bOTNbyJW"
}
]
}
}
},
"isAutomated": false,
"automatedBy": null
},
"extendedEntities": {},
"card": null,
"place": {},
"entities": {
"hashtags": [],
"symbols": [],
"urls": [
{
"display_url": "academy.dair.ai/dashboard/reso…",
"expanded_url": "https://academy.dair.ai/dashboard/resources/jev-as-a-judge",
"indices": [
370,
393
],
"url": "https://t.co/SkXGd4uA2J"
},
{
"display_url": "academy.dair.ai/labs/jev-as-a-…",
"expanded_url": "https://academy.dair.ai/labs/jev-as-a-judge-for-agent-evals",
"indices": [
456,
479
],
"url": "https://t.co/SqGSzlMFut"
},
{
"display_url": "arxiv.org/abs/2609.26550",
"expanded_url": "https://arxiv.org/abs/2609.26550",
"indices": [
605,
628
],
"url": "https://t.co/8Oi6oBEt2A"
}
],
"user_mentions": []
},
"quoted_tweet": {
"type": "tweet",
"id": "2112588257104216294",
"url": "https://x.com/HamelHusain/status/2112588257104216294",
"twitterUrl": "https://twitter.com/HamelHusain/status/2112588257104216294",
"text": "New blog post 🎉: How To Use Decision Models For Evals\n\nIn this post, we show you how to choose a decision model for your task, tune its threshold (don't assume the 0.5 default is good!), and interpret its scores.\n\nLots of cool interactive charts here. https://t.co/uYAfte9Kb5",
"source": "",
"retweetCount": 145,
"replyCount": 93,
"likeCount": 1442,
"quoteCount": 26,
"viewCount": 151276,
"createdAt": "Tue Oct 20 16:54:25 +0000 2026",
"lang": "en",
"bookmarkCount": 2751,
"isReply": false,
"inReplyToId": null,
"conversationId": "2112588257104216294",
"displayTextRange": [
0,
275
],
"inReplyToUserId": null,
"inReplyToUsername": null,
"author": {
"type": "user",
"userName": "HamelHusain",
"url": "https://x.com/HamelHusain",
"twitterUrl": "https://twitter.com/HamelHusain",
"id": "825766640",
"name": "Hamel Husain",
"isVerified": false,
"isBlueVerified": true,
"verifiedType": null,
"profilePicture": "https://pbs.twimg.com/profile_images/1287206199088173057/ixE4fKy1_normal.jpg",
"coverPicture": "https://pbs.twimg.com/profile_banners/825766640/1758993452",
"description": "",
"location": "Looking at the data",
"followers": 61772,
"following": 2705,
"status": "",
"canDm": true,
"canMediaTag": false,
"createdAt": "Sat Sep 15 18:45:02 +0000 2012",
"entities": {
"description": {
"urls": []
},
"url": {}
},
"fastFollowersCount": 0,
"favouritesCount": 19614,
"hasCustomTimelines": true,
"isTranslator": false,
"mediaCount": 1679,
"statusesCount": 17731,
"withheldInCountries": [],
"affiliatesHighlightedLabel": {},
"possiblySensitive": false,
"pinnedTweetIds": [
"2102807203967365549"
],
"profile_bio": {
"description": "Evals Evals Evals @OpenAI \n\nAbout Me: https://t.co/P6WyeKkyTa",
"entities": {
"description": {
"urls": [
{
"display_url": "hamel.dev",
"expanded_url": "https://hamel.dev",
"indices": [
38,
61
],
"url": "https://t.co/P6WyeKkyTa"
}
],
"user_mentions": [
{
"id_str": "",
"indices": [
18,
25
],
"name": "",
"screen_name": "OpenAI"
}
]
},
"url": {
"urls": [
{
"display_url": "hamel.dev",
"expanded_url": "https://hamel.dev",
"indices": [
0,
23
],
"url": "https://t.co/P6WyeKkyTa"
}
]
}
}
},
"isAutomated": false,
"automatedBy": null
},
"extendedEntities": {},
"card": null,
"place": {},
"entities": {
"urls": [
{
"display_url": "x.com/i/article/2112…",
"expanded_url": "https://x.com/i/article/2112552453422104576",
"indices": [
252,
275
],
"url": "https://t.co/uYAfte9Kb5"
}
]
},
"quoted_tweet": null,
"retweeted_tweet": null,
"isLimitedReply": false,
"communityInfo": null,
"article": {
"title": "How To Use Decision Models for Evals",
"preview_text": "Co-authored with Antaripa Saha.\nDecision models have exploded onto the scene recently, starting with TypeSafe’s Jev, followed by Perplexity’s Decider, Liquid’s d1, Cloudflare’s Clef, and OpenAI’s",
"cover_media_img_url": "https://pbs.twimg.com/media/HVFLwuWakAEm51z.jpg"
}
},
"retweeted_tweet": null,
"isLimitedReply": false,
"communityInfo": null,
"article": null
},
"isLimitedReply": false,
"communityInfo": null,
"article": null
}