{
  "type": "tweet",
  "id": "2115189693159809472",
  "url": "https://x.com/echen/status/2115189693159809472",
  "twitterUrl": "https://twitter.com/echen/status/2115189693159809472",
  "text": "too many benchmarks are too sanitized. they test if models can solve well-defined problems when you tell them exactly what problem is.\n\nbut figuring out the problem is half the job and all the fun\n\ninfusing the chaos of reality into our benchmarks (and figuring out how to grade them nonetheless) is what our Evals team does every day.\n\n~~introducing DAYJOB: TAX, the next in our economically valuable 9 to 5 series~~\n\none messy example:\n\nAnna asks her tax advisor whether to sell her house in Oct or Jan, to optimize her taxes. a good advisor tells her that both dates qualify for a $250K exclusion in capital gains...\n\n...but an even better advisor proactively warns her that she could lose the exclusion if the sale gets inevitably delayed past next August.\n\n(Opus mentioned the August deadline 5 out of 5 times. Astra never did.)\n\n(maybe your Opus bill is worth it after all!)\n\nknowing tax rules isn't enough. great tax agents should give you *advice* too, and have the professional judgment and experience to handle everything you didn't know to ask.\n\nwe built DAYJOB: TAX (and our entire DAYJOB Knowledge Work series) full of the messy holes of reality that even the smartest agents still don't know how to fill in.",
  "source": "",
  "retweetCount": 1,
  "replyCount": 8,
  "likeCount": 23,
  "quoteCount": 0,
  "viewCount": 3267,
  "createdAt": "Tue Oct 27 21:11:35 +0000 2026",
  "lang": "en",
  "bookmarkCount": 12,
  "isReply": false,
  "inReplyToId": null,
  "conversationId": "2115189693159809472",
  "displayTextRange": [
    0,
    278
  ],
  "inReplyToUserId": null,
  "inReplyToUsername": null,
  "author": {
    "type": "user",
    "userName": "echen",
    "url": "https://x.com/echen",
    "twitterUrl": "https://twitter.com/echen",
    "id": "67653490",
    "name": "echen",
    "isVerified": false,
    "isBlueVerified": true,
    "verifiedType": null,
    "profilePicture": "https://pbs.twimg.com/profile_images/1992435577052942336/R9BkFJwD_normal.jpg",
    "coverPicture": "https://pbs.twimg.com/profile_banners/67653490/1756586044",
    "description": "",
    "location": "Surge AI",
    "followers": 14398,
    "following": 571,
    "status": "",
    "canDm": true,
    "canMediaTag": true,
    "createdAt": "Fri Aug 21 16:46:09 +0000 2009",
    "entities": {
      "description": {
        "urls": []
      },
      "url": {}
    },
    "fastFollowersCount": 0,
    "favouritesCount": 1791,
    "hasCustomTimelines": true,
    "isTranslator": true,
    "mediaCount": 63,
    "statusesCount": 202,
    "withheldInCountries": [],
    "affiliatesHighlightedLabel": {},
    "possiblySensitive": false,
    "pinnedTweetIds": [
      "1941623739097153869"
    ],
    "profile_bio": {
      "description": "founder @HelloSurgeAI // raising AGI",
      "entities": {
        "description": {
          "user_mentions": [
            {
              "id_str": "",
              "indices": [
                8,
                21
              ],
              "name": "",
              "screen_name": "HelloSurgeAI"
            }
          ]
        },
        "url": {
          "urls": [
            {
              "display_url": "edwinchen.ai",
              "expanded_url": "https://www.edwinchen.ai",
              "indices": [
                0,
                23
              ],
              "url": "https://t.co/XB5NLYhGlD"
            }
          ]
        }
      }
    },
    "isAutomated": false,
    "automatedBy": null,
    "protected": false
  },
  "extendedEntities": {},
  "card": null,
  "place": {},
  "entities": {
    "hashtags": [],
    "symbols": [],
    "urls": [],
    "user_mentions": []
  },
  "quoted_tweet": null,
  "retweeted_tweet": null,
  "isLimitedReply": false,
  "communityInfo": null,
  "article": null
}