๐Ÿฆ Twitter Post Details

Viewing enriched Twitter post

@onusoz

We need to normalize measuring and judging models against a standardized test harness "Oh but model X performs best in their own proprietary harness" I could not care less. When I take exams, I go to the standardized classroom, get the standardized pencil and exam sheet, and have to solve it under 2 hours This system arose because we have a LOT of people to test Guess what? We now have a LOT of models, and they are multiplying by the day "Oh but model X performs substantially better in ARC-AGI-3 with a custom harness" I don't care... Then imbue model X with enough knowledge so that it can reconstruct that harness on the spot The main harness could be mini-swe-agent, terminus 2, vanilla pi or something along those lines It needs to be simple, and stay roughly the same over time There is already too much complexity in the benchmarking space right now, and I feel like not enough people are putting their feet down to cut away some part of it

๐Ÿ“Š Media Metadata

{
  "score": 0.42,
  "score_components": {
    "author": 0.09,
    "engagement": 0.0,
    "quality": 0.12,
    "source": 0.135,
    "nlp": 0.05,
    "recency": 0.025
  },
  "scored_at": "2026-08-23T18:01:13.296474",
  "import_source": "api_import",
  "source_tagged_at": "2026-08-23T18:01:13.296485",
  "enriched": true,
  "enriched_at": "2026-08-23T18:01:13.296486"
}

๐Ÿ”ง Raw API Response

{
  "type": "tweet",
  "id": "2091434969151267162",
  "url": "https://x.com/onusoz/status/2091434969151267162",
  "twitterUrl": "https://twitter.com/onusoz/status/2091434969151267162",
  "text": "We need to normalize measuring and judging models against a standardized test harness\n\n\"Oh but model X performs best in their own proprietary harness\"\n\nI could not care less. When I take exams, I go to the standardized classroom, get the standardized pencil and exam sheet, and have to solve it under 2 hours\n\nThis system arose because we have a LOT of people to test\n\nGuess what? We now have a LOT of models, and they are multiplying by the day\n\n\"Oh but model X performs substantially better in ARC-AGI-3 with a custom harness\"\n\nI don't care... Then imbue model X with enough knowledge so that it can reconstruct that harness on the spot\n\nThe main harness could be mini-swe-agent, terminus 2, vanilla pi or something along those lines\n\nIt needs to be simple, and stay roughly the same over time\n\nThere is already too much complexity in the benchmarking space right now, and I feel like not enough people are putting their feet down to cut away some part of it",
  "source": "Twitter for iPhone",
  "retweetCount": 3,
  "replyCount": 44,
  "likeCount": 149,
  "quoteCount": 6,
  "viewCount": 37880,
  "createdAt": "Sun Aug 23 07:58:48 +0000 2026",
  "lang": "en",
  "bookmarkCount": 25,
  "isReply": false,
  "inReplyToId": null,
  "conversationId": "2091434969151267162",
  "displayTextRange": [
    0,
    277
  ],
  "inReplyToUserId": null,
  "inReplyToUsername": null,
  "author": {
    "type": "user",
    "userName": "onusoz",
    "url": "https://x.com/onusoz",
    "twitterUrl": "https://twitter.com/onusoz",
    "id": "1598253668175847425",
    "name": "Onur Solmaz",
    "isVerified": false,
    "isBlueVerified": true,
    "verifiedType": null,
    "profilePicture": "https://pbs.twimg.com/profile_images/1998282426783875072/AD1wK-0c_normal.jpg",
    "coverPicture": "https://pbs.twimg.com/profile_banners/1598253668175847425/1783509440",
    "description": "",
    "location": "",
    "followers": 9365,
    "following": 2072,
    "status": "",
    "canDm": true,
    "canMediaTag": true,
    "createdAt": "Thu Dec 01 09:53:11 +0000 2022",
    "entities": {
      "description": {
        "urls": []
      },
      "url": {}
    },
    "fastFollowersCount": 0,
    "favouritesCount": 9891,
    "hasCustomTimelines": true,
    "isTranslator": false,
    "mediaCount": 418,
    "statusesCount": 1995,
    "withheldInCountries": [],
    "affiliatesHighlightedLabel": {
      "label": {
        "badge": {
          "url": "https://pbs.twimg.com/profile_images/2017100664984186880/orbYx-3U_bigger.jpg"
        },
        "description": "OpenClaw๐Ÿฆž",
        "url": {
          "url": "https://twitter.com/openclaw",
          "url_type": "DeepLink"
        },
        "user_label_display_type": "Badge",
        "user_label_type": "BusinessLabel"
      }
    },
    "possiblySensitive": false,
    "pinnedTweetIds": [
      "1929140559668515195"
    ],
    "profile_bio": {
      "description": "Maintainer @openclaw ๐Ÿฆž, Engineer @huggingface ๐Ÿค—. Experimenting in https://t.co/SGQepULb6z. Making local models work great in OpenClaw",
      "entities": {
        "description": {
          "urls": [
            {
              "display_url": "ourmodels.cc",
              "expanded_url": "http://ourmodels.cc",
              "indices": [
                66,
                89
              ],
              "url": "https://t.co/SGQepULb6z"
            }
          ],
          "user_mentions": [
            {
              "id_str": "",
              "indices": [
                11,
                20
              ],
              "name": "",
              "screen_name": "openclaw"
            },
            {
              "id_str": "",
              "indices": [
                33,
                45
              ],
              "name": "",
              "screen_name": "huggingface"
            }
          ]
        },
        "url": {
          "urls": [
            {
              "display_url": "solmaz.io",
              "expanded_url": "https://solmaz.io",
              "indices": [
                0,
                23
              ],
              "url": "https://t.co/uyEv4yXsrK"
            }
          ]
        }
      }
    },
    "isAutomated": false,
    "automatedBy": null
  },
  "extendedEntities": {},
  "card": null,
  "place": {},
  "entities": {
    "hashtags": [],
    "symbols": [],
    "urls": [],
    "user_mentions": []
  },
  "quoted_tweet": null,
  "retweeted_tweet": null,
  "isLimitedReply": false,
  "communityInfo": null,
  "article": null
}