🐦 Twitter Post Details

Viewing enriched Twitter post

@random_walker

Resharing our paper on the science of AI agent evaluation because the PHP vulnerability happened right as we announced the paper last week and our server was taken down all day to upgrade PHP 🫠 PDF: https://t.co/8m13p9d70F Webpage: https://t.co/xGAvBCGW4a Blog: https://t.co/qxO21qWZfm There are growing calls for independent and embedded AI evaluation, especially of AI agents. But much remains unclear: what constitutes a “good” evaluation, what needs to be evaluated in the first place, and how best to coordinate and support the influx of people entering the burgeoning evaluation ecosystem. Our group at Princeton has been working to improve the state of AI agent evaluation for about three years. We teamed up with people who’ve done foundational work on evaluation at Stanford, the UK AI Security Institute, and Brookings. Our paper is titled Emerging Trends in AI Agent Evaluation. We synthesized the trends we see across three dimensions—the science and methods, the research agenda, and the evaluation ecosystem—with the goal to help those who are upskilling for this new paradigm. We also aim to equip evaluators, funders, and the public with a set of questions to ask, and provide actionable recommendations. By @flxcn, @steverab, @PKirgis, @nityndg, @RishiBommasani, @DubMagda, @CUdudec, @AnkaReuel, Elham Tabassi, @sayashk, and me.

Media 1
View on Twitter

📊 Media Metadata

{
  "media": [
    {
      "type": "photo",
      "url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/2116165441110323349/media_0.jpg",
      "filename": "media_0.jpg"
    }
  ],
  "processed_at": "2026-10-30T14:01:05.927035",
  "pipeline_version": "2.0"
}

🔧 Raw API Response

{
  "type": "tweet",
  "id": "2116165441110323349",
  "url": "https://x.com/random_walker/status/2116165441110323349",
  "twitterUrl": "https://twitter.com/random_walker/status/2116165441110323349",
  "text": "Resharing our paper on the science of AI agent evaluation because the PHP vulnerability happened right as we announced the paper last week and our server was taken down all day to upgrade PHP 🫠 \n\nPDF: https://t.co/8m13p9d70F\nWebpage: https://t.co/xGAvBCGW4a\nBlog: https://t.co/qxO21qWZfm\n\nThere are growing calls for independent and embedded AI evaluation, especially of AI agents. But much remains unclear: what constitutes a “good” evaluation, what needs to be evaluated in the first place, and how best to coordinate and support the influx of people entering the burgeoning evaluation ecosystem.\n\nOur group at Princeton has been working to improve the state of AI agent evaluation for about three years. We teamed up with people who’ve done foundational work on evaluation at Stanford, the UK AI Security Institute, and Brookings. Our paper is titled Emerging Trends in AI Agent Evaluation. We synthesized the trends we see across three dimensions—the science and methods, the research agenda, and the evaluation ecosystem—with the goal to help those who are upskilling for this new paradigm. We also aim to equip evaluators, funders, and the public with a set of questions to ask, and provide actionable recommendations.\n\nBy @flxcn, @steverab, @PKirgis, @nityndg, @RishiBommasani, @DubMagda, @CUdudec, @AnkaReuel, Elham Tabassi, @sayashk, and me.",
  "source": "",
  "retweetCount": 0,
  "replyCount": 2,
  "likeCount": 2,
  "quoteCount": 0,
  "viewCount": 498,
  "createdAt": "Fri Oct 30 13:48:52 +0000 2026",
  "lang": "en",
  "bookmarkCount": 3,
  "isReply": false,
  "inReplyToId": null,
  "conversationId": "2116165441110323349",
  "displayTextRange": [
    0,
    263
  ],
  "inReplyToUserId": null,
  "inReplyToUsername": null,
  "author": {
    "type": "user",
    "userName": "random_walker",
    "url": "https://x.com/random_walker",
    "twitterUrl": "https://twitter.com/random_walker",
    "id": "10834752",
    "name": "Arvind Narayanan",
    "isVerified": false,
    "isBlueVerified": true,
    "verifiedType": null,
    "profilePicture": "https://pbs.twimg.com/profile_images/1650881612756942850/bZYjMyFU_normal.jpg",
    "coverPicture": "https://pbs.twimg.com/profile_banners/10834752/1488663432",
    "description": "",
    "location": "Princeton, NJ",
    "followers": 132770,
    "following": 572,
    "status": "",
    "canDm": false,
    "canMediaTag": false,
    "createdAt": "Tue Dec 04 11:14:14 +0000 2007",
    "entities": {
      "description": {
        "urls": []
      },
      "url": {}
    },
    "fastFollowersCount": 0,
    "favouritesCount": 25642,
    "hasCustomTimelines": true,
    "isTranslator": false,
    "mediaCount": 962,
    "statusesCount": 13464,
    "withheldInCountries": [],
    "affiliatesHighlightedLabel": {},
    "possiblySensitive": false,
    "pinnedTweetIds": [
      "2092933101697585601"
    ],
    "profile_bio": {
      "description": "Princeton CS prof and Director @PrincetonCITP. \nCoauthor of \"AI Snake Oil\" and \"AI as Normal Technology\". https://t.co/ZwebetjZ4n\nViews mine.",
      "entities": {
        "description": {
          "urls": [
            {
              "display_url": "normaltech.ai",
              "expanded_url": "https://www.normaltech.ai/",
              "indices": [
                106,
                129
              ],
              "url": "https://t.co/ZwebetjZ4n"
            }
          ],
          "user_mentions": [
            {
              "id_str": "",
              "indices": [
                31,
                45
              ],
              "name": "",
              "screen_name": "PrincetonCITP"
            }
          ]
        },
        "url": {
          "urls": [
            {
              "display_url": "cs.princeton.edu/~arvindn/",
              "expanded_url": "https://www.cs.princeton.edu/~arvindn/",
              "indices": [
                0,
                23
              ],
              "url": "https://t.co/px6fpS9QFq"
            }
          ]
        }
      }
    },
    "isAutomated": false,
    "automatedBy": null,
    "protected": false
  },
  "extendedEntities": {
    "media": [
      {
        "allow_download_status": {
          "allow_download": true
        },
        "display_url": "pic.x.com/ilyeP4YD79",
        "expanded_url": "https://x.com/random_walker/status/2116165441110323349/photo/1",
        "ext_master_playlist_only": [],
        "ext_media_availability": {
          "status": "Available"
        },
        "ext_playlists": [],
        "features": {
          "large": {
            "faces": []
          },
          "orig": {
            "faces": []
          }
        },
        "id_str": "2116164285378252802",
        "indices": [
          264,
          287
        ],
        "media_key": "3_2116164285378252802",
        "media_results": {
          "id": "QXBpTWVkaWFSZXN1bHRzOgwAAQoAAR1eIDSkVtACCgACHV4hQbtWsJUAAA==",
          "result": {
            "__typename": "ApiMedia",
            "id": "QXBpTWVkaWE6DAABCgABHV4gNKRW0AIKAAIdXiFBu1awlQAA",
            "media_key": "3_2116164285378252802"
          }
        },
        "media_url_https": "https://pbs.twimg.com/media/HV4gNKRW0AIfqKE.jpg",
        "original_info": {
          "focus_rects": [
            {
              "h": 1010,
              "w": 1804,
              "x": 0,
              "y": 0
            },
            {
              "h": 1152,
              "w": 1152,
              "x": 0,
              "y": 0
            },
            {
              "h": 1152,
              "w": 1011,
              "x": 0,
              "y": 0
            },
            {
              "h": 1152,
              "w": 576,
              "x": 0,
              "y": 0
            },
            {
              "h": 1152,
              "w": 1804,
              "x": 0,
              "y": 0
            }
          ],
          "height": 1152,
          "width": 1804
        },
        "sizes": {
          "large": {
            "h": 1152,
            "w": 1804
          }
        },
        "type": "photo",
        "url": "https://t.co/ilyeP4YD79"
      }
    ]
  },
  "card": null,
  "place": {},
  "entities": {
    "hashtags": [],
    "symbols": [],
    "urls": [
      {
        "display_url": "sage.cs.princeton.edu/trends/emergin…",
        "expanded_url": "https://sage.cs.princeton.edu/trends/emerging-trends-paper.pdf",
        "indices": [
          201,
          224
        ],
        "url": "https://t.co/8m13p9d70F"
      },
      {
        "display_url": "sage.cs.princeton.edu/trends/",
        "expanded_url": "https://sage.cs.princeton.edu/trends/",
        "indices": [
          234,
          257
        ],
        "url": "https://t.co/xGAvBCGW4a"
      },
      {
        "display_url": "normaltech.ai/p/new-paper-em…",
        "expanded_url": "https://www.normaltech.ai/p/new-paper-emerging-trends-in-ai-agent",
        "indices": [
          264,
          287
        ],
        "url": "https://t.co/qxO21qWZfm"
      }
    ],
    "user_mentions": [
      {
        "id_str": "1958554053413142528",
        "indices": [
          1229,
          1235
        ],
        "name": "Felix Chen",
        "screen_name": "flxcn"
      },
      {
        "id_str": "138821636",
        "indices": [
          1237,
          1246
        ],
        "name": "Stephan Rabanser",
        "screen_name": "steverab"
      },
      {
        "id_str": "1036066345547444225",
        "indices": [
          1248,
          1256
        ],
        "name": "Peter Kirgis",
        "screen_name": "PKirgis"
      },
      {
        "id_str": "1798346290444611584",
        "indices": [
          1258,
          1266
        ],
        "name": "Nitya Nadgir",
        "screen_name": "nityndg"
      },
      {
        "id_str": "895659037198393344",
        "indices": [
          1268,
          1283
        ],
        "name": "rishi",
        "screen_name": "RishiBommasani"
      },
      {
        "id_str": "804222097325166592",
        "indices": [
          1285,
          1294
        ],
        "name": "Magda Dubois",
        "screen_name": "DubMagda"
      },
      {
        "id_str": "1404056967220432899",
        "indices": [
          1296,
          1304
        ],
        "name": "Cozmin Ududec",
        "screen_name": "CUdudec"
      },
      {
        "id_str": "1236338714554630145",
        "indices": [
          1306,
          1316
        ],
        "name": "Anka Reuel | @ankareuel.bsky.social",
        "screen_name": "AnkaReuel"
      },
      {
        "id_str": "3084274082",
        "indices": [
          1333,
          1341
        ],
        "name": "Sayash Kapoor",
        "screen_name": "sayashk"
      }
    ]
  },
  "quoted_tweet": null,
  "retweeted_tweet": null,
  "isLimitedReply": false,
  "communityInfo": null,
  "article": null
}