🐦 Twitter Post Details

Viewing enriched Twitter post

@petergyang

“The fundamentals for [AI evals] still apply. Start by looking at real data. What has changed is getting agents to help you look at it in a thoughtful way.” Here’s my new episode with @sh_reya and @HamelHusain, who have taught AI evals to 4,500+ engineers and PMs. I asked them to audit the evals I built for my creator skills live. They then demoed a free skill that you can use in Claude Code or Codex to build reusable evals from your feedback. Some quotes from Shreya and Hamel: “Bottom-up evals come from looking at lots of sample outputs and turning that into eval criteria. AI is very bad at coming up with them. That’s all you.” “The agent’s job is not to invent new feedback. But it can help you group and distill the feedback into actionable rubric criteria.” “All your competitors can point Claude at their product and say, ‘Find all the errors.’ What matters is how much taste you can infuse beyond that.” 📌 Watch now: https://t.co/BuTklgfbr4 Thanks to our sponsors: @WisprFlow: 4x faster than typing with your voice https://t.co/oqHJ8bN3ll @linear: The AI agent platform for modern teams https://t.co/tgWf9oL4bs

Media 2

📊 Media Metadata

{
  "media": [
    {
      "url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/2091529690041491820/media_0.mp4",
      "media_url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/2091529690041491820/media_0.mp4",
      "type": "video",
      "filename": "media_0.mp4"
    },
    {
      "url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/2091529690041491820/media_1.jpg",
      "media_url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/2091529690041491820/media_1.jpg",
      "type": "photo",
      "filename": "media_1.jpg"
    }
  ],
  "processed_at": "2026-08-23T16:02:13.596754",
  "pipeline_version": "2.0"
}

🔧 Raw API Response

{
  "type": "tweet",
  "id": "2091529690041491820",
  "url": "https://x.com/petergyang/status/2091529690041491820",
  "twitterUrl": "https://twitter.com/petergyang/status/2091529690041491820",
  "text": "“The fundamentals for [AI evals] still apply. Start by looking at real data. What has changed is getting agents to help you look at it in a thoughtful way.”\n\nHere’s my new episode with @sh_reya and @HamelHusain, who have taught AI evals to 4,500+ engineers and PMs.\n\nI asked them to audit the evals I built for my creator skills live. They then demoed a free skill that you can use in Claude Code or Codex to build reusable evals from your feedback.\n\nSome quotes from Shreya and Hamel:\n\n“Bottom-up evals come from looking at lots of sample outputs and turning that into eval criteria. AI is very bad at coming up with them. That’s all you.”\n\n“The agent’s job is not to invent new feedback. But it can help you group and distill the feedback into actionable rubric criteria.”\n\n“All your competitors can point Claude at their product and say, ‘Find all the errors.’ What matters is how much taste you can infuse beyond that.”\n\n📌 Watch now: https://t.co/BuTklgfbr4\n\nThanks to our sponsors:\n\n@WisprFlow: 4x faster than typing with your voice https://t.co/oqHJ8bN3ll\n\n@linear: The AI agent platform for modern teams https://t.co/tgWf9oL4bs",
  "source": "Twitter for iPhone",
  "retweetCount": 3,
  "replyCount": 5,
  "likeCount": 18,
  "quoteCount": 0,
  "viewCount": 3748,
  "createdAt": "Sun Aug 23 14:15:11 +0000 2026",
  "lang": "en",
  "bookmarkCount": 14,
  "isReply": false,
  "inReplyToId": null,
  "conversationId": "2091529690041491820",
  "displayTextRange": [
    0,
    279
  ],
  "inReplyToUserId": null,
  "inReplyToUsername": null,
  "author": {
    "type": "user",
    "userName": "petergyang",
    "url": "https://x.com/petergyang",
    "twitterUrl": "https://twitter.com/petergyang",
    "id": "84490044",
    "name": "Peter Yang",
    "isVerified": false,
    "isBlueVerified": true,
    "verifiedType": null,
    "profilePicture": "https://pbs.twimg.com/profile_images/1454103621516206083/_klMwpkk_normal.jpg",
    "coverPicture": "https://pbs.twimg.com/profile_banners/84490044/1776558769",
    "description": "",
    "location": "Get my best tutorials →",
    "followers": 274734,
    "following": 2197,
    "status": "",
    "canDm": true,
    "canMediaTag": true,
    "createdAt": "Fri Oct 23 02:50:52 +0000 2009",
    "entities": {
      "description": {
        "urls": []
      },
      "url": {}
    },
    "fastFollowersCount": 0,
    "favouritesCount": 30508,
    "hasCustomTimelines": true,
    "isTranslator": true,
    "mediaCount": 4516,
    "statusesCount": 28508,
    "withheldInCountries": [],
    "affiliatesHighlightedLabel": {},
    "possiblySensitive": false,
    "pinnedTweetIds": [
      "2091529690041491820"
    ],
    "profile_bio": {
      "description": "Practical AI tutorials and interviews for busy people | Get my best AI skills and guides at https://t.co/6VAA6p81x6",
      "entities": {
        "description": {
          "urls": [
            {
              "display_url": "behindthecraft.com",
              "expanded_url": "https://www.behindthecraft.com/",
              "indices": [
                92,
                115
              ],
              "url": "https://t.co/6VAA6p81x6"
            }
          ]
        },
        "url": {
          "urls": [
            {
              "display_url": "youtube.com/@peteryangyt?s…",
              "expanded_url": "https://www.youtube.com/@peteryangyt?sub_confirmation=1",
              "indices": [
                0,
                23
              ],
              "url": "https://t.co/Ggqaa3F11Z"
            }
          ]
        }
      }
    },
    "isAutomated": false,
    "automatedBy": null
  },
  "extendedEntities": {
    "media": [
      {
        "additional_media_info": {
          "monetizable": false
        },
        "display_url": "pic.x.com/TjFOBTEhNO",
        "expanded_url": "https://x.com/petergyang/status/2091529690041491820/video/1",
        "ext_master_playlist_only": [],
        "ext_media_availability": {
          "status": "Available"
        },
        "ext_playlists": [],
        "id_str": "2091529645804118016",
        "indices": [
          280,
          303
        ],
        "media_key": "13_2091529645804118016",
        "media_results": {
          "id": "QXBpTWVkaWFSZXN1bHRzOgwABAoAAR0GmyGnWmAAAAA=",
          "result": {
            "__typename": "ApiMedia",
            "id": "QXBpTWVkaWE6DAAECgABHQabIadaYAAAAA==",
            "media_key": "13_2091529645804118016"
          }
        },
        "media_url_https": "https://pbs.twimg.com/amplify_video_thumb/2091529645804118016/img/a-f-NbT_p6RK09Nm.jpg",
        "original_info": {
          "focus_rects": [],
          "height": 480,
          "width": 848
        },
        "sizes": {
          "large": {
            "h": 480,
            "w": 848
          }
        },
        "type": "video",
        "url": "https://t.co/TjFOBTEhNO",
        "video_info": {
          "aspect_ratio": [
            53,
            30
          ],
          "duration_millis": 39833,
          "variants": [
            {
              "content_type": "application/x-mpegURL",
              "url": "https://video.twimg.com/amplify_video/2091529645804118016/pl/M7hv27h3jnXaeF-o.m3u8?tag=14&v=7ae"
            },
            {
              "bitrate": 288000,
              "content_type": "video/mp4",
              "url": "https://video.twimg.com/amplify_video/2091529645804118016/vid/avc1/476x270/U91fb4skkxms1-rz.mp4?tag=14"
            },
            {
              "bitrate": 832000,
              "content_type": "video/mp4",
              "url": "https://video.twimg.com/amplify_video/2091529645804118016/vid/avc1/636x360/u8x46Le9sWQOzVL_.mp4?tag=14"
            },
            {
              "bitrate": 2176000,
              "content_type": "video/mp4",
              "url": "https://video.twimg.com/amplify_video/2091529645804118016/vid/avc1/848x480/BHNP7rFleYlWvshm.mp4?tag=14"
            }
          ]
        }
      }
    ]
  },
  "card": null,
  "place": {},
  "entities": {
    "hashtags": [],
    "symbols": [],
    "timestamps": [],
    "urls": [
      {
        "display_url": "youtube.com/watch?v=bdMHQL…",
        "expanded_url": "https://www.youtube.com/watch?v=bdMHQLvtVaQ",
        "indices": [
          938,
          961
        ],
        "url": "https://t.co/BuTklgfbr4"
      },
      {
        "display_url": "ref.wisprflow.ai/peteryang",
        "expanded_url": "https://ref.wisprflow.ai/peteryang",
        "indices": [
          1038,
          1061
        ],
        "url": "https://t.co/oqHJ8bN3ll"
      },
      {
        "display_url": "linear.app/behind-the-cra…",
        "expanded_url": "https://linear.app/behind-the-craft",
        "indices": [
          1111,
          1134
        ],
        "url": "https://t.co/tgWf9oL4bs"
      }
    ],
    "user_mentions": [
      {
        "id_str": "2286218053",
        "indices": [
          185,
          193
        ],
        "name": "Shreya Shankar",
        "screen_name": "sh_reya"
      },
      {
        "id_str": "825766640",
        "indices": [
          198,
          210
        ],
        "name": "Hamel Husain",
        "screen_name": "HamelHusain"
      },
      {
        "id_str": "1452175050765864960",
        "indices": [
          988,
          998
        ],
        "name": "Wispr Flow",
        "screen_name": "WisprFlow"
      },
      {
        "id_str": "1083130198042656768",
        "indices": [
          1063,
          1070
        ],
        "name": "Linear",
        "screen_name": "linear"
      }
    ]
  },
  "quoted_tweet": null,
  "retweeted_tweet": null,
  "isLimitedReply": false,
  "communityInfo": null,
  "article": null
}