Viewing enriched Twitter post
SALMON: Self-Alignment with Principle-Following Reward Models abs: https://t.co/n8ikVW3WUh code: https://t.co/UtUtZilnaH This paper from IBM proposes a new RLAIF paradigm that uses the LLM to judge responses based on specific principles, and trains a reward model conditional on the principles. Their 70b model surpasses Llama2-70b-chat on various benchmarks.
{
"user": {
"created_at": "2011-12-20T03:45:50.000Z",
"default_profile_image": false,
"description": "PhD at 19 |\nFounder and CEO at @MedARC_AI |\nResearch Director at @StabilityAI | \n@kaggle Notebooks GM |\nBiomed. engineer @ 14 |\nTEDx talk➡https://t.co/DwMkst4bnG",
"fast_followers_count": 0,
"favourites_count": 60004,
"followers_count": 45439,
"friends_count": 995,
"has_custom_timelines": true,
"is_translator": false,
"listed_count": 703,
"location": "",
"media_count": 1203,
"name": "Tanishq Mathew Abraham, PhD",
"normal_followers_count": 45439,
"possibly_sensitive": false,
"profile_banner_url": "https://pbs.twimg.com/profile_banners/441465751/1675968078",
"profile_image_url_https": "https://pbs.twimg.com/profile_images/1553508977735962624/nnlSwBmu_normal.jpg",
"screen_name": "iScienceLuvr",
"statuses_count": 12087,
"translator_type": "none",
"url": "https://t.co/nNzCz2VVd1",
"verified": false,
"withheld_in_countries": [],
"id_str": "441465751"
},
"id": "1711651943825953134",
"conversation_id": "1711651943825953134",
"full_text": "SALMON: Self-Alignment with Principle-Following Reward Models\n\nabs: https://t.co/n8ikVW3WUh\ncode: https://t.co/UtUtZilnaH\n\nThis paper from IBM proposes a new RLAIF paradigm that uses the LLM to judge responses based on specific principles, and trains a reward model conditional on the principles. Their 70b model surpasses Llama2-70b-chat on various benchmarks.",
"reply_count": 1,
"retweet_count": 28,
"favorite_count": 149,
"hashtags": [],
"symbols": [],
"user_mentions": [],
"urls": [
{
"url": "https://t.co/wXnKYvzDJc",
"expanded_url": "https://arxiv.org/abs/2310.05910",
"display_url": "arxiv.org/abs/2310.05910"
},
{
"url": "https://t.co/ZXqyI8N9H5",
"expanded_url": "https://github.com/IBM/SALMON",
"display_url": "github.com/IBM/SALMON"
}
],
"media": [
{
"media_url": "https://pbs.twimg.com/media/F8D_SE1bUAAZKUX.jpg",
"type": "photo"
}
],
"url": "https://twitter.com/iScienceLuvr/status/1711651943825953134",
"created_at": "2023-10-10T07:56:39.000Z",
"#sort_index": "1711651943825953134",
"view_count": 24325,
"quote_count": 1,
"is_quote_tweet": false,
"is_retweet": false,
"is_pinned": false,
"is_truncated": true,
"startUrl": "https://twitter.com/iscienceluvr/status/1711651943825953134"
}