🐦 Twitter Post Details

Viewing enriched Twitter post

@abacaj

Not sure if anyone else has seen this, I get very bad outputs using the HF code llama models, see below for the same prompt using HF vs meta provided code & weights (34b model). Also recommend the inference code from meta which is much faster out of the box https://t.co/mtqq53BkRq

🔧 Raw API Response

{
  "user": {
    "created_at": "2009-08-31T22:06:04.000Z",
    "default_profile_image": false,
    "description": "just a software engineer. Hacking on large language models. Get in touch if you need an eng",
    "fast_followers_count": 0,
    "favourites_count": 22137,
    "followers_count": 13592,
    "friends_count": 314,
    "has_custom_timelines": true,
    "is_translator": false,
    "listed_count": 441,
    "location": "",
    "media_count": 1160,
    "name": "anton",
    "normal_followers_count": 13592,
    "possibly_sensitive": false,
    "profile_banner_url": "https://pbs.twimg.com/profile_banners/70514287/1665627801",
    "profile_image_url_https": "https://pbs.twimg.com/profile_images/1678598826544734210/Z8ZMuiAR_normal.jpg",
    "screen_name": "abacaj",
    "statuses_count": 6754,
    "translator_type": "none",
    "url": "https://t.co/C9Xh6a7AC9",
    "verified": false,
    "withheld_in_countries": [],
    "id_str": "70514287"
  },
  "id": "1695334296792264792",
  "conversation_id": "1695334296792264792",
  "full_text": "Not sure if anyone else has seen this, I get very bad outputs using the HF code llama models, see below for the same prompt using HF vs meta provided code & weights (34b model). Also recommend the inference code from meta which is much faster out of the box https://t.co/mtqq53BkRq",
  "reply_count": 17,
  "retweet_count": 23,
  "favorite_count": 215,
  "hashtags": [],
  "symbols": [],
  "user_mentions": [],
  "urls": [],
  "media": [
    {
      "media_url": "https://pbs.twimg.com/media/F4cJiLSWQAEWrqa.jpg",
      "type": "photo"
    }
  ],
  "url": "https://twitter.com/abacaj/status/1695334296792264792",
  "created_at": "2023-08-26T07:16:08.000Z",
  "#sort_index": "1695334296792264792",
  "view_count": 59909,
  "quote_count": 0,
  "is_quote_tweet": false,
  "is_retweet": false,
  "is_pinned": false,
  "is_truncated": false,
  "startUrl": "https://twitter.com/abacaj/status/1695334296792264792"
}