🐦 Twitter Post Details

Viewing enriched Twitter post

@bindureddy

ANNOUNCING Giraffe - Long Context Open-Source LLMs - An AI Brain for your Organization We are excited to invent and open-source Giraffe, the world's first commercially usable 32K long-context open-source LLM based on Llama-2 Our AI research paper details our inventions around context-length extrapolation. In layman's terms, context length is the amount of data you can send to a large language model (LLM) in one API call. Context length becomes very important when building a Custom ChatGPT - An AI brain for your organization based on your knowledge base. You are constrained by the amount of proprietary data you can send in one API call. So the bigger the context length, the better. Today's SOTA open-source LLMs such as Llama 1 and 2 have one big shortcoming! These LLMs have a very small context length of only 2K. This makes them unusable in any enterprise land. Our open-source model extends (extrapolates) context length from 2k to 32K! The longest context for an open-source model to date! This makes it super easy to send bigger documents to the LLM and get your questions/chats answered. The 32K Giraffe can do more complex retrievals with fewer mistakes and is essential for maintaining long conversations, or for asking an LLM to help with coding on a large existing codebase. The 32K Giraffe, can easily function like an AI brain for your business - boosting employee productivity, improving decision making and surfacing custom insights from your data In addition, in our research paper, we showcase the two new approaches we have invented around context-length exploration and compare and test them thoroughly against other prominent approaches. One of our methods, called truncation shows some very promising results. Our blog post has all the details including links to the paper, open-source models, and our git-repo https://t.co/anYyRnR02i

🔧 Raw API Response

{
  "user": {
    "created_at": "2007-05-29T00:21:54.000Z",
    "default_profile_image": false,
    "description": "CEO of @abacusai, the AI-assisted data-science & LLMOps platform to build applied AI systems at scale, ex-AWS / Google, passionate about human behavior",
    "fast_followers_count": 0,
    "favourites_count": 6006,
    "followers_count": 89086,
    "friends_count": 400,
    "has_custom_timelines": true,
    "is_translator": false,
    "listed_count": 1159,
    "location": "San Francisco, CA",
    "media_count": 485,
    "name": "Bindu Reddy",
    "normal_followers_count": 89086,
    "possibly_sensitive": false,
    "profile_banner_url": "https://pbs.twimg.com/profile_banners/6398252/1689653510",
    "profile_image_url_https": "https://pbs.twimg.com/profile_images/1443737943684763651/32WHA-kg_normal.jpg",
    "screen_name": "bindureddy",
    "statuses_count": 10611,
    "translator_type": "none",
    "url": "https://t.co/QA1YZ10l2F",
    "verified": false,
    "withheld_in_countries": [],
    "id_str": "6398252"
  },
  "id": "1694126931174977906",
  "conversation_id": "1694126931174977906",
  "full_text": "ANNOUNCING Giraffe - Long Context Open-Source LLMs - An AI Brain for your Organization\n\nWe are excited to invent and open-source Giraffe, the world's first commercially usable 32K long-context open-source LLM based on Llama-2\n \nOur AI research paper details our inventions around context-length extrapolation. In layman's terms, context length is the amount of data you can send to a large language model (LLM) in one API call. \n\nContext length becomes very important when building a Custom ChatGPT - An AI brain for your organization based on your knowledge base.\n\nYou are constrained by the amount of proprietary data you can send in one API call. So the bigger the context length, the better. \n\nToday's SOTA open-source LLMs such as Llama 1 and 2 have one big shortcoming!  These LLMs have a very small context length of only 2K. This makes them unusable in any enterprise land.\n\nOur open-source model extends (extrapolates) context length from 2k to 32K! The longest context for an open-source model to date! This makes it super easy to send bigger documents to the LLM and get your questions/chats answered.\n\nThe 32K Giraffe can do more complex retrievals with fewer mistakes and is essential for maintaining long conversations, or for asking an LLM to help with coding on a large existing codebase. \n\nThe 32K Giraffe, can easily function like an AI brain for your business - boosting employee productivity, improving decision making and surfacing custom insights from your data\n\nIn addition, in our research paper, we showcase the two new approaches we have invented around context-length exploration and compare and test them thoroughly against other prominent approaches. One of our methods, called truncation shows some very promising results.\n\nOur blog post has all the details including links to the paper, open-source models, and our git-repo\n\nhttps://t.co/anYyRnR02i",
  "reply_count": 55,
  "retweet_count": 406,
  "favorite_count": 2132,
  "hashtags": [],
  "symbols": [],
  "user_mentions": [],
  "urls": [],
  "media": [
    {
      "media_url": "https://pbs.twimg.com/media/F4K_KcZbIAAtkHI.jpg",
      "type": "photo"
    }
  ],
  "url": "https://twitter.com/bindureddy/status/1694126931174977906",
  "created_at": "2023-08-22T23:18:30.000Z",
  "#sort_index": "1694126931174977906",
  "view_count": 641850,
  "quote_count": 34,
  "is_quote_tweet": false,
  "is_retweet": false,
  "is_pinned": false,
  "is_truncated": true,
  "startUrl": "https://twitter.com/bindureddy/status/1694126931174977906"
}