🐦 Twitter Post Details

Viewing enriched Twitter post

@dair_ai

New research from NVIDIA. Long-running agentic tasks like deep research require multi-hop reasoning over many documents. One of the biggest challenges with agents is that context grows rapidly, and KV cache memory usage becomes the bottleneck. As agents take on longer tasks, memory management can't rely on static heuristics. Letting the model manage its own context is both more effective and more adaptive. Existing cache compression techniques use fixed heuristics to decide what to keep. But in agentic reasoning, a token that seems unimportant early on may become critical ten turns later. This new NVIDIA research paper introduces SideQuest, a framework where the reasoning model itself manages its own KV cache. The model reasons about which tokens are still useful and clears the rest, essentially performing its own memory garbage collection. This management runs as an auxiliary task in parallel with the main reasoning thread, so the management tokens never pollute the primary context. That's important. Trained with just 215 samples, SideQuest reduces peak token usage by up to 65% on agentic tasks with minimal accuracy loss, outperforming all heuristic-based compression techniques. Paper: https://t.co/n3P6UjtLJ7 Learn to build effective AI agents in our academy: https://t.co/LRnpZN7L4c

Media 1
Media 2

📊 Media Metadata

{
  "media": [
    {
      "type": "photo",
      "url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/2027417456537710721/media_0.jpg?",
      "filename": "media_0.jpg"
    },
    {
      "type": "photo",
      "url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/2027417456537710721/media_1.png?",
      "filename": "media_1.png"
    }
  ],
  "processed_at": "2026-03-01T19:15:20.687657",
  "pipeline_version": "2.0"
}

🔧 Raw API Response

{
  "type": "tweet",
  "id": "2027417456537710721",
  "url": "https://x.com/dair_ai/status/2027417456537710721",
  "twitterUrl": "https://twitter.com/dair_ai/status/2027417456537710721",
  "text": "New research from NVIDIA.\n\nLong-running agentic tasks like deep research require multi-hop reasoning over many documents.\n\nOne of the biggest challenges with agents is that context grows rapidly, and KV cache memory usage becomes the bottleneck.\n\nAs agents take on longer tasks, memory management can't rely on static heuristics. Letting the model manage its own context is both more effective and more adaptive.\n\nExisting cache compression techniques use fixed heuristics to decide what to keep. But in agentic reasoning, a token that seems unimportant early on may become critical ten turns later.\n\nThis new NVIDIA research paper introduces SideQuest, a framework where the reasoning model itself manages its own KV cache. The model reasons about which tokens are still useful and clears the rest, essentially performing its own memory garbage collection.\n\nThis management runs as an auxiliary task in parallel with the main reasoning thread, so the management tokens never pollute the primary context. That's important.\n\nTrained with just 215 samples, SideQuest reduces peak token usage by up to 65% on agentic tasks with minimal accuracy loss, outperforming all heuristic-based compression techniques.\n\nPaper: https://t.co/n3P6UjtLJ7\n\nLearn to build effective AI agents in our academy: https://t.co/LRnpZN7L4c",
  "source": "Twitter for iPhone",
  "retweetCount": 33,
  "replyCount": 8,
  "likeCount": 225,
  "quoteCount": 5,
  "viewCount": 21491,
  "createdAt": "Fri Feb 27 16:16:03 +0000 2026",
  "lang": "en",
  "bookmarkCount": 232,
  "isReply": false,
  "inReplyToId": null,
  "conversationId": "2027417456537710721",
  "displayTextRange": [
    0,
    278
  ],
  "inReplyToUserId": null,
  "inReplyToUsername": null,
  "author": {
    "type": "user",
    "userName": "dair_ai",
    "url": "https://x.com/dair_ai",
    "twitterUrl": "https://twitter.com/dair_ai",
    "id": "889050642903293953",
    "name": "DAIR.AI",
    "isVerified": false,
    "isBlueVerified": true,
    "verifiedType": null,
    "profilePicture": "https://pbs.twimg.com/profile_images/1643277398522187778/31dedbLo_normal.jpg",
    "coverPicture": "https://pbs.twimg.com/profile_banners/889050642903293953/1742055232",
    "description": "",
    "location": "",
    "followers": 90586,
    "following": 1,
    "status": "",
    "canDm": true,
    "canMediaTag": true,
    "createdAt": "Sun Jul 23 09:12:45 +0000 2017",
    "entities": {
      "description": {
        "urls": []
      },
      "url": {}
    },
    "fastFollowersCount": 0,
    "favouritesCount": 4185,
    "hasCustomTimelines": true,
    "isTranslator": false,
    "mediaCount": 161,
    "statusesCount": 2963,
    "withheldInCountries": [],
    "affiliatesHighlightedLabel": {},
    "possiblySensitive": false,
    "pinnedTweetIds": [
      "2028094132090966088"
    ],
    "profile_bio": {
      "description": "Democratizing AI research, education, and technologies.",
      "entities": {
        "description": {
          "hashtags": [],
          "symbols": [],
          "urls": [],
          "user_mentions": []
        },
        "url": {
          "urls": [
            {
              "display_url": "dair.ai",
              "expanded_url": "https://www.dair.ai/",
              "indices": [
                0,
                23
              ],
              "url": "https://t.co/lkqPZtMmfU"
            }
          ]
        }
      }
    },
    "isAutomated": false,
    "automatedBy": null
  },
  "extendedEntities": {
    "media": [
      {
        "display_url": "pic.twitter.com/silNLoyoK3",
        "expanded_url": "https://twitter.com/dair_ai/status/2027417456537710721/photo/1",
        "ext_media_availability": {
          "status": "Available"
        },
        "features": {
          "large": {
            "faces": []
          },
          "orig": {
            "faces": []
          }
        },
        "id_str": "2027417452741894144",
        "indices": [
          279,
          302
        ],
        "media_key": "3_2027417452741894144",
        "media_results": {
          "id": "QXBpTWVkaWFSZXN1bHRzOgwAAQoAARwi1W56G6AACgACHCLVb1xbMIEAAA==",
          "result": {
            "__typename": "ApiMedia",
            "id": "QXBpTWVkaWE6DAABCgABHCLVbnoboAAKAAIcItVvXFswgQAA",
            "media_key": "3_2027417452741894144"
          }
        },
        "media_url_https": "https://pbs.twimg.com/media/HCLVbnoboAAb3pR.jpg",
        "original_info": {
          "focus_rects": [
            {
              "h": 903,
              "w": 1612,
              "x": 0,
              "y": 0
            },
            {
              "h": 1612,
              "w": 1612,
              "x": 0,
              "y": 0
            },
            {
              "h": 1774,
              "w": 1556,
              "x": 0,
              "y": 0
            },
            {
              "h": 1774,
              "w": 887,
              "x": 310,
              "y": 0
            },
            {
              "h": 1774,
              "w": 1612,
              "x": 0,
              "y": 0
            }
          ],
          "height": 1774,
          "width": 1612
        },
        "sizes": {
          "large": {
            "h": 1774,
            "w": 1612
          }
        },
        "type": "photo",
        "url": "https://t.co/silNLoyoK3"
      }
    ]
  },
  "card": null,
  "place": {},
  "entities": {
    "hashtags": [],
    "symbols": [],
    "urls": [
      {
        "display_url": "arxiv.org/abs/2602.22603",
        "expanded_url": "https://arxiv.org/abs/2602.22603",
        "indices": [
          1214,
          1237
        ],
        "url": "https://t.co/n3P6UjtLJ7"
      },
      {
        "display_url": "academy.dair.ai",
        "expanded_url": "https://academy.dair.ai/",
        "indices": [
          1290,
          1313
        ],
        "url": "https://t.co/LRnpZN7L4c"
      }
    ],
    "user_mentions": []
  },
  "quoted_tweet": null,
  "retweeted_tweet": null,
  "isLimitedReply": false,
  "article": null
}