🐦 Twitter Post Details

Viewing enriched Twitter post

@rohanpaul_ai

Researchers found our current approach to making AI smarter over time has a giant blind spot. AI is not actually understanding or applying high-level abstract lessons at all. Developers spend massive amounts of time building systems that condense past AI mistakes into neat little rules for the future. This paper proves that the AI essentially throws those rules in the trash and only looks at raw historical logs. Modern LLM systems try to get better over time by storing past tasks as either raw step-by-step histories or condensed summary rules. The study tested if these agents actually use their stored memories by secretly swapping the correct tips with random garbage text. - When the step-by-step histories were messed up, the AI failed hard, proving it heavily relies on copying exact past actions. - But when researchers completely corrupted the condensed summary rules, the AI kept acting normally and showed zero performance drop. If an AI cannot apply an abstract lesson to a new situation, it is not truly reasoning or learning. This raises the question if the entire AI industry need to rethink how memory works because right now these agents are just mimicking instead of understanding. ---- arxiv. org/abs/2601.22436 "LLM Agents Are Not Always Faithful Self-Evolvers"

Media 1

šŸ“Š Media Metadata

{
  "media": [
    {
      "url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/2066166267950858561/media_0.jpg",
      "media_url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/2066166267950858561/media_0.jpg",
      "type": "photo",
      "filename": "media_0.jpg"
    }
  ],
  "processed_at": "2026-06-14T15:20:39.018870",
  "pipeline_version": "2.0"
}

šŸ”§ Raw API Response

{
  "type": "tweet",
  "id": "2066166267950858561",
  "url": "https://x.com/rohanpaul_ai/status/2066166267950858561",
  "twitterUrl": "https://twitter.com/rohanpaul_ai/status/2066166267950858561",
  "text": "Researchers found our current approach to making AI smarter over time has a giant blind spot.\n\nAI is not actually understanding or applying high-level abstract lessons at all.\n\nDevelopers spend massive amounts of time building systems that condense past AI mistakes into neat little rules for the future.\n\nThis paper proves that the AI essentially throws those rules in the trash and only looks at raw historical logs.\n\nModern LLM systems try to get better over time by storing past tasks as either raw step-by-step histories or condensed summary rules. The study tested if these agents actually use their stored memories by secretly swapping the correct tips with random garbage text.\n\n- When the step-by-step histories were messed up, the AI failed hard, proving it heavily relies on copying exact past actions.\n\n- But when researchers completely corrupted the condensed summary rules, the AI kept acting normally and showed zero performance drop.\n\nIf an AI cannot apply an abstract lesson to a new situation, it is not truly reasoning or learning.\n\nThis raises the question if the entire AI industry need to rethink how memory works because right now these agents are just mimicking instead of understanding.\n\n----\n\narxiv. org/abs/2601.22436\n\n\"LLM Agents Are Not Always Faithful Self-Evolvers\"",
  "source": "Twitter for iPhone",
  "retweetCount": 5,
  "replyCount": 1,
  "likeCount": 24,
  "quoteCount": 3,
  "viewCount": 2125,
  "createdAt": "Sun Jun 14 14:30:00 +0000 2026",
  "lang": "en",
  "bookmarkCount": 15,
  "isReply": false,
  "inReplyToId": null,
  "conversationId": "2066166267950858561",
  "displayTextRange": [
    0,
    275
  ],
  "inReplyToUserId": null,
  "inReplyToUsername": null,
  "author": {
    "type": "user",
    "userName": "rohanpaul_ai",
    "url": "https://x.com/rohanpaul_ai",
    "twitterUrl": "https://twitter.com/rohanpaul_ai",
    "id": "2588345408",
    "name": "Rohan Paul",
    "isVerified": false,
    "isBlueVerified": true,
    "verifiedType": null,
    "profilePicture": "https://pbs.twimg.com/profile_images/1816185267037859840/Fd18CH0v_normal.jpg",
    "coverPicture": "https://pbs.twimg.com/profile_banners/2588345408/1729559315",
    "description": "",
    "location": "Ex Inv Banking (Deutsche)",
    "followers": 150236,
    "following": 7208,
    "status": "",
    "canDm": true,
    "canMediaTag": false,
    "createdAt": "Wed Jun 25 22:38:54 +0000 2014",
    "entities": {
      "description": {
        "urls": []
      },
      "url": {}
    },
    "fastFollowersCount": 0,
    "favouritesCount": 67044,
    "hasCustomTimelines": true,
    "isTranslator": false,
    "mediaCount": 30021,
    "statusesCount": 73943,
    "withheldInCountries": [],
    "affiliatesHighlightedLabel": {},
    "possiblySensitive": false,
    "pinnedTweetIds": [
      "1965551636082032917"
    ],
    "profile_bio": {
      "description": "Compiling in real-time, the race towards AGI.\n\nThe Largest Show on X for AI.\n\nšŸ—žļø Get my daily AI analysis newsletter to your email  šŸ‘‰ https://t.co/6LBxO8215l",
      "entities": {
        "description": {
          "urls": [
            {
              "display_url": "rohan-paul.com",
              "expanded_url": "https://www.rohan-paul.com",
              "indices": [
                134,
                157
              ],
              "url": "https://t.co/6LBxO8215l"
            }
          ]
        },
        "url": {
          "urls": [
            {
              "display_url": "rohan-paul.com",
              "expanded_url": "http://www.rohan-paul.com",
              "indices": [
                0,
                23
              ],
              "url": "https://t.co/2NKnK0wIil"
            }
          ]
        }
      }
    },
    "isAutomated": false,
    "automatedBy": null
  },
  "extendedEntities": {
    "media": [
      {
        "allow_download_status": {
          "allow_download": true
        },
        "display_url": "pic.twitter.com/fYfsWnblpz",
        "expanded_url": "https://twitter.com/rohanpaul_ai/status/2066166267950858561/photo/1",
        "ext_master_playlist_only": [],
        "ext_media_availability": {
          "status": "Available"
        },
        "ext_playlists": [],
        "features": {
          "large": {
            "faces": [
              {
                "h": 42,
                "w": 42,
                "x": 765,
                "y": 308
              },
              {
                "h": 49,
                "w": 49,
                "x": 638,
                "y": 492
              },
              {
                "h": 54,
                "w": 54,
                "x": 712,
                "y": 225
              },
              {
                "h": 59,
                "w": 59,
                "x": 440,
                "y": 638
              },
              {
                "h": 62,
                "w": 62,
                "x": 439,
                "y": 323
              },
              {
                "h": 67,
                "w": 67,
                "x": 42,
                "y": 616
              }
            ]
          },
          "orig": {
            "faces": [
              {
                "h": 42,
                "w": 42,
                "x": 765,
                "y": 308
              },
              {
                "h": 49,
                "w": 49,
                "x": 638,
                "y": 492
              },
              {
                "h": 54,
                "w": 54,
                "x": 712,
                "y": 225
              },
              {
                "h": 59,
                "w": 59,
                "x": 440,
                "y": 638
              },
              {
                "h": 62,
                "w": 62,
                "x": 439,
                "y": 323
              },
              {
                "h": 67,
                "w": 67,
                "x": 42,
                "y": 616
              }
            ]
          }
        },
        "id_str": "2066075696729047040",
        "indices": [
          276,
          299
        ],
        "media_key": "3_2066075696729047040",
        "media_results": {
          "id": "QXBpTWVkaWFSZXN1bHRzOgwAAQoAARysLOZOmkAACgACHKx/RhAbAUEAAA==",
          "result": {
            "__typename": "ApiMedia",
            "id": "QXBpTWVkaWE6DAABCgABHKws5k6aQAAKAAIcrH9GEBsBQQAA",
            "media_key": "3_2066075696729047040"
          }
        },
        "media_url_https": "https://pbs.twimg.com/media/HKws5k6aQAAnTQp.jpg",
        "original_info": {
          "focus_rects": [
            {
              "h": 539,
              "w": 962,
              "x": 0,
              "y": 0
            },
            {
              "h": 805,
              "w": 805,
              "x": 150,
              "y": 0
            },
            {
              "h": 805,
              "w": 706,
              "x": 199,
              "y": 0
            },
            {
              "h": 805,
              "w": 403,
              "x": 351,
              "y": 0
            },
            {
              "h": 805,
              "w": 962,
              "x": 0,
              "y": 0
            }
          ],
          "height": 805,
          "width": 962
        },
        "sizes": {
          "large": {
            "h": 805,
            "w": 962
          }
        },
        "type": "photo",
        "url": "https://t.co/fYfsWnblpz"
      }
    ]
  },
  "card": null,
  "place": {},
  "entities": {
    "hashtags": [],
    "symbols": [],
    "urls": [],
    "user_mentions": []
  },
  "quoted_tweet": null,
  "retweeted_tweet": null,
  "isLimitedReply": false,
  "communityInfo": null,
  "article": null
}