@omarsar0
RT @omarsar0: NEW paper worth reading. (bookmark it) The basic idea is to pair a compressive recurrent state with a small exact memory, w…
Viewing enriched Twitter post
RT @omarsar0: NEW paper worth reading. (bookmark it) The basic idea is to pair a compressive recurrent state with a small exact memory, w…
{
"score": 0.36,
"score_components": {
"author": 0.09,
"engagement": 0.0,
"quality": 0.06000000000000001,
"source": 0.135,
"nlp": 0.05,
"recency": 0.025
},
"scored_at": "2026-07-04T04:01:45.662986",
"import_source": "api_import",
"source_tagged_at": "2026-07-04T04:01:45.662994",
"enriched": true,
"enriched_at": "2026-07-04T04:01:45.662996"
} {
"type": "tweet",
"id": "2073250672729022574",
"url": "https://x.com/omarsar0/status/2073250672729022574",
"twitterUrl": "https://twitter.com/omarsar0/status/2073250672729022574",
"text": "RT @omarsar0: NEW paper worth reading.\n\n(bookmark it)\n\nThe basic idea is to pair a compressive recurrent state with a small exact memory, w…",
"source": "Twitter for iPhone",
"retweetCount": 15,
"replyCount": 10,
"likeCount": 118,
"quoteCount": 1,
"viewCount": 10570,
"createdAt": "Sat Jul 04 03:40:54 +0000 2026",
"lang": "en",
"bookmarkCount": 123,
"isReply": false,
"inReplyToId": null,
"conversationId": "2073250672729022574",
"displayTextRange": [
0,
140
],
"inReplyToUserId": null,
"inReplyToUsername": null,
"author": {
"type": "user",
"userName": "omarsar0",
"url": "https://x.com/omarsar0",
"twitterUrl": "https://twitter.com/omarsar0",
"id": "3448284313",
"name": "elvis",
"isVerified": false,
"isBlueVerified": true,
"verifiedType": null,
"profilePicture": "https://pbs.twimg.com/profile_images/939313677647282181/vZjFWtAn_normal.jpg",
"coverPicture": "https://pbs.twimg.com/profile_banners/3448284313/1565974901",
"description": "Building self-improving AI @dair_ai • Prev: Meta AI | PhD • Learn about AI Agents for FREE here: https://t.co/P5SA9u54xO",
"location": "DAIR.AI Academy",
"followers": 309703,
"following": 895,
"status": "",
"canDm": true,
"canMediaTag": true,
"createdAt": "Fri Sep 04 12:59:26 +0000 2015",
"entities": {
"description": {
"urls": [
{
"display_url": "academy.dair.ai/courses/elemen…",
"expanded_url": "https://academy.dair.ai/courses/elements-of-ai-agents",
"indices": [
97,
120
],
"url": "https://t.co/P5SA9u54xO"
}
]
},
"url": {
"urls": [
{
"display_url": "dair.ai",
"expanded_url": "https://www.dair.ai/",
"indices": [
0,
23
],
"url": "https://t.co/XQto5ypkSM"
}
]
}
},
"fastFollowersCount": 0,
"favouritesCount": 37353,
"hasCustomTimelines": true,
"isTranslator": false,
"mediaCount": 4765,
"statusesCount": 18623,
"withheldInCountries": [],
"affiliatesHighlightedLabel": {},
"possiblySensitive": false,
"pinnedTweetIds": [
"2073183732492603411"
],
"profile_bio": {},
"isAutomated": false,
"automatedBy": null
},
"extendedEntities": {},
"card": null,
"place": {},
"entities": {
"user_mentions": [
{
"id_str": "3448284313",
"indices": [
3,
12
],
"name": "elvis",
"screen_name": "omarsar0"
}
]
},
"quoted_tweet": null,
"retweeted_tweet": {
"type": "tweet",
"id": "2073068756293869685",
"url": "https://x.com/omarsar0/status/2073068756293869685",
"twitterUrl": "https://twitter.com/omarsar0/status/2073068756293869685",
"text": "NEW paper worth reading.\n\n(bookmark it)\n\nThe basic idea is to pair a compressive recurrent state with a small exact memory, which helps to recover long-range recall without giving up the efficiency of linear attention.\n\nMore on it below:\n\nLinear-attention and state-space models compress the whole prefix into a fixed-size state. That buys O(1) memory, but when many key-value associations compete, earlier facts get overwritten and needle recall degrades.\n\nHOLA gives linear attention a hippocampal complement. It keeps the usual delta-rule state as compressive memory and adds a bounded exact KV cache, forming a semiparametric test-time memory.\n\nThe state models linearly compressible structure while the cache stores associations that should not be forced through it. The cache writes without a learned eviction module, keeping only tokens whose prediction residual was actually committed to the state.\n\nAt 340M parameters on 15B SlimPajama tokens, HOLA lowers Wikitext perplexity from 27.32 to 22.92, below a full-attention Transformer++ at 26.88, and stays robust on RULER needle recall out to 32k tokens, 16x its training length.\n\nPaper: https://t.co/z1Jzp7qQ6B\n\nLearn to build effective AI agents in our academy: https://t.co/1e8RZKs4uX",
"source": "Twitter for iPhone",
"retweetCount": 15,
"replyCount": 10,
"likeCount": 118,
"quoteCount": 1,
"viewCount": 10570,
"createdAt": "Fri Jul 03 15:38:01 +0000 2026",
"lang": "en",
"bookmarkCount": 123,
"isReply": false,
"inReplyToId": null,
"conversationId": "2073068756293869685",
"displayTextRange": [
0,
278
],
"inReplyToUserId": null,
"inReplyToUsername": null,
"author": {
"type": "user",
"userName": "omarsar0",
"url": "https://x.com/omarsar0",
"twitterUrl": "https://twitter.com/omarsar0",
"id": "3448284313",
"name": "elvis",
"isVerified": false,
"isBlueVerified": true,
"verifiedType": null,
"profilePicture": "https://pbs.twimg.com/profile_images/939313677647282181/vZjFWtAn_normal.jpg",
"coverPicture": "https://pbs.twimg.com/profile_banners/3448284313/1565974901",
"description": "Building self-improving AI @dair_ai • Prev: Meta AI | PhD • Learn about AI Agents for FREE here: https://t.co/P5SA9u54xO",
"location": "DAIR.AI Academy",
"followers": 309703,
"following": 895,
"status": "",
"canDm": true,
"canMediaTag": true,
"createdAt": "Fri Sep 04 12:59:26 +0000 2015",
"entities": {
"description": {
"urls": [
{
"display_url": "academy.dair.ai/courses/elemen…",
"expanded_url": "https://academy.dair.ai/courses/elements-of-ai-agents",
"indices": [
97,
120
],
"url": "https://t.co/P5SA9u54xO"
}
]
},
"url": {
"urls": [
{
"display_url": "dair.ai",
"expanded_url": "https://www.dair.ai/",
"indices": [
0,
23
],
"url": "https://t.co/XQto5ypkSM"
}
]
}
},
"fastFollowersCount": 0,
"favouritesCount": 37353,
"hasCustomTimelines": true,
"isTranslator": false,
"mediaCount": 4765,
"statusesCount": 18623,
"withheldInCountries": [],
"affiliatesHighlightedLabel": {},
"possiblySensitive": false,
"pinnedTweetIds": [
"2073183732492603411"
],
"profile_bio": {},
"isAutomated": false,
"automatedBy": null
},
"extendedEntities": {
"media": [
{
"display_url": "pic.x.com/P6o9juK2zA",
"expanded_url": "https://x.com/omarsar0/status/2073068756293869685/photo/1",
"ext_media_availability": {
"status": "Available"
},
"features": {
"large": {
"faces": []
},
"medium": {
"faces": []
},
"orig": {
"faces": []
},
"small": {
"faces": []
}
},
"id_str": "2073068752552558593",
"indices": [
279,
302
],
"media_key": "3_2073068752552558593",
"media_results": {
"result": {
"media_key": "3_2073068752552558593"
}
},
"media_url_https": "https://pbs.twimg.com/media/HMUFC_7bgAE9_aa.jpg",
"original_info": {
"focus_rects": [
{
"h": 960,
"w": 1714,
"x": 0,
"y": 0
},
{
"h": 1714,
"w": 1714,
"x": 0,
"y": 0
},
{
"h": 1902,
"w": 1668,
"x": 0,
"y": 0
},
{
"h": 1902,
"w": 951,
"x": 48,
"y": 0
},
{
"h": 1902,
"w": 1714,
"x": 0,
"y": 0
}
],
"height": 1902,
"width": 1714
},
"sizes": {
"large": {
"h": 1902,
"resize": "fit",
"w": 1714
},
"medium": {
"h": 1200,
"resize": "fit",
"w": 1081
},
"small": {
"h": 680,
"resize": "fit",
"w": 613
},
"thumb": {
"h": 150,
"resize": "crop",
"w": 150
}
},
"type": "photo",
"url": "https://t.co/P6o9juK2zA"
}
]
},
"card": null,
"place": {},
"entities": {
"hashtags": [],
"symbols": [],
"urls": [
{
"display_url": "arxiv.org/abs/2607.02303",
"expanded_url": "https://arxiv.org/abs/2607.02303",
"indices": [
1145,
1168
],
"url": "https://t.co/z1Jzp7qQ6B"
},
{
"display_url": "academy.dair.ai",
"expanded_url": "https://academy.dair.ai/",
"indices": [
1221,
1244
],
"url": "https://t.co/1e8RZKs4uX"
}
],
"user_mentions": []
},
"quoted_tweet": null,
"retweeted_tweet": null,
"article": null
},
"article": null
}