{
  "type": "tweet",
  "id": "2012148362670149716",
  "url": "https://x.com/RitchieVink/status/2012148362670149716",
  "twitterUrl": "https://twitter.com/RitchieVink/status/2012148362670149716",
  "text": "So there was quite a sensational rant post titling \"DuckDB beats Polars for 1TB of data\" and the video \"Polars Got Destroyed by DuckDB in this 1TB Test\" that was shared a lot.\n\nThere was no code shared for Polars and upon request, we were ignored.  These posts were conveniently shared in posts and newsletters because they fit a narrative.\n\nIn any case, I went through the effort to reproduce the dataset and run the exact benchmark.\n\nThe post mentioned 64GB RAM, so I ran on a 5a.8xlarge (32vCPU / 64GB RAM).\n\nPolars did not go OOM, but finished the query in 14 minutes never exceeding 14GB RAM usage. \n\nOn the same machine DuckDB also took 14 minutes. Both tools hit the bandwidth limit: 1 TB / 10 Gbps = 13.3 min, but that makes less of a title 😉.\n\nThe whole benchmark was just hard to reproduce, the 1TB part of it made it unwieldy, but didn't matter. It could have done with a 100GB benchmark as the cardinality of the groups was just ~1800. \n\nHere is the Polars query: https://t.co/62oLSctcSd\n\nSo I guess... Code or it didn't happen.",
  "source": "Twitter for iPhone",
  "retweetCount": 27,
  "replyCount": 12,
  "likeCount": 485,
  "quoteCount": 1,
  "viewCount": 50602,
  "createdAt": "Fri Jan 16 13:02:08 +0000 2026",
  "lang": "en",
  "bookmarkCount": 127,
  "isReply": false,
  "inReplyToId": null,
  "conversationId": "2012148362670149716",
  "displayTextRange": [
    0,
    303
  ],
  "inReplyToUserId": null,
  "inReplyToUsername": null,
  "author": {
    "type": "user",
    "userName": "RitchieVink",
    "url": "https://x.com/RitchieVink",
    "twitterUrl": "https://twitter.com/RitchieVink",
    "id": "71857743",
    "name": "Ritchie Vink",
    "isVerified": false,
    "isBlueVerified": true,
    "verifiedType": null,
    "profilePicture": "https://pbs.twimg.com/profile_images/769293632897708032/M_mbf6L9_normal.jpg",
    "coverPicture": "",
    "description": "",
    "location": "",
    "followers": 2736,
    "following": 171,
    "status": "",
    "canDm": false,
    "canMediaTag": true,
    "createdAt": "Sat Sep 05 18:09:31 +0000 2009",
    "entities": {
      "description": {
        "urls": []
      },
      "url": {}
    },
    "fastFollowersCount": 0,
    "favouritesCount": 878,
    "hasCustomTimelines": true,
    "isTranslator": false,
    "mediaCount": 83,
    "statusesCount": 814,
    "withheldInCountries": [],
    "affiliatesHighlightedLabel": {},
    "possiblySensitive": false,
    "pinnedTweetIds": [],
    "profile_bio": {
      "description": "Author of Polars | CEO & Founder Polars Inc | Building scalable Polars",
      "entities": {
        "description": {},
        "url": {
          "urls": [
            {
              "display_url": "ritchievink.com",
              "expanded_url": "https://www.ritchievink.com",
              "indices": [
                0,
                23
              ],
              "url": "https://t.co/ZPGKa5rbv6"
            }
          ]
        }
      }
    },
    "isAutomated": false,
    "automatedBy": null
  },
  "extendedEntities": {
    "media": [
      {
        "display_url": "pic.twitter.com/OW1P7uf95F",
        "expanded_url": "https://twitter.com/RitchieVink/status/2012148362670149716/photo/1",
        "ext_media_availability": {
          "status": "Available"
        },
        "features": {
          "large": {},
          "orig": {}
        },
        "id_str": "2012148312598859776",
        "indices": [
          304,
          327
        ],
        "media_key": "3_2012148312598859776",
        "media_results": {
          "id": "QXBpTWVkaWFSZXN1bHRzOgwAAQoAARvsljq/21AACgACG+yWRmhWkFQAAA==",
          "result": {
            "__typename": "ApiMedia",
            "id": "QXBpTWVkaWE6DAABCgABG+yWOr/bUAAKAAIb7JZGaFaQVAAA",
            "media_key": "3_2012148312598859776"
          }
        },
        "media_url_https": "https://pbs.twimg.com/media/G-yWOr_bUAAcPUx.png",
        "original_info": {
          "focus_rects": [
            {
              "h": 389,
              "w": 695,
              "x": 0,
              "y": 0
            },
            {
              "h": 389,
              "w": 389,
              "x": 92,
              "y": 0
            },
            {
              "h": 389,
              "w": 341,
              "x": 116,
              "y": 0
            },
            {
              "h": 389,
              "w": 195,
              "x": 189,
              "y": 0
            },
            {
              "h": 389,
              "w": 882,
              "x": 0,
              "y": 0
            }
          ],
          "height": 389,
          "width": 882
        },
        "sizes": {
          "large": {
            "h": 389,
            "w": 882
          }
        },
        "type": "photo",
        "url": "https://t.co/OW1P7uf95F"
      }
    ]
  },
  "card": null,
  "place": {},
  "entities": {
    "urls": [
      {
        "display_url": "github.com/danielbeach/du…",
        "expanded_url": "https://github.com/danielbeach/duckdbAndDaftEat1TB/pull/1",
        "indices": [
          976,
          999
        ],
        "url": "https://t.co/62oLSctcSd"
      }
    ]
  },
  "quoted_tweet": null,
  "retweeted_tweet": null,
  "isLimitedReply": false,
  "article": null
}