🐦 Twitter Post Details

Viewing enriched Twitter post

@jerryjliu0

Introducing SemTools - add blazing-fast semantic search to your entire filesystem without a vector database ⚡️ Coding agents like Claude Code/Cursor have full access to the CLI like grep, cat, and pipe operations for search. But they lack ‘proper` semantic search that’s actually fast. SemTools adds in two additional CLI commands: 1️⃣ `parse` for document parsing 2️⃣ `search` to dynamically chunk/embed/search in-mem based on any set of files using static embeddings (400x faster than dense). You can chain these commands with existing operations like grep + pipes. Importantly, you also don’t need to maintain a vector db or dense heavyweight embedding models - these are overkill, slower, and probably lower accuracy vs. just a CLI agent which has access to other CLI operations too. (See Claude code screenshot below with semtools in action - see `parse` and `search` commands used) This means you can easily give 1k+ PDFs/other docs within your filesystem to your favorite coding agent/general agent, and have it efficiently crunch through any context to pull in just what the agent needs. Huge shoutout to @LoganMarkewich. Check it out: https://t.co/xg1iqbghIr

Media 1
Media 2

📊 Media Metadata

{
  "media": [
    {
      "url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/1961488443663597857/media_0.jpg?",
      "media_url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/1961488443663597857/media_0.jpg?",
      "type": "photo",
      "filename": "media_0.jpg"
    },
    {
      "url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/1961488443663597857/media_1.jpg?",
      "media_url": "https://crmoxkoizveukayfjuyo.supabase.co/storage/v1/object/public/media/posts/1961488443663597857/media_1.jpg?",
      "type": "photo",
      "filename": "media_1.jpg"
    }
  ],
  "processed_at": "2025-09-01T19:51:51.217721",
  "pipeline_version": "2.0"
}

🔧 Raw API Response

{
  "type": "tweet",
  "id": "1961488443663597857",
  "url": "https://x.com/jerryjliu0/status/1961488443663597857",
  "twitterUrl": "https://twitter.com/jerryjliu0/status/1961488443663597857",
  "text": "Introducing SemTools - add blazing-fast semantic search to your entire filesystem without a vector database ⚡️\n\nCoding agents like Claude Code/Cursor have full access to the CLI like grep, cat, and pipe operations for search. But they lack ‘proper` semantic search that’s actually fast. SemTools adds in two additional CLI commands:\n1️⃣ `parse` for document parsing\n2️⃣ `search` to dynamically chunk/embed/search in-mem based on any set of files using static embeddings (400x faster than dense).\n\nYou can chain these commands with existing operations like grep + pipes. Importantly, you also don’t need to maintain a vector db or dense heavyweight embedding models - these are overkill, slower, and probably lower accuracy vs. just a CLI agent which has access to other CLI operations too.\n\n(See Claude code screenshot below with semtools in action - see `parse` and `search` commands used)\n\nThis means you can easily give 1k+ PDFs/other docs within your filesystem to your favorite coding agent/general agent, and have it efficiently crunch through any context to pull in just what the agent needs.\n\nHuge shoutout to @LoganMarkewich. Check it out: https://t.co/xg1iqbghIr",
  "source": "Twitter for iPhone",
  "retweetCount": 64,
  "replyCount": 10,
  "likeCount": 437,
  "quoteCount": 6,
  "viewCount": 47133,
  "createdAt": "Fri Aug 29 17:57:42 +0000 2025",
  "lang": "en",
  "bookmarkCount": 543,
  "isReply": false,
  "inReplyToId": null,
  "conversationId": "1961488443663597857",
  "displayTextRange": [
    0,
    281
  ],
  "inReplyToUserId": null,
  "inReplyToUsername": null,
  "author": {
    "type": "user",
    "userName": "jerryjliu0",
    "url": "https://x.com/jerryjliu0",
    "twitterUrl": "https://twitter.com/jerryjliu0",
    "id": "369777416",
    "name": "Jerry Liu",
    "isVerified": false,
    "isBlueVerified": true,
    "verifiedType": null,
    "profilePicture": "https://pbs.twimg.com/profile_images/1283610285031460864/1Q4zYhtb_normal.jpg",
    "coverPicture": "",
    "description": "",
    "location": "",
    "followers": 64763,
    "following": 1379,
    "status": "",
    "canDm": true,
    "canMediaTag": true,
    "createdAt": "Wed Sep 07 22:54:31 +0000 2011",
    "entities": {
      "description": {
        "urls": []
      },
      "url": {}
    },
    "fastFollowersCount": 0,
    "favouritesCount": 7824,
    "hasCustomTimelines": true,
    "isTranslator": false,
    "mediaCount": 1270,
    "statusesCount": 6109,
    "withheldInCountries": [],
    "affiliatesHighlightedLabel": {},
    "possiblySensitive": false,
    "pinnedTweetIds": [],
    "profile_bio": {
      "description": "co-founder/CEO @llama_index\n\nCareers: https://t.co/EUnMNmbCtx\nEnterprise: https://t.co/Ht5jwxSrQB",
      "entities": {
        "description": {
          "urls": [
            {
              "display_url": "llamaindex.ai/careers",
              "expanded_url": "https://www.llamaindex.ai/careers",
              "indices": [
                38,
                61
              ],
              "url": "https://t.co/EUnMNmbCtx"
            },
            {
              "display_url": "llamaindex.ai/contact",
              "expanded_url": "https://www.llamaindex.ai/contact",
              "indices": [
                74,
                97
              ],
              "url": "https://t.co/Ht5jwxSrQB"
            }
          ],
          "user_mentions": [
            {
              "id_str": "0",
              "indices": [
                15,
                27
              ],
              "name": "",
              "screen_name": "llama_index"
            }
          ]
        },
        "url": {
          "urls": [
            {
              "display_url": "llamaindex.ai",
              "expanded_url": "https://www.llamaindex.ai/",
              "indices": [
                0,
                23
              ],
              "url": "https://t.co/YiIfjVlzb6"
            }
          ]
        }
      }
    },
    "isAutomated": false,
    "automatedBy": null
  },
  "extendedEntities": {
    "media": [
      {
        "display_url": "pic.twitter.com/e8cxufFr3R",
        "expanded_url": "https://twitter.com/jerryjliu0/status/1961488443663597857/photo/1",
        "ext_media_availability": {
          "status": "Available"
        },
        "features": {
          "large": {},
          "orig": {}
        },
        "id_str": "1961488409903677440",
        "indices": [
          282,
          305
        ],
        "media_key": "3_1961488409903677440",
        "media_results": {
          "id": "QXBpTWVkaWFSZXN1bHRzOgwAAQoAARs4m1D/WsAACgACGzibWNuaQSEAAA==",
          "result": {
            "__typename": "ApiMedia",
            "id": "QXBpTWVkaWE6DAABCgABGzibUP9awAAKAAIbOJtY25pBIQAA",
            "media_key": "3_1961488409903677440"
          }
        },
        "media_url_https": "https://pbs.twimg.com/media/GzibUP9awAAzCkH.jpg",
        "original_info": {
          "focus_rects": [
            {
              "h": 550,
              "w": 983,
              "x": 0,
              "y": 0
            },
            {
              "h": 983,
              "w": 983,
              "x": 0,
              "y": 0
            },
            {
              "h": 1022,
              "w": 896,
              "x": 0,
              "y": 0
            },
            {
              "h": 1022,
              "w": 511,
              "x": 179,
              "y": 0
            },
            {
              "h": 1022,
              "w": 983,
              "x": 0,
              "y": 0
            }
          ],
          "height": 1022,
          "width": 983
        },
        "sizes": {
          "large": {
            "h": 1022,
            "w": 983
          }
        },
        "type": "photo",
        "url": "https://t.co/e8cxufFr3R"
      }
    ]
  },
  "card": null,
  "place": {},
  "entities": {
    "urls": [
      {
        "display_url": "github.com/run-llama/semt…",
        "expanded_url": "https://github.com/run-llama/semtools",
        "indices": [
          1149,
          1172
        ],
        "url": "https://t.co/xg1iqbghIr"
      }
    ],
    "user_mentions": [
      {
        "id_str": "1676011773810360320",
        "indices": [
          1118,
          1133
        ],
        "name": "Logan Markewich",
        "screen_name": "LoganMarkewich"
      }
    ]
  },
  "quoted_tweet": {
    "type": "tweet",
    "id": "1961448960184520945",
    "url": "https://x.com/LoganMarkewich/status/1961448960184520945",
    "twitterUrl": "https://twitter.com/LoganMarkewich/status/1961448960184520945",
    "text": "Now you can grep a PDF (and any document)\n\nIntroducing SemTools - simple parsing and semantic search for the command line\n\nhttps://t.co/Zih7K4skqm",
    "source": "Twitter for iPhone",
    "retweetCount": 22,
    "replyCount": 5,
    "likeCount": 126,
    "quoteCount": 3,
    "viewCount": 52721,
    "createdAt": "Fri Aug 29 15:20:48 +0000 2025",
    "lang": "en",
    "bookmarkCount": 105,
    "isReply": false,
    "inReplyToId": null,
    "conversationId": "1961448960184520945",
    "displayTextRange": [
      0,
      146
    ],
    "inReplyToUserId": null,
    "inReplyToUsername": null,
    "author": {
      "type": "user",
      "userName": "LoganMarkewich",
      "url": "https://x.com/LoganMarkewich",
      "twitterUrl": "https://twitter.com/LoganMarkewich",
      "id": "1676011773810360320",
      "name": "Logan Markewich",
      "isVerified": false,
      "isBlueVerified": false,
      "verifiedType": null,
      "profilePicture": "https://pbs.twimg.com/profile_images/1676014745646661633/1iFlvih-_normal.jpg",
      "coverPicture": "",
      "description": "",
      "location": "Saskatoon SK, Canada",
      "followers": 1161,
      "following": 47,
      "status": "",
      "canDm": false,
      "canMediaTag": true,
      "createdAt": "Mon Jul 03 23:35:51 +0000 2023",
      "entities": {
        "description": {
          "urls": []
        },
        "url": {}
      },
      "fastFollowersCount": 0,
      "favouritesCount": 918,
      "hasCustomTimelines": true,
      "isTranslator": false,
      "mediaCount": 9,
      "statusesCount": 273,
      "withheldInCountries": [],
      "affiliatesHighlightedLabel": {},
      "possiblySensitive": false,
      "pinnedTweetIds": [],
      "profile_bio": {
        "description": "Head of Open Source @llama_index",
        "entities": {
          "description": {
            "user_mentions": [
              {
                "id_str": "0",
                "indices": [
                  20,
                  32
                ],
                "name": "",
                "screen_name": "llama_index"
              }
            ]
          },
          "url": {
            "urls": [
              {
                "display_url": "linkedin.com/in/logan-marke…",
                "expanded_url": "https://www.linkedin.com/in/logan-markewich/",
                "indices": [
                  0,
                  23
                ],
                "url": "https://t.co/krS01VjLhH"
              }
            ]
          }
        }
      },
      "isAutomated": false,
      "automatedBy": null
    },
    "extendedEntities": {},
    "card": {
      "binding_values": [
        {
          "key": "photo_image_full_size_large",
          "value": {
            "image_value": {
              "height": 419,
              "url": "https://pbs.twimg.com/card_img/1961913834072907776/N3Dy4V-B?format=jpg&name=800x419",
              "width": 800
            }
          }
        },
        {
          "key": "thumbnail_image",
          "value": {
            "image_value": {
              "height": 200,
              "url": "https://pbs.twimg.com/card_img/1961913834072907776/N3Dy4V-B?format=jpg&name=400x400",
              "width": 400
            }
          }
        },
        {
          "key": "description",
          "value": {
            "string_value": "Semantic search and document parsing tools for the command line - run-llama/semtools"
          }
        },
        {
          "key": "domain",
          "value": {
            "string_value": "github.com"
          }
        },
        {
          "key": "thumbnail_image_large",
          "value": {
            "image_value": {
              "height": 300,
              "url": "https://pbs.twimg.com/card_img/1961913834072907776/N3Dy4V-B?format=jpg&name=600x600",
              "width": 600
            }
          }
        },
        {
          "key": "summary_photo_image_small",
          "value": {
            "image_value": {
              "height": 202,
              "url": "https://pbs.twimg.com/card_img/1961913834072907776/N3Dy4V-B?format=jpg&name=386x202",
              "width": 386
            }
          }
        },
        {
          "key": "thumbnail_image_original",
          "value": {
            "image_value": {
              "height": 600,
              "url": "https://pbs.twimg.com/card_img/1961913834072907776/N3Dy4V-B?format=jpg&name=orig",
              "width": 1200
            }
          }
        },
        {
          "key": "site",
          "value": {
            "scribe_key": "publisher_id",
            "user_value": {
              "id_str": "13334762"
            }
          }
        },
        {
          "key": "photo_image_full_size_small",
          "value": {
            "image_value": {
              "height": 202,
              "url": "https://pbs.twimg.com/card_img/1961913834072907776/N3Dy4V-B?format=jpg&name=386x202",
              "width": 386
            }
          }
        },
        {
          "key": "summary_photo_image_large",
          "value": {
            "image_value": {
              "height": 419,
              "url": "https://pbs.twimg.com/card_img/1961913834072907776/N3Dy4V-B?format=jpg&name=800x419",
              "width": 800
            }
          }
        },
        {
          "key": "thumbnail_image_small",
          "value": {
            "image_value": {
              "height": 72,
              "url": "https://pbs.twimg.com/card_img/1961913834072907776/N3Dy4V-B?format=jpg&name=144x144",
              "width": 144
            }
          }
        },
        {
          "key": "thumbnail_image_x_large",
          "value": {
            "image_value": {
              "height": 600,
              "url": "https://pbs.twimg.com/card_img/1961913834072907776/N3Dy4V-B?format=png&name=2048x2048_2_exp",
              "width": 1200
            }
          }
        },
        {
          "key": "photo_image_full_size_original",
          "value": {
            "image_value": {
              "height": 600,
              "url": "https://pbs.twimg.com/card_img/1961913834072907776/N3Dy4V-B?format=jpg&name=orig",
              "width": 1200
            }
          }
        },
        {
          "key": "photo_image_full_size_alt_text",
          "value": {
            "string_value": "Semantic search and document parsing tools for the command line - run-llama/semtools"
          }
        },
        {
          "key": "vanity_url",
          "value": {
            "scribe_key": "vanity_url",
            "string_value": "github.com"
          }
        },
        {
          "key": "photo_image_full_size",
          "value": {
            "image_value": {
              "height": 314,
              "url": "https://pbs.twimg.com/card_img/1961913834072907776/N3Dy4V-B?format=jpg&name=600x314",
              "width": 600
            }
          }
        },
        {
          "key": "summary_photo_image_alt_text",
          "value": {
            "string_value": "Semantic search and document parsing tools for the command line - run-llama/semtools"
          }
        },
        {
          "key": "thumbnail_image_color",
          "value": {
            "image_color_value": {
              "palette": [
                {
                  "percentage": 89.42,
                  "rgb": {
                    "blue": 255,
                    "green": 255,
                    "red": 255
                  }
                },
                {
                  "percentage": 4.66,
                  "rgb": {
                    "blue": 0,
                    "green": 0,
                    "red": 0
                  }
                },
                {
                  "percentage": 3.12,
                  "rgb": {
                    "blue": 132,
                    "green": 165,
                    "red": 221
                  }
                },
                {
                  "percentage": 2.14,
                  "rgb": {
                    "blue": 121,
                    "green": 117,
                    "red": 112
                  }
                },
                {
                  "percentage": 0.4,
                  "rgb": {
                    "blue": 244,
                    "green": 210,
                    "red": 88
                  }
                }
              ]
            }
          }
        },
        {
          "key": "title",
          "value": {
            "string_value": "GitHub - run-llama/semtools: Semantic search and document parsing tools for the command line"
          }
        },
        {
          "key": "summary_photo_image_color",
          "value": {
            "image_color_value": {
              "palette": [
                {
                  "percentage": 89.42,
                  "rgb": {
                    "blue": 255,
                    "green": 255,
                    "red": 255
                  }
                },
                {
                  "percentage": 4.66,
                  "rgb": {
                    "blue": 0,
                    "green": 0,
                    "red": 0
                  }
                },
                {
                  "percentage": 3.12,
                  "rgb": {
                    "blue": 132,
                    "green": 165,
                    "red": 221
                  }
                },
                {
                  "percentage": 2.14,
                  "rgb": {
                    "blue": 121,
                    "green": 117,
                    "red": 112
                  }
                },
                {
                  "percentage": 0.4,
                  "rgb": {
                    "blue": 244,
                    "green": 210,
                    "red": 88
                  }
                }
              ]
            }
          }
        },
        {
          "key": "summary_photo_image_x_large",
          "value": {
            "image_value": {
              "height": 600,
              "url": "https://pbs.twimg.com/card_img/1961913834072907776/N3Dy4V-B?format=png&name=2048x2048_2_exp",
              "width": 1200
            }
          }
        },
        {
          "key": "summary_photo_image",
          "value": {
            "image_value": {
              "height": 314,
              "url": "https://pbs.twimg.com/card_img/1961913834072907776/N3Dy4V-B?format=jpg&name=600x314",
              "width": 600
            }
          }
        },
        {
          "key": "photo_image_full_size_color",
          "value": {
            "image_color_value": {
              "palette": [
                {
                  "percentage": 89.42,
                  "rgb": {
                    "blue": 255,
                    "green": 255,
                    "red": 255
                  }
                },
                {
                  "percentage": 4.66,
                  "rgb": {
                    "blue": 0,
                    "green": 0,
                    "red": 0
                  }
                },
                {
                  "percentage": 3.12,
                  "rgb": {
                    "blue": 132,
                    "green": 165,
                    "red": 221
                  }
                },
                {
                  "percentage": 2.14,
                  "rgb": {
                    "blue": 121,
                    "green": 117,
                    "red": 112
                  }
                },
                {
                  "percentage": 0.4,
                  "rgb": {
                    "blue": 244,
                    "green": 210,
                    "red": 88
                  }
                }
              ]
            }
          }
        },
        {
          "key": "photo_image_full_size_x_large",
          "value": {
            "image_value": {
              "height": 600,
              "url": "https://pbs.twimg.com/card_img/1961913834072907776/N3Dy4V-B?format=png&name=2048x2048_2_exp",
              "width": 1200
            }
          }
        },
        {
          "key": "card_url",
          "value": {
            "scribe_key": "card_url",
            "string_value": "https://t.co/Zih7K4skqm"
          }
        },
        {
          "key": "summary_photo_image_original",
          "value": {
            "image_value": {
              "height": 600,
              "url": "https://pbs.twimg.com/card_img/1961913834072907776/N3Dy4V-B?format=jpg&name=orig",
              "width": 1200
            }
          }
        }
      ],
      "card_platform": {
        "platform": {
          "audience": {
            "name": "production"
          },
          "device": {
            "name": "iPhone",
            "version": "13"
          }
        }
      },
      "name": "summary_large_image",
      "url": "https://t.co/Zih7K4skqm",
      "user_refs_results": [
        {
          "rest_id": "13334762",
          "result": {
            "__typename": "User",
            "action_counts": {
              "favorites_count": 8197
            },
            "avatar": {
              "image_url": "https://pbs.twimg.com/profile_images/1633247750010830848/8zfRrYjA_normal.png"
            },
            "banner": {
              "image_url": "https://pbs.twimg.com/profile_banners/13334762/1747774520"
            },
            "core": {
              "created_at": "Mon Feb 11 04:41:50 +0000 2008",
              "name": "GitHub",
              "screen_name": "github"
            },
            "dm_permissions": {
              "can_dm": false
            },
            "exclusive_tweet_following": false,
            "identity_profile_labels_highlighted_label": {},
            "location": {
              "location": "San Francisco, CA"
            },
            "media_permissions": {
              "can_media_tag": true
            },
            "notifications_settings": {},
            "pinned_items": {},
            "privacy": {},
            "private_super_following": false,
            "profile_bio": {
              "description": "The AI-powered developer platform to build, scale, and deliver secure software.",
              "entities": {
                "description": {},
                "url": {
                  "urls": [
                    {
                      "display_url": "github.com",
                      "expanded_url": "http://github.com",
                      "indices": [
                        0,
                        23
                      ],
                      "url": "https://t.co/bbJgfyzcJR"
                    }
                  ]
                }
              }
            },
            "profile_image_shape": "Square",
            "profile_metadata": {
              "profile_interstitial_type": "",
              "profile_link_color": "981CEB"
            },
            "profile_translation": {
              "translator_type_enum": "None"
            },
            "properties": {
              "has_extended_profile": true
            },
            "relationship_counts": {
              "followers": 2642674,
              "following": 327
            },
            "relationship_perspectives": {},
            "rest_id": "13334762",
            "super_follow_eligible": false,
            "super_followed_by": false,
            "super_following": false,
            "tweet_counts": {
              "media_tweets": 2733,
              "tweets": 9889
            },
            "website": {
              "url": "https://t.co/bbJgfyzcJR"
            },
            "verification": {
              "is_blue_verified": true,
              "verified_type": "Business"
            }
          }
        }
      ]
    },
    "place": {},
    "entities": {
      "urls": [
        {
          "display_url": "github.com/run-llama/semt…",
          "expanded_url": "https://github.com/run-llama/semtools",
          "indices": [
            123,
            146
          ],
          "url": "https://t.co/Zih7K4skqm"
        }
      ]
    },
    "quoted_tweet": null,
    "retweeted_tweet": null,
    "isLimitedReply": false,
    "article": null
  },
  "retweeted_tweet": null,
  "isLimitedReply": false,
  "article": null
}