@mishig25
At @huggingface, how we created doc chatbot system using open weights LLMs & open source software stack: 1. chunk & embed docs markdowns using open weights embedding models (BAAI/bge-base-en-v1.5, google/embeddinggemma-300m, we usually use https://t.co/zWv8ZjEiMd to find the hottest models), use @meilisearch (https://t.co/kU8wkaIuyV) as our semantic search db 2. https://t.co/0GeysYbFab that acts as gateway to semantically search hf docs (among other things). https://t.co/DFnlv8W55z by @evalstate 3. add https://t.co/0GeysYbFab to https://t.co/WXiwAO0VCK, which uses latest open weights LLMs such as zai-org/GLM-4.6 (https://t.co/74frBh1wpa) through HF Inference Providers (https://t.co/6j1SC6JyeU) that runs your inference through @FireworksAI_HQ, @togethercompute, @GroqInc, @novita_labs