Google kicks out legit paying Antigravity customers for high usage [to solve their problem of not enough capacity]; does not tell them; does not offer refunds or any way to refund the service. This comic by @lmanul is so spot on with regards to Google (and Amazon!) https://t.co/x0LToYbOHX

Google kicks out legit paying Antigravity customers for high usage [to solve their problem of not enough capacity]; does not tell them; does not offer refunds or any way to refund the service. This comic by @lmanul is so spot on with regards to Google (and Amazon!) https://t.co/x0LToYbOHX

I've been working on a new LLM inference algorithm. It's called Speculative Speculative Decoding (SSD) and it's up to 2x faster than the strongest inference engines in the world. Collab w/ @tri_dao @avnermay. Details in thread.

I've been working on a new LLM inference algorithm. It's called Speculative Speculative Decoding (SSD) and it's up to 2x faster than the strongest inference engines in the world. Collab w/ @tri_dao @avnermay. Details in thread.

🚀 New paper: Mamba–Transformer hybrid VLMs can go fast without forgetting. We introduce stateful token reduction for long-video VLMs. ✅ Only 25% of visual tokens 🚀 3.8–4.2× faster prefilling (TTFT) 🎯 Near-baseline accuracy (can exceed baseline with light finetuning) https://t.co/CJaCktyWCt

Asymmetric hardware scaling is here. Blackwell tensor cores are now so fast, exp2 and shared memory are the wall. FlashAttention-4 changes the algorithm & pipeline so that softmax & SMEM bandwidth no longer dictate speed. Attn reaches ~1600 TFLOPs, pretty much at matmul speed! joint work w/ Markus Hoehnerbach, Jay Shah(@ultraproduct), Timmy Liu, Vijay Thakkar (@__tensorcore__ ), Tri Dao (@tri_dao) 1/

Claude / Codex also have an easier time writing some components of FA4 thanks to the fast compile time. I got Claude to debug a deadlock when we first implemented 2CTA fwd. It ran autonomously overnight for 6 hours, figured out part of the fix, but then went down a rabbit hole convincing itself that the compiler is broken (so very human 😂). After 6 hours, from Claude’s partial fix, I was able to fix the hang in 10 mins. More details here: https://t.co/ipGhC9FzET I’m hoping FA5 will be written completely by AI

FA4 now available in lm-engine: https://t.co/n47TEinAfG 13.4% end-to-end speedup for Llama 8B training on 4x GB200s (1 node) 🚀🚀🚀 1005.55 TFLOPs for SDPA vs 1140.73 for FA4 (BF16 precision) @tedzadouri @ultraproduct @__tensorcore__ @tri_dao cooked Thanks to @bharatrunwal2 for running the experiment!

FA4 now available in lm-engine: https://t.co/n47TEinAfG 13.4% end-to-end speedup for Llama 8B training on 4x GB200s (1 node) 🚀🚀🚀 1005.55 TFLOPs for SDPA vs 1140.73 for FA4 (BF16 precision) @tedzadouri @ultraproduct @__tensorcore__ @tri_dao cooked Thanks to @bharatrunwal2 for running the experiment!

the FA4 integration into @huggingface Transformers is here https://t.co/48XPxmKbMv you will need to apply my proposed changes at the end for it to work if the owner hasn't done it already by the time you try it out

the FA4 integration into @huggingface Transformers is here https://t.co/48XPxmKbMv you will need to apply my proposed changes at the end for it to work if the owner hasn't done it already by the time you try it out

the FA4 integration into @huggingface Transformers is here https://t.co/48XPxmKbMv you will need to apply my proposed changes at the end for it to work if the owner hasn't done it already by the time you try it out

Together Research has produced FlashAttention, ATLAS, ThunderKittens and more. This week at AI Native Conf: seven more releases, all coming to production soon. Thread → #ainativeconf #ainativecloud https://t.co/XXIXMRRiLe

Together Research has produced FlashAttention, ATLAS, ThunderKittens and more. This week at AI Native Conf: seven more releases, all coming to production soon. Thread → #ainativeconf #ainativecloud https://t.co/XXIXMRRiLe

@FPLGOAT7 I got lucky, sold Dango, sold Haaland. Tarkowski did it for me. https://t.co/BUmAWBP0W7

@yehiael22 @FPL_Harry Same here https://t.co/2gZdylxMf1

@yehiael22 @FPL_Harry Same here https://t.co/2gZdylxMf1

Introducing the Google Workspace CLI: https://t.co/8yWtbxiVPp - built for humans and agents. Google Drive, Gmail, Calendar, and every Workspace API. 40+ agent skills included.

⚠️ WARNING: THIS PRODUCT MAY CONTAIN SHELLFISH 🦞 https://t.co/zJ6n2auo6B

Do you want to demo your project at the Meta booth during GTC? 😎 Join @Meta and @nvidia, in partnership with CV, for a full-day hackathon at @SHACK15sf, writing high-performance GPU kernels with Helion, PyTorch's new kernel authoring DSL that delivers higher performance in fewer lines of code with autotuning. 📅 March 14th — Right before NVIDIA GTC. The perfect warm-up. 🏆 Prizes & perks: > Nvidia GPUs and Nvidia DGX Spark > Demo your project at the Meta booth during GTC > GTC conference passes > Ray-Ban Meta glasses > Mentoring from Meta AI researchers & NVIDIA engineers 📍 Fully in-person | Teams of up to 4 | Rolling review, limited spots Register below 👇

How can we securelty contain #AI?. In this live discussion, experts will explore why traditional container isolation falls short for agent-based systems & what changes when agents have persistent memory, filesystem access, GPUs, or external execution authority https://t.co/qi4Mw97DPo

Sakana AIで、最先端AIの「社会実装」を加速させませんか？🚀 基礎研究とプロダクトの架け橋となる Applied Research Engineer を絶賛募集中です！世界トップクラスの技術に触れながら、次世代のソリューションを自らの手で創り上げる熱いポジションです🐟💨 ▼詳細はこちら https://t.co/eQ7e0rIOmg https://t.co/7Mx8h3JScP

Sakana AIで一緒に働くApplied Research Engineerを絶賛募集中です！🐟💨 https://t.co/FuEoI2xrzS

Sakana AIの「社会実装」をより加速させるため、新たにRecruiterを募集します！🐟 https://t.co/qiY3upbBAV 新規プロダクト開発が進む中、未踏のソリューションを創るEngineerやPMを積極採用中です。ダイレクトソーシングを軸に候補者と直接向き合い、コアチームを組成していただく重要な役割です。 テクノロジー業界での採用経験を活かし、私たちの成長エンジンの中心を担ってくださる方をお待ちしています！🚀

⏰ Clock’s ticking! Registration for #PyTorchCon Europe goes up €100 after 20 March. Also less than a week left to RSVP for onsite child care 👶 7–8 April | Paris 🎟 Register: https://t.co/53JVfAmOap 👶 Child care info: https://t.co/OnRpL1AQKa https://t.co/okpcmT7qu3

+1 more

Applied Research Engineer 🐟 https://t.co/FuEoI2xrzS

We are pleased to announce a strategic investment from Citi! https://t.co/SQp1HEGzEp This milestone marks Citi’s first such investment in a Japanese company. The investment reflects their high regard for our advanced technical capabilities and our proven track record of implementing AI within the financial sector. We are focused on developing new enterprise-grade AI solutions using nature-inspired intelligence. Our goal has consistently been to bridge the gap between cutting-edge research and practical business applications. Building on our work developing highly specialized AI agents for financial domains, we are ready to take the next step. Through this partnership, we aim to accelerate our international expansion and drive innovation in global financial services, originating from Japan.

Recover more than 70% accuracy degradation from 4-bit quantization using TorchAO’s (https://t.co/Jr0qtnIAgZ) Quantization-Aware Training (QAT), now available through fine-tuning in Unsloth and Axolotl! Following the previous TorchAO QAT blog(https://t.co/kXAGBfOSMZ), the PyTorch team at @Meta extended the TorchAO QAT flow to support an end-to-end GPU server flow, targeting fast CUDA kernels for fast inference in @vllm_project, and integrated this flow into popular fine-tuning frameworks like Unsloth and Axolotl. Read our latest blog: https://t.co/nFx4MYHoRj #PyTorch #vLLM #OpenSourceAI #TorchAO

Got #CloudNative, #OpenInfra, or #PyTorch insights to share? 🎤 Take the stage at #KubeCon + #CloudNativeCon + #OpenInfraSummit + #PyTorchCon China. Topics span #AI, infrastructure, #Kubernetes, #ML systems, #OpenSource leadership & more. 🗓 Submit your proposal by 3 May. 👉 https://t.co/qri77SxbE3

💡 Share ideas. Build models. Meet the community. #PyTorchCon Europe 7–8 April | Paris 💰 Rates increase €100 after 20 March. 🎟 https://t.co/jod4fkDoG2 🎓 Less than a week left to apply for a scholarship: https://t.co/7t0H4Xmukz https://t.co/cwazYvBo4G

+1 more

We are excited to announce a strategic partnership with @datadoghq! 🤝 Datadog values our research capabilities focused on efficient, scalable, and adaptive AI models, and our expertise in applying them to complex industrial challenges. Together, we will work on joint research initiatives, potential open-source contributions, and new go-to-market efforts. Through this collaboration, we will accelerate our engagement with large enterprises to explore new approaches to building, deploying, and operating advanced AI systems at scale.

PyTorch at the micro-edge? Yes. See how ExecuTorch brings PyTorch models to Arm microcontrollers—quantized, compiled, and running on a Corstone-320 + Ethos-U NPU (via FVP). 🔗 https://t.co/plbiWAAu85 From training to deployment, end to end. #PyTorch #ExecuTorch #EdgeAI #TinyML #Arm