Your curated collection of saved posts and media

Showing 32 posts · last 14 days · by score
A
Abu
@abuchanlife
📅
Aug 20, 2026
12d ago
🆔29722118
⭐0.40

AI did not suddenly discover a cancer vaccine. That is engagement bait. Moderna and Merck reported positive Phase 3 results for Intismeran plus Keytruda in 1,137 melanoma patients after surgery. This is a real and important scientific result. But the vaccine entered human trials in 2017, and Moderna was already using internal bioinformatics algorithms to select each patient’s tumor targets. AI helps analyze mutations and choose up to 34 neoantigens for the personalized treatment. It did not independently invent the vaccine or cure cancer. The full Phase 3 numbers have not been released. Overall survival is still unknown. The treatment is not approved, not a universal cancer vaccine and was tested with Keytruda, not alone. BioNTech, Roche, NEC, Transgene and Evaxion have used similar computational or machine learning approaches for years. This is a breakthrough in genomics, immunology, mRNA, manufacturing and clinical science. Rebranding all of that as “AI discovered a cancer vaccine today” is pure AI hype.

@nikitabier • Wed Aug 19 23:13

With cancer vaccines now being discovered with AI ($MRNA), it seems that the US government might actually grow its way out of its budget deficit. It feels like we're in the early innings of the healthcare system becoming unburdened by many terminal illnesses.

❀508
likes
🔁89
retweets
M
Mia
@MiaAI_lab
📅
Aug 27, 2026
4d ago
🆔30279370
⭐0.32

Wow this is huge!!! 😯 Hermes agent can now browse as you, with your existing logins and cookies. I see so many use cases!

@NousResearch • Thu Aug 27 19:49

Hermes Agent can now seamlessly browse as you. Turn on real-profile browsing and your agent acts with your logins, from a managed copy of your existing Chrome profile. https://t.co/20IKsY6LZK

❀389
likes
🔁15
retweets
M
mr-r0b0t
@mr_r0b0t
📅
Aug 18, 2026
14d ago
🆔96635736

Tip for your @NousResearch Hermes Agent Bots: Create an "Orchestrator" Bot and then have it design its own team to optimally fulfill any/all user requests. Here's El Jefe (my orchestrator) completing a very solid roster including comprehensive soul.md entries for each Bot! https://t.co/4VKL5UxG25

@mr_r0b0t • Tue Aug 18 15:47

El Jefe and Fixer working together to assemble the optimal Hermes Bot team is 10/10 entertainment 🀩 https://t.co/5VMTjklvT8

Media 1
❀384
likes
🔁25
retweets
🖌 Media
A
Andy Konwinski
@andykonwinski
📅
Aug 24, 2026
7d ago
🆔38496195

Introducing Headlong, an open source microharness for persistent agents: self-guided agents that think continuously. Most agent harnesses are reactive: you send a task, the agent completes it, and then it sits frozen until the next request. Cron jobs and heartbeats wake it up to run a checklist and put it back to sleep. A Headlong agent is never asleep. It keeps generating thoughts about whatever it decides is interesting, in a self-guided loop inspired by human inner monologue. Your message doesn't start a session. It's one more observation that lands in the agent's thought stream, and the agent decides if and when to reply. Headlong is built on the idea of persistent agency: continuous inner thought generation between external interactions. The agent sets its own interests and priorities, comes up with its own projects, and sometimes pings you unprompted with progress. To keep our prototype as simple and small as possible, we implemented Headlong as a microharness: a complete agent harness in under 10K lines of Bash, organized as a handful of small executables. It includes a loop that generates the next thought, shellm (a recursive language model written in Bash), a trajectory stored as a DAG of jsonl files, and context as a projection of that trajectory. We've been running one Headlong agent internally at Laude for several weeks. The whole team talks to it over Slack and Telegram, and every conversation lands in its single stream of thought. It works in its own fork of Headlong and we've pulled over 50 of its commits into main. One night, with nobody talking to it, it went back to check whether a recall process it had built was actually wired into its mind, found that it wasn't, diagnosed and fixed the bug, and verified the fix end to end. 48 minutes, no human asked for the fix or was in the loop at any point. Every step is a timestamped line in its log. Things broke too, and we wrote those up. Background thinking costs us $1 to $2 an hour, our agent stopped its own service three times by accident, and self-delegation died on day one. Details in the post. One line installs everything and starts an agent. Use a dedicated sandbox and spend-capped API key; it runs real shell commands and thinks around the clock. Headlong is research software, be careful! curl -fsSL https://t.co/P2Q5Ch8C4e | bash Launch post: https://t.co/HhWULUTkpH Repo: https://t.co/U4JunpSTYt Headlong is a @LaudeInstitute / MIT collaboration.

Media 2
+1 more
❀294
likes
🔁35
retweets
🖌 Media
🔁GitHub retweeted
V
Vercel
@vercel
📅
Aug 25, 2026
7d ago
🆔88568985
⭐0.34

Vercel Connect is now generally available. Give your apps and agents secure access to @slackhq, @linear, @github & 100+ other services. • Short-lived, scoped access tokens • Token and trigger observability • RBAC and audit trails https://t.co/3JUlBz3ddo

❀290
likes
🔁23
retweets
S
shubham
@ShubhamInTech
📅
Aug 20, 2026
12d ago
🆔22170022

Stop using your agent logs just for debugging. Use them to train your own model. Today we're launching Agnost AI (YC S26)'s first model: agnost-*******-0.1 Trained for our first customer on their existing production traces & it beat the frontier: +22.9% task success −90.2% latency −94.5% cost If you ever thought of fine-tuning your own model, we'll do it for you, talk to us!

❀269
likes
🔁59
retweets
🖌 Media
H
HealthRanger
@HealthRanger
📅
Aug 31, 2026
1d ago
🆔23564603
⭐0.36

Damn. Hermes Agent + local Qwen3.8-27B is a beast. So far it hasn't failed a single coding task I've given it, and I keep upping the complexity to see if I can make it fail. So far, it has been near-perfect. As good as Opus.

❀269
likes
🔁10
retweets
A
Andrew Ng
@AndrewYNg
📅
Aug 25, 2026
7d ago
🆔76555806

OpenWorker -- an open source agent that doesn't just chat but completes tasks on your laptop -- just released a new version with many features for security workflows. After our initial release, many users found it especially useful for cybersecurity. Attackers are already using AI; OpenWorker is committed to giving defenders the same leverage. Running an agent requires both (i) A model and (ii) A harness (the software around the model). Because the OpenWorker harness is fully open source, security teams can audit it to make sure we haven't built any backdoors that exfiltrate your code and data to some company or even a foreign adversary. OpenWorker now comes with built-in cybersecurity agents for (i) Scanning your code for vulnerabilities. (ii) Scanning dependencies for supply chain injections. (iii) Checking your cloud security configuration for attack surfaces. This enables developers to do much more security work before deployment (part of what's called the "shift left" movement). You choose the model: you can run open weight models fully locally so sensitive code never leaves your machine. This helps with legitimate security work (like reproducing a known exploit to defend against it) that can trigger refusals in leading closed models. Or use your ChatGPT subscription, or stealth preview models like Ox Alpha, or any model via API key. Thanks also to all the open source contributors! Join work with @rohitcprasad so please follow him too to get more frequent updates. Try it out: https://t.co/QPZLudn7ug Code: https://t.co/NYCiTD6hSq

Media 1
❀250
likes
🔁35
retweets
🖌 Media
R
Randall Balestriero
@randall_balestr
📅
Aug 28, 2026
4d ago
🆔29652671

SIGReg for pretraining Video Foundation Models! Our LeVJEPA opens many doors... - stable recipe with a simple loss (sigreg + prediction) - no tubelet, frame aggregation, EMA, stop-gradient, .... - 20X more FLOP efficient than VJEPA1/2 pretraining - open source + reproducible https://t.co/rCwJRx2Dim

@lukaskuhn77 • Fri Aug 28 12:42

A new Pareto frontier in video pretraining. Excited to introduce LeVJEPA 🔥: a stable, efficient end-to-end pretraining method that matches V-JEPA 2 at up to 20x less pretraining compute! No target encoder, no masked prediction, no stop-gradient or teacher-student schedule. On

Media 1
❀217
likes
🔁28
retweets
🖌 Media
A
Artificial Analysis
@ArtificialAnlys
📅
Aug 28, 2026
3d ago
🆔68666138

Perplexity Search debuts on the Artificial Analysis Search Index, with all three context size variants taking top positions on the leaderboard The @perplexity_ai Search API comes with three context settings (low, medium, and high) that control how much extracted content each search result carries. We tested all three variants using our standardized methodology: the same model (GPT-5.6 Luna at medium reasoning), running inside Stirrup, our open-source agent harness, with tools for searching and fetching pages from the web. Only the provider behind the search tool changes. Key results: ➀ Perplexity Search (medium) scores 80 on the Artificial Analysis Search Index, ahead of the previous leaders, Parallel (advanced) and Brave Search (LLM context), at 75. The high and low variants score 79 and 77 respectively. Its lead is concentrated in BrowseComp results, with AA-Omniscience and DeepSearchQA scoring comparably to other leading providers ➀ Efficient search payloads: smaller overall search results mean the model reads less per task, so Perplexity has the lowest model inference cost per task of providers we’ve tested so far, ranging from $0.028 to $0.034 across the three variants vs $0.036 for the next lowest provider ➀ Total cost per task is ~$0.091 for the medium and high context variants, at mid-pack latency. For comparison, Parallel (advanced) costs $0.084 per task and Brave (LLM context) costs $0.13 per task

Media 1
❀204
likes
🔁16
retweets
🖌 Media
G
Gabriele Berton
@gabriberton
📅
Aug 24, 2026
7d ago
🆔02237657

What is the simplest, cleanest technique for self-supervised learning (SSL)? RotNet (2018), without a doubt Take an image, rotate by either 0, 90, 180, 270 degrees, and predict its rotation. The model must learn useful features to solve the task. Read on... [1/2] https://t.co/jlqS7kXHeH

Media 1
❀197
likes
🔁5
retweets
🖌 Media
G
GitHub
@github
📅
Aug 25, 2026
7d ago
🆔60987573
⭐0.36

💡 Learn the latest GitHub workflows by actually building with them. We’ve released 4 new GitHub Skills exercises designed to give developers practice with AI-powered development, agentic workflows, and code quality. 🧵⬇

❀193
likes
🔁12
retweets
V
Vercel Developers
@vercel_dev
📅
Aug 18, 2026
13d ago
🆔15355806

Introducing fx, a tiny, open, native coding agent from Vercel Labs. Originally an internal tool, fx is a harness and CLI written in Zig, optimized for research and embedding in larger systems. Today, we're open sourcing it. fx is built on three principles: 1. Fast. A single native binary, no runtime to install. It cold starts in 10µs and does no unnecessary work or I/O before accepting input. fx is the answer to "how fast can a coding agent be?" 2. Light. The 6.3MiB binary uses single-digit megabytes of memory at baseline, made for instant installation and embedding in resource-constrained environments and agent sandboxes. 3. Open. Apache-2.0, model and provider agnostic, suitable for local and cloud inference. Its small core extends through skills, plugins, and MCP. Minimalism is an obsession throughout the entire harness: system prompt, tools, features, binary. The goal was to keep context usage and time to first token low, and make fx optimal for model benchmarking, sandboxing, evals, and gyms. You can use fx directly or embed it as infrastructure. The CLI feels more like a Unix shell than an IDE in the terminal: it preserves scroll history, produces minimal output, and uses complex TUI rendering very, very sparingly. Programmatically, 𝚏𝚡 𝚊𝚜𝚔 --𝚓𝚜𝚘𝚗 gives structured output, 𝚏𝚡 𝚊𝚌𝚙 connects to editors and other clients, and WebAssembly can even run the whole thing inside the browser (see: https://t.co/wf2Trg47sC). Privacy is a design constraint: no product telemetry, sessions and usage stay local, and no source code or prompts are shared with any endpoint other than inference. With local inference and auto-updates off, fx is fully hermetic. fx is experimental. Use at your own risk and expect frequent changes. Chat with us on X (https://t.co/A2AB2YythC) or file issues (https://t.co/GEjTHSoa1J). 𝚌𝚞𝚛𝚕 -𝚏𝚜𝚂𝙻 𝚏𝚡.𝚜𝚑/𝚜𝚎𝚝𝚞𝚙.𝚜𝚑 | 𝚋𝚊𝚜𝚑 https://t.co/g2uEuXhGnt

Media 2
+2 more
❀177
likes
🔁19
retweets
🖌 Media
C
clem 🀗
@ClementDelangue
📅
Aug 22, 2026
9d ago
🆔15492806

NVIDIA built its own coding harness to optimize CUDA GPU kernels and achieved a 100% score on ARC-AGI-3’s 25 public games, solving all 183 levels. With agents, we'll move from a world where it's quite hard to run, optimize, post-train your own AI models and kernels to a world where virtually everybody can do it. 100 million AI builders when?

Media 1
❀163
likes
🔁35
retweets
🖌 Media
Z
Zixuan Li
@ZixuanLi_
📅
Aug 28, 2026
3d ago
🆔00487090
⭐0.32

GLM 5.3’s weights were just released, and it’s already available in Perplexity Computer.

@perplexity_ai • Fri Aug 28 18:49

GLM 5.3 is now available in Perplexity Computer. Built for long-context, multimodal agent workloads, it beat GLM 5.2 on WANDR, our benchmark for large-scale, evidence-backed research. https://t.co/02FMedtoJb

❀126
likes
🔁7
retweets
G
Google Gemma
@googlegemma
📅
Aug 28, 2026
4d ago
🆔07963769

Gemma 4 E2B running fully locally on an 8GB NVIDIA Jetson Orin Nano. Using native image/audio input and function calling, this edge setup is capable of vision, voice interaction, and camera control, all within an 8GB memory footprint! https://t.co/ILdL9vnvdG

❀119
likes
🔁8
retweets
🖌 Media
A
Artificial Analysis
@ArtificialAnlys
📅
Aug 21, 2026
11d ago
🆔31994528

Announcing our new Speech Agent Arena, evaluating Speech to Speech models on real-world scenarios to analyze conversational preference and task success rate Existing Speech to Speech benchmarks cover reasoning, simulated agentic tasks, and conversational dynamics such as turn-taking and interruption handling. The Speech Agent Arena compares models and cascaded systems as humans complete real-world tasks, measuring conversational preference and successful tool use. This allows us to provide an evaluation which closer reflects real-world use, offering insight into which models users most prefer speaking with and how effectively those models support their requests. Overview of the Speech Agent Arena and Task Success Rate Human participants compare two hidden Speech to Speech models on the same assigned scenario, one of 15 agentic scenarios (tasks requiring tool calling, such as ordering takeout) or 20 non-agentic scenarios (tasks without tool calling, such as asking about opening hours). After separate live conversations with each model, participants select which they preferred, with these pairwise votes used to fit a Preference Elo score. For agentic scenarios, Task Success Rate is the share of eligible conversations (no participant deviations or unverifiable cases) where the model completed the requested action through the correct final tool call or calls. For all but a New Patient Dental Booking example, scenario model prompts, tool schemas and participant instructions are currently private to reduce overfitting. Additionally, the Speech Agent Arena currently uses a qualified pool of paid, screened third-party participants to conduct and evaluate agent interactions. Key results: ➀ Arena Preference Elo: @GoogleAI Gemini 3.1 Flash Live Preview - Minimal leads at 1,046 Elo, followed by Gemini 3.1 Flash Live Preview - High at 1,014, @OpenAI GPT-Realtime-1.5 at 1,000, GPT Realtime (Aug '25) at 944, and @ElevenLabs Agents (default cascaded system of Scribe v2 Realtime / GPT-4o Mini / Eleven v3, with pre-registered tool schema) at 937. In reviewed conversations, highly preferred models tended to respond quickly, sound more natural and produce fewer unnatural sounds or audio artifacts ➀ Task Success Rate: @SpaceXAI Grok Voice Think Fast 2.0 High leads at 94.7%, followed by @OpenAI GPT-Realtime-2.1 High at 91.5%, @ElevenLabs Agents (Default Cascaded System) at 90.5%, and GPT-Realtime-2 (High) at 89.8%, with GPT Realtime (Aug '25) and GPT-Realtime-2.1 Minimal tied at 89.4%. Gemini 3.1 Flash Live Preview - Minimal leads overall preference at 1,046 Elo but records a 74.6% Task Success Rate, showing that a preferred conversation does not always result in successful task completion - some conversations can sound as though the requested action was completed even when the required final tool call was unsuccessful We are continuing to expand our coverage of native and cascaded Speech to Speech systems, and welcome feedback as we add more models, providers and scenarios. See more details below ⬇

Media 1
❀119
likes
🔁11
retweets
🖌 Media
X
Florian Brand
@xeophon
📅
Aug 24, 2026
8d ago
🆔81518646
⭐0.30

tired: hill climbing an eval by doing a synth env wired: hill climbing an eval by fixing the eval

❀110
likes
🔁5
retweets
K
Yilun Kuang
@KuangYilun
📅
Aug 26, 2026
6d ago
🆔96364214

Introducing LpWM: A Case for Sparse Representations in World Models Dense Gaussian representations are a choice, not a requirement. We find that sparse representations can make latent dynamics easier to model for planning. 📄https://t.co/Il2krEtFi5 💻https://t.co/D1UAVtkwQD https://t.co/T9RoK2Te07

Media 1Media 2
❀108
likes
🔁27
retweets
🖌 Media
L
Lightwheel
@LightwheelAI
📅
Aug 21, 2026
11d ago
🆔45117725
⭐0.42

The largest fully annotated open egocentric human dataset. Today we're open-sourcing EgoSuite-Open100K with @huggingface : 100,000 hours of egocentric human data, free for anyone to use. Physical AI has a scaling law of its own now, and its input is human data. That part is settled. What the field still needs is a shared foundation to build on. 15,000+ tasks. 15,000+ real scenes, from factory floors to retail backrooms. Hand pose, body pose and subtask-level semantics, with wrist camera coverage on part of the set. Licensed for commercial training, not research-only. We build the data infrastructure for Physical AI. Open100K is the first public layer of it. The first 10,000 hours are live now, with the rest rolling out in stages.

❀107
likes
🔁12
retweets
K
Andrej Karpathy
@karpathy
📅
Aug 20, 2026
12d ago
🆔95929036
⭐0.38

@ChrisJMcCormick Yeah, increasingly a lot more appealing to tear down these abstractions now that agents can do a lot of the math and drudgery and verification. A lot of the abstractions were built for a world with constraints of finite intelligence and attention in the industry.

❀101
likes
🔁7
retweets
J
Jerry Liu
@jerryjliu0
📅
Sep 01, 2026
17h ago
🆔74905676

There’s generally a massive difference in quality between specialized OCR providers, “simple” open-weight OCR models, and free/OSS solutions. 1⃣ Specialized OCR models (including LlamaParse) solve for the long-tail of complex documents, and make sure that everything is digitalized properly with lower hallucinations. They typically use posttrained VLMs to cover a wide range of real-world docs. They have tuned bounding boxes and annotations for each section, letting agents trace citations back to the source. They also usually come with additional endpoints like extraction and splitting. 2⃣ Open-weight VLMs (e.g. Paddle, MinerU, UnlimitedOCR) are reasonable over relatively simple documents like text and tables and can do basic visual reasoning. They can seem somewhat cheap to host but can be unreliable in quality. 3⃣ Free OSS libs (including liteparse) are meant to be universally accessible, fast text extractors. They’re not meant to do any sort of visual reasoning, so won’t perform any linearization, or reasoning over complex tables, or OCR over non-native docs. AI agents like Claude will by default use these tools to do a light pass over documents. But I would caution using these for retrieval, because they will drop entire sections that are not digitalized. At this point we’ve benchmarked over 92 tools on ParseBench. Come check it out! https://t.co/PWczfhp0OX

Media 1Media 2
+1 more
❀99
likes
🔁19
retweets
🖌 Media
M
Mark Kretschmann
@mark_k
📅
Aug 21, 2026
11d ago
🆔54906708

Grok Build 1.0.8 is out. @SpaceXAI keeps improving the agent workflow, with this release focused heavily on subagents, workflows, and smoother multitasking. Most important changes: • Concurrent subagents now start much faster and no longer freeze the parent session • Opening many subagents at once no longer freezes the UI while loading history • Follow-up messages are sent immediately even while a subagent/task is running • Ctrl+S now stashes your current prompt draft so you can switch tasks and restore it later • /workflow now autocompletes saved workflows and only shows valid actions • MCP servers can request form input or URL consent through the normal question popup • Workflow agent rows now show current context usage instead of cumulative token counts Also included: clearer errors for hallucinated tool calls, status-line fixes, and improved folder downloads.

Media 1
❀95
likes
🔁5
retweets
🖌 Media
🔁Yann LeCun retweeted
S
Steeve Morin
@steeve
📅
Aug 18, 2026
14d ago
🆔12501099
⭐0.36

yeah so zml runs on: 1. NVIDIA 2. AMD 3. Metal 4. Intel 5. Trainium 6. Tenstorrent 7. TPU 8. MooreThreads 9. Vulkan and a few more very soon

❀94
likes
🔁4
retweets
D
👩‍💻 Paige Bailey
@DynamicWebPaige
📅
Aug 27, 2026
5d ago
🆔39338186

gemini 3.6 flash cleared 88% of the baba is you intro levels and spent $124 doing it gemini 3.7 flash cleared 100% and spent only $5.38 and boy, is she fast! 😍⚡ @QuesmaOrg https://t.co/9OOTRyDCl3

Media 1Media 2
❀85
likes
🔁5
retweets
🖌 Media
J
jacky
@jjacky
📅
Aug 26, 2026
5d ago
🆔80199620
⭐0.40

we're hiring cracked evals/benchmarking ppl research-oriented role super tough hairy unsolved problems those that thrive in unknowns preferred pls dm me with your actual work (not resume), will fast track you

❀80
likes
🔁2
retweets
H
Daisuke Okanohara / 岡野原 倧茔
@hillbig
📅
Aug 30, 2026
2d ago
🆔67754000
⭐0.40

LeVJEPAは動画の自己教垫あり孊習を倧幅に単玔化し、埓来手法ず同等以䞊の性胜を5〜20倍少ない蚈算量で実珟する。 動画には、静止画には含たれない物䜓の動きや時間的な因果関係など、䞖界の衚珟を孊ぶための玠材ずしお有望な情報が含たれる。 䞀方で、動画の自己教垫あり孊習は画像ず比べお倚数のフレヌムを凊理するため蚈算コストが倧きいずいう問題があった。 さらに、埓来の自己教垫あり孊習では衚珟厩壊を防ぐため、EMAで曎新するtarget笊号化噚、stop-gradient、predictorなど耇数の仕組みを必芁ずしおいた。 LeVJEPAは、この二぀の問題を同時に解決する手法を提案しおいる。そしお、動画からの事前孊習そのものが、将来的には芖芚基盀モデルを孊習する暙準的な方法になりうるこずを䞻匵しおいる。 たず動画から16フレヌムのクリップを取り出し、䞀぀のglobal viewず耇数のlocal viewを䜜る。local viewには空間的なcropや色倉化などのaugmentationが加えられるが、globalずlocalの時間区間は共通である これらすべおを同じ䞀぀の笊号化噚に入力する。 笊号化噚には孊習可胜なCLSトヌクンが䞀぀だけ远加される。このCLSトヌクンは党フレヌム、党パッチトヌクンにattentionでき、クリップ党䜓の情報を集玄できる。 䞀方、各パッチトヌクンは、同じ時刻のトヌクンず、それ以前の時刻のトヌクンにしかattentionできない。たた、パッチトヌクンからCLSトヌクンぞのattentionも犁止されおいる。 そのため、各フレヌムのパッチ衚珟は未来の情報を䜿わないcausalな衚珟になる䞀方、CLS衚珟は動画党䜓を芋たnon-causalな衚珟になる。 この蚭定の䞭で、孊習目暙は、最終的なCLS衚珟を小さなprojectorに通しお朜圚衚珟 z を䜜り、global viewずlocal viewの z をMSEで近づけるこずである。 ただし、この損倱だけでは、すべおの入力に察しお同じ衚珟を出せば損倱がれロになるため、衚珟厩壊が起こりうる。そこでSIGRegを加える。 SIGRegは、バッチ党䜓のembedding分垃を等方Gaussian N(0,I)に近づける正則化である。 実際にはランダムな方向 a を倚数サンプリングし、zずの内積 a^T z を蚈算する。そしお、その䞀次元分垃が N(0,1) に埓っおいるかをEpps-Pulley統蚈量で枬り、それを損倱ずする。 なお、笊号化噚最終局にはLayerNormがあり、CLS衚珟は球面状の空間に制玄される。そのたたではGaussian分垃を芁求するSIGRegを適甚しにくいため、䞀床projectorを通しおからSIGRegを適甚しおいる。 たずめるず、孊習党䜓の損倱は、global viewずlocal viewのCLS衚珟を䞀臎させるMSEずSIGRegのみである。 埓来䜿われおいた衚珟厩壊を防ぐEMAによるtarget笊号化噚、stop-gradient、predictorは䜿甚しない。 もう䞀぀の倧きな特城は、95%のパッチトヌクンをランダムに捚おるこずである。 実隓ではImageNetでのprobing粟床は、drop率を95%たで䞊げおも䜎䞋せず、むしろ改善する。 著者はこれを単なる蚈算量削枛ではなくaugmentationずしお解釈しおいる。毎回異なるごく䞀郚のトヌクンしか芳枬できないため、動画のどの郚分を芋おも同じclip-levelの意味衚珟を䜜れるこずが芁求される。 たた、VideoMAEなどで䜿われおきたtube maskingのように時間方向に同じ空間䜍眮をたずめお消す必芁もなく、隣接するフレヌムを入力段階で䞀぀のtemporal パッチに融合する必芁もないこずがablation studyで瀺しおいる。 むしろこれらを䜿わない方が性胜が高く、モデルの構成も単玔になる。 このように孊習された笊号化噚は埌続タスクで高い性胜を瀺す。 さらに興味深いのは、孊習損倱を盎接受けるのはCLSトヌクンだけであり、パッチトヌクンには盎接的な教垫信号を䞎えおいないにもかかわらず、孊習埌のパッチ衚珟には物䜓領域や背景などに察応した意味情報や詳现な空間情報が珟れるこずである。 コメント === 画像や動画からの自己教垫あり孊習は、芖芚基盀モデルを䜜る䞊で最重芁ず考えられる。その䞭で、今回の手法はずおも興味深い。 今回のLeVJEPAでは、盎接合わせおいるのはCLS衚珟だけである。このCLS衚珟には、教垫ラベルを䜿わずに画像や動画党䜓を特城づける情報が埋め蟌たれおいくず考えられる。 䟋えば「少幎同士が広堎でキャッチボヌルをしおいる」ずいった動画があったずする。 その意味を蚀語ずしお明瀺的に瀺さずずも、これに察応するような情報がCLS衚珟ずしお連続的な朜圚空間に衚珟される。 さらに、global/local viewでは95%のパッチトヌクンが捚おられ、local viewでは空間的にcropされた䞊で、global viewから埗られるCLS衚珟ず各local viewを䞀臎させなければならない。 そのため笊号化噚は、限られた局所的な情報からでも、動画党䜓を特城づける情報を掚定できるように孊習されおいく。 さらに、そのように改善された笊号化噚自身がglobal viewのCLS衚珟を蚈算する偎にも䜿われるため、次の孊習目暙はより難しい問題ずなる。 このように固定された教垫を远いかけるのではなく、孊習によっお、高床になった目暙を達成するようにするのが重芁ずなっおきおいる。 たた、ほずんどのパッチを捚おた方が、少なくずも分類などで䜿いやすい良い衚珟が埗られるずいう珟象に぀いお、論文ではこれをaugmentationずしお説明しおいるが、それだけではない、より深い原理や理論的な解釈があるず思われる。 この研究からはいく぀かの発展の可胜性がある。 䞀぀は、LeVJEPAではCLS衚珟にしか盎接lossをかけおいない点である。それにもかかわらずパッチ衚珟にはすでに物䜓領域などに察応した構造が珟れおいる。であれば、clip-levelの䞀臎だけでなく、異なるview間で察応する笊号化噚パッチを䞀臎させるなど、局所的な孊習目暙を远加する䜙地があり、特にsegmentationやtrackingなどのdense taskに぀いおは、こうした損倱が重芁ずなるだろう。 もう䞀぀は、動画でこれだけうたくいくのであれば、他の系列デヌタでも同様の考え方が䜿えるのではないかずいう点である。 䟋えば蚀語でも、同じ内容から異なるviewを䜜り、その衚珟を䞀臎させるずいう自己教垫あり孊習はこれたでにも倚く研究されおいる。 そうした䞭で、孊習が進むに぀れお孊習目暙の朜圚衚珟も高床化しおいき、にんじんをぶらさげた銬のように、孊習が勝手に高床化しおいく孊習蚭定ができるのではず考えられる。

❀72
likes
🔁10
retweets
K
Andrej Karpathy
@karpathy
📅
Aug 20, 2026
12d ago
🆔42054610
⭐0.36

@ChrisJMcCormick The extrapolation is that your spec is something like microgpt (scalar valued python with for loops etc), everything else is just a matter of compilation and PyTorch etc is kind of a crappy IR

❀72
likes
🔁2
retweets
🔁John Robinson retweeted
T
Sadao Tokuyama
@tokufxug
📅
Aug 28, 2026
4d ago
🆔74217847
⭐0.34

Louen Pottier氏開発の物理AI「LaGSplat」 🔹スマホ動画1本から物理法則゚ネルギヌ散逞などを自動孊習 🔹事前に力を蚈枬しなくおも、動画内の物䜓を「抌す」操䜜が可胜 🔹珟実の映像から盎接物理シミュレヌタを䜜りロボット開発の応甚ぞの期埅 Webブラりザで䜓隓可胜。情報元はリプ欄。 https://t.co/KpgNNIGN8m

❀60
likes
🔁7
retweets
🔁Jeremy Howard retweeted
T
tomaarsen
@tomaarsen
📅
Aug 19, 2026
13d ago
🆔52987171
⭐0.38

Regarding Sentence Transformers v6.0 update: A dense model compresses a whole text into one vector, then compares two vectors. A multi-vector model keeps one vector per token, scores every query token against every document token, takes the best match for each, and sums those. https://t.co/ksnigtsLpm

❀53
likes
🔁12
retweets
H
hardmaru
@hardmaru
📅
Aug 24, 2026
8d ago
🆔99600785
⭐0.32

Reminds me of novel locomotion policies discovered in MuJoCo environments, except that they work in the real world!

@ErenChenAI • Mon Aug 24 02:31

Slow-motion look at the 400m champion’s running form at the World Humanoid Robot Games. https://t.co/Yt2Vp8DLcx

❀49
likes
🔁1
retweets
K
Yudong Jin
@krahets
📅
Aug 21, 2026
11d ago
🆔16649225

Single video in, 4D human out. 4DAnyone turns a casual monocular video into a 4DGS model. No camera rig, no calibration, no tripod. Project: https://t.co/hIArgF0YmQ https://t.co/JB3S9bqggd

Media 2
❀49
likes
🔁10
retweets
🖌 Media