@a1zhang
Introducing Speculative Programmatic Tool Calling (sPTC)! A general class of technique for speculating on tool calls during code generation in a harness and queuing them early to overlap with token generation + REPL execution time. Blog: https://t.co/0nzkLvTXNy https://t.co/SVH8D2JyEg