@omarsar0
Reasoning Patterns of OpenAI's o1-preview Model When compared with other test-time compute methods, o1 achieved the best performance across most datasets. The authors observe that the most commonly used reasoning patterns in o1 are divide and conquer and self-refinement. o1 uses different reasoning patterns for different tasks. For commonsense reasoning tasks, o1 tends to use context identification and emphasize constraints. For math and coding tasks, o1 mainly relies on method reuse and divide and conquer. "We also explore the number of reasoning tokens of o1 across different tasks, and observe that the number of reasoning tokens varies a lot across different tasks." Models like o1-preview are hard to use in that it's not so clear how to further optimize their performance. Understanding these "reasoning" patterns is a good first step but there is a lot more research to be done on these patterns and what and when to add additional context.