The introduction of OPT* offers a new framework for training large language models (LLMs) in step-by-step optimization-like reasoning, enhancing their ability to navigate complex decision-making tasks. This advancement could significantly improve LLM performance in real-world applications requiring high-value planning among multiple alternatives.