Current large language model (LLM) agents can accurately model a counterparty's preferences in negotiations but struggle to leverage this information for strategic advantage, often leading to suboptimal outcomes. Despite appearing more strategic when required to state concessions, the final agreements remain influenced by initial offers rather than true utility considerations.