The article emphasizes the importance of log analysis for the credible evaluation of AI agents, arguing that traditional benchmarks can misrepresent capabilities and overlook critical failure modes. It presents a taxonomy of evaluation threats and guiding principles for log analysis, advocating for its adoption among various stakeholders in the AI field.