LinAlg-Bench is a new benchmark that evaluates large language models' performance on structured linear algebra tasks, revealing systematic failure modes based on matrix dimensions. The findings indicate that model failures are linked to computational limits rather than knowledge gaps, highlighting critical areas for improvement in AI mathematical reasoning capabilities.