I found my problem: see W5500 gets TCP timeout even when peer has sent the ACK within timelimit (200 ms) - #2 by Eugeny
The retry_count, which sets the RCR register, must be 3 or greater. Less than 3 leads to ‘unpredictable’ behavior.
Wish that was in the data sheet.