fix flaky timeout test (#3415)

Timeout test was flaky, failed on main.

----

_By submitting this pull request, I confirm that you can use, modify,
copy, and redistribute this contribution, under the terms of your
choice._