Read it through once
Here are two infinitives, with the prepositive omitted, “expostulate” and “attempt”, both dependent on the noun “time”, and another, “withdraw”, without the prepositive, dependent on “attempt”: “but when ‘twas time {to} expostulate, {to} attempt {to} withdraw”, etc.