Paraguay's Santiago Peña offered to resign, but the Senate has begun impeachment proceedings against him.
Ueno Bank's crisis has left nearly three million customers unable to access their accounts.
Criminal investigations are examining alleged financial irregularities, public deposits and Peña's links to the bank's owner.
