Prime Minister Shigeru Ishiba has pledged to stay in office — in defiance of growing calls for him to step down after the LDP's poor showing in the Upper House election.