Finance Minister Satsuki Katayama's remarks caught markets off guard, leading to a jump in the yen and a drop in bond yields.