Typically, Fed chairs leave the central bank after their leadership tenure ends — only one has stayed on past the end of their term as chair in the central bank's 112-year history.