Born in Connecticut, Ives became a bishop in the Episcopal Church, serving first in New York and then in North Carolina. He was influenced by the Oxford Movement and entered the Catholic Church as a layman in 1852. He taught at St. Joseph's Seminary in New York and founded a charitable institution.