Born in Bohemia, Neumann went to the United States after studying for the priesthood, and was ordained by Bishop Dubois of New York in 1836. He worked in Buffalo before moving to Pittsburgh, where he joined the Redemptorists. As bishop of Philadelphia he presided over the building of fifty churches and nearly 100 schools.