 Zaremba started a career as cantor of the Lutheran Church of Saint Peter and Saint Paul, after he married the Lutheran Jacobine Philippine Adeleide von Klugen.In 1860 he joined the Russian Musical Society.He was appointed as one of the professors at the Saint Petersburg Conservatory when it was founded in 1862.