 In 1826 Warren moved back to Rhode Island, opening an architect's office in Providence.In 1828, he collaborated with fellow Providence architect James C. Bucklin of Tallman & Bucklin in the design of the Westminster Arcade, designing the Westminster Street facade.He joined Tallman & Bucklin formally in 1830, the firm becoming Warren, Tallman & Bucklin.