 While in Bloemfontein Swartz initiated the ecumenical movement together with Ivan Abrahams, later presiding bishop of the Methodist Church of South Africa in 1984, this movement carried on as members of the Methodist, Lutheran, Roman Catholic, Dutch Reformed now the Uniting Reformed Church, United Congregational Church of Southern Africa UCCSA and Anglican Churches meet monthly to celebrate and commit themselves to unity.Swartz was also involved in the community and coached the Free State Women's hockey team inter alia.He also was involved in promoting the arts with John Badenhorst.