Celumusa is married to Nobuhle, and they have one son, S'bonga. He is an ordained minister of the Reformed Evangelical Anglican Church of South Africa (REACHSA). He is the rector at Christ Church Leondale and the bishop's chaplain of Gauteng.
He has Bachelor of Theology (BTh) from Potchefstroom University for Christian Higher Education (PU for CHE) now called North West University, which he did through Mukhanyo Theleogical College in KwaMhlanga, Mpumalanga. He also has BA Honours in Theology from North West University, which he did through George Whitefield College in Muizenberg, Cape Town. He was a part time lecturer at Mukhanyo Theological College in 2004, 2006 & 2013-2015. He loves Zulu Gospel Music and Zulu Traditional Music called Maskandi. He loves a number of sports: cricket, rugby, horse racing and soccer. He supports Kaizer Chiefs FC, Khosi 4 Life! Manchester City FC, and Barcelona FC.