Over the years, the office of the ombudsman in the public services of African states has been wobbling in its performance. The reasons for this are largely a result of overcentralization of government, bureaucratization, and the unwillingness of government to become truly democratic. The resultant effect has been that many citizens in African states cannot meaningfully seek redress against maladministration nor can they complain about poor governance and services delivery. This article argues that public servants in African states should be perceived as existing to help citizens, not to make citizens’ lives more difficult; it needs to be clear that the office of the ombudsman must be strengthened so that all the tenets of a credible public service are seen to be present and working to the advantage of all. This will help to put a check on government activities in the interest of the citizens and thus help to address the problems of human rights abuses, lack of accountability, and the absence of good governance.