Boswell Albernathy, Justice of the Peace