Deputy Barry White allegedly shot 69-year-old Tillman Jenkins while trying to serve him a misdemeanor warrant at his residence.
According to authorities, Jenkins answered the door with a handgun and tried to shoot the deputy.
"He was on two days leave, requested by me, and we got to the bottom of it, which it's still ongoing," said Sheriff Kemp. "I see no reason at this point why the deputy needs to be disciplined. I see no reason why he can't return to his duties."
Kemp said White was attempting to serve a simple assault warrant filed against Jenkins by Clarke county's prosecuting attorney. George Williams alleged that he was hit by Jenkins at the Clarke County Courthouse Monday.
The incident is under investigation by the Mississippi Bureau of Investigation.
Meanwhile, Jenkins remains in critical but stable condition at a Meridian Hospital.