Scott Bittle retired Mississippi State's final 11 batters as Mississippi rallied to an 11-6 win Saturday night.
The Rebels (13-4, 2-0 SEC) scored four runs in the eighth inning to break open a 6-6 game.
Michael Guerrero drove in four runs for the Rebels, who can sweep the Southeastern Conference season-opening series against the Bulldogs (7-9, 0-2) with a win Sunday.
Bittle allowed two hits and one run in four innings after taking over for starter Cody Satterwhite, who gave up nine hits and five runs in five innings.
Jordan Henry and Cody Overbeck had two RBIs for Ole Miss.