OXFORD (AP) — For his first two months as Vanderbilt’s coach, Robbie Caldwell was only known for his jokes.

But after the Commodores beat Mississippi 28-14 on Saturday for his first career victory, he proved his coaching skills might not be too bad either.

‘‘It’s not all about me,’’ Caldwell said. ‘‘It’s about the young men on the football team. I’m so thrilled they tasted victory.’’

Warren Norman rushed for 111 yards, including an 80-yard touchdown, as Vanderbilt (1-2, 1-1 Southeastern Conference) snapped a 10-game conference losing streak dating back to 2008. The Commodores have beaten the Rebels four of the past six seasons.

It was Norman’s third career 100-yard rushing game, and his first against an SEC opponent. The Commodores did most of their damage on the ground, rushing for 227 yards.

Vanderbilt lived off big plays all afternoon. The Commodores scored their first three touchdowns on 35-yard touchdown run by Zac Stacy, a 21-yard interception return by Eddie Foster and the biggest of all — Norman’s 80-yard touchdown run that gave them the lead for good.

Norman’s touchdown came at a critical juncture. Ole Miss (1-2, 1-1) had just tied the scored at 14-14 when the 5-foot-10, 195-pound sophomore scored on Vanderbilt’s first play from scrimmage, running untouched for the longest run of his career and the second-longest run in school history.

‘‘It just opened up,’’ Norman said. ‘‘I almost hesitated because it opened up so big.’’

Larry Smith added a 15-yard touchdown run in the fourth quarter. He also completed 9 of 19 passes for 73 yards.

Caldwell, who replaced Bobby Johnson after he surprisingly stepped down in July, is the first Vanderbilt coach to win his road debut since 1975.

Just days after Caldwell was announced as Vanderbilt’s coach, he arrived at SEC Media Days in Hoover, Ala., as a virtual unknown. But after a hilarious 40-minute speech that included topics ranging from his work on a turkey farm to his rotund frame, he received a standing ovation from some of the gathered reporters.

Still, his coaching skills were untested. And after the Commodores lost to Northwestern 23-21 in their season opener and 27-3 to LSU in their conference opener, it looked like he might be in for a long season.

The trip to Ole Miss didn’t get off to a great start either. One of the team’s buses broke down on the way to Oxford.

But Caldwell was in tears after the Commodores won, and was also soaked after getting Gatorade dumped on his head in the aftermath.

‘‘I haven’t slept well lately because of pure excitement,’’ Caldwell said. ‘‘The adrenaline is going. I’m thankful to Vandy for giving me the opportunity to do this.’’

Vanderbilt’s players gave Caldwell the game ball.

While the Commodores were making the most of their opportunities on Saturday, Ole Miss couldn’t avoid crucial mistakes. The Rebels dropped at least two touchdown passes, missed a field goal and lost a fumble in the fourth quarter that set up Vanderbilt’s final touchdown.

‘‘Those are crucial,’’ Ole Miss quarterback Jeremiah Masoli said. ‘‘We have to step up and make those plays. Hindsight is 20/20, but if those plays go our way, we might have a whole new ballgame.’’

Masoli completed 19 of 35 passes for 190 yards, but threw two interceptions. He rushed for 104 yards, including a 28-yard touchdown run.

Korvic Neat scored the team’s first touchdown on a 4-yard run.

The Rebels lost despite outgaining the Commodores 385-300. They completed only 5 of 18 third-down opportunities.

It’s been a rough start to Nutt’s third season with the program. The Rebels won 18 games and two Cotton Bowls over the 2008 and 2009 seasons, but have two embarrassing home losses early in the season.

Ole Miss lost to Jacksonville State 49-48 in double overtime in the season opener. It was the first loss to a Football Championship Subdivision team in school history.