Vikings QB Christian Ponder defended his play after the loss to the Colts, saying he isn't going to take shots downfield if they're not there. (AP)

Minnesota WR Percy Harvin was called for offensive interference in the fourth quarter of the Vikings' 23-20 loss to the Colts on Sunday, helping to derail yet another drive for the Vikings. Harvin and the Colts defender both made contact with each other, but it was Harvin who drew the call -- and he disagreed with it.

“It was a terrible call,” Harvin said. “[The defender] kind of was shielding me from the ball. I was just trying to get around him to the ball and I don’t know what they [saw]. But he was shielding me off so it was bad call -- but it’s all good. It’s part of the game and we’ve moved on from it.”

Harvin said he knows that the replacement referees are trying to do their best and that there are going to be calls that don’t work out, but it’s still tough when poor calls are made in pivotal situations.

“It’s frustrating because I think there was no offensive pass interference calls the whole preseason, so that’s kind of what they’ve been emphasizing,” Harvin said. “It wasn’t just our game, but a lot of offensive pass interference [was] called. It just seemed like they were gunning for the offensive pass interferences this week. It’s frustrating not knowing exactly what they are looking at, but we can’t worry about that. We have to adjust to the game and be ready to go from there.”

Greenway won’t make excuses for defense: LB Chad Greenway didn't mince words when asked if he took any positives away from Sunday’s loss to the Colts.

“You know, not really,” he said. “It’s about winning, and we didn’t do enough to win this week. Obviously, we didn’t play good enough, and I think if you look at it that way you’re sort of splitting hairs and trying to find positives: ‘Well, we did this good, but we didn’t do that good.’ You get into that, and you're giving yourself excuses, and we can’t afford to do that. We’re just not good enough to be able to do that for ourselves. So it’s about going out there and just getting better and getting the win.”

Frazier wants better two-minute defense: With all the talk about the lack of fast starts by the offense, coach Leslie Frazier would like to see a faster finish from his defense. He says they have not done well at the end of each half and must improve.

“We’d like to be better in two-minute. We’re not doing very well right now in two minutes -- at two minutes before the half, at two minutes at the end of the game,” said Frazier. “That’s glaring, so we have to do better. The way our team is built, we’re going to play a lot of close games. Two minutes, yeah, we have to do better in that area.”

Ponder defends the offense: QB Christian Ponder was defensive about his offense Monday. He said he would like to make plays down the field, but the offense has been successful without that. (“We're averaging 8.3 yards per catch, which is up there in the tops of the league,” he said.) Ponder said the offense would continue to take what the defense gives it.

“[It’s] based on what they’re giving us,” he said. “Especially [Sunday, the Colts] were playing two-deep a lot of the time and taking [the deep throws] away.

“I’m going to be smart with the ball," Ponder said. "Obviously, my troubles last year were turnovers. I’m not going to force things down the field that aren’t there. We’re just going to play and make the plays we’re supposed to.”

For more Vikings news and notes, follow Joe Oberle on Twitter @CBSVikings