Scott has a torn labrum in his right arm. He was removed from the 15-day disabled list Friday, but didn't get through an entire game against the Los Angeles Angels before realizing he could not hit as he did before the injury.
Scott hit .284 with 27 homers and 72 RBI last year. This season, he's batting .220 with nine homers and 22 RBI.
He told reporters Saturday "I battled through it the best I could, but I'm not helping the team."
Baltimore placed Scott on the 15-day disabled list Saturday and recalled third baseman Josh Bell from Triple-A Norfolk.