Golson was only with the Yankees for three days, promoted last Thursday when Alex Rodriguez was placed on the 15-day disabled list following right knee surgery.
Manager Joe Girardi said he chose to switch the right-handed hitting Golson for the left-handed Dickerson because four of the next five starting pitchers New York will face are right-handers.
This is Dickerson's third stint with the Yankees this season. He has played in 31 games, batting .300 with no home runs and three RBI. Dickerson was optioned to Triple-A on July 4 when Derek Jeter was activated off the disabled list.