Spatial information can be conveyed not only by stimulus position but by the meaning of a location word or direction of an arrow. We examined whether all the location-, arrow- and word-based Simon effects or some of them can be observed when a location word or an arrow is presented eccentrically and a left–right keypress is made to indicate its ink color. Results showed that only the location-based Simon effect was observed for location words, whereas an additional smaller arrow-based Simon effect, compared to the location-based Simon effect was observed, for arrows. These results showed spatial location, arrow direction, and location word stimulus dimensions affect response position codes in a spatial-to-verbal priority order, consistent with the possibility that they can activate mode-specific spatial representations.