There is abundant research indicating the existence of a stable mechanism of correspondence between semantic units and color. Researchers usually refer to it as synesthesia. This mechanism inspired the creation of a cross-media mapping model (between semantics and color) to execute semantics-color interaction and design, and a method to generate corresponding color combinations by semantic imagery. In this project, a semantics-color mapping model was constructed based on user-evaluated parameters of color relations and semantic dimensions. The model consists of six semantic dimensions corresponding to six multicolor relation scales. An attempt was also made to provide a synesthetic color combination corresponding to a user's semantic expectation. This method paved a path toward restoring semantics-color synesthesia and generating color combinations by semantic control. The synesthetic mapping model will affect color perception and expression as well. The cross-media mapping model can be applied not only in semantic-driven color design but also in cross-media interaction, cognitive and expressive aid, and other artistic fields.