A color-selective, band-engineered photodetector is demonstrated. The device uses two Schottky junctions to accumulate charge in an energy well, which results in photocurrent gain and a plasmonic aluminum grating for photocurrent enhancement and red-green-blue color selectivity. This work provides a more intelligent way to design imaging sensors by integrating amplifiers and color filters directly into pixels.