We reveal some of the key mechanisms during charge generation in polymer:fullerene blends exploiting our well-defined understanding of the microstructures obtained in pBTTT:PCBM systems via processing with fatty acid methyl ester additives. Based on ultrafast transient absorption, electro-absorption, and fluorescence up-conversion spectroscopy, we find that exciton diffusion through relatively phase-pure polymer or fullerene domains limits the rate of electron and hole transfer, while prompt charge separation occurs in regions where the polymer and fullerene are molecularly intermixed (such as the co-crystal phase where fullerenes intercalate between polymer chains in pBTTT:PCBM). We moreover confirm the importance of neat domains, which are essential to prevent geminate recombination of bound electron-hole pairs. Most interestingly, using an electro-absorption (Stark effect) signature, we directly visualize the migration of holes from intermixed to neat regions, which occurs on the subpicosecond time scale. This ultrafast transport is likely sustained by high local mobility (possibly along chains extending from the co-crystal phase to neat regions) and by an energy cascade driving the holes toward the neat domains.