The block diagonal decoupling problem for structured systems is treated using the transfer matrix approach. An associated graph, which displays the internal structure of the system (invariant and interconnection), is used to establish necessary and sufficient conditions for the solution of the problem. These conditions are expressed in the graph in terms of shortest input-output paths, which are related to the infinite structure of the system.