The synthesis and structure of two new transition metal oxide tellurides, Sr2MnO2Cu1.82(2)Te2 and Sr2CoO2Cu2Te2, are reported. Sr2CoO2Cu2Te2 with the purely divalent Co2+ ion in the oxide layers has magnetic ordering based on antiferromagnetic interactions between nearest neighbors and appears to be inert to attempted topotactic oxidation by partial removal of the Cu ions. In contrast, the Mn analogue with the more oxidizable transition metal ion has a 9(1)% Cu deficiency in the telluride layer when synthesized at high temperatures, corresponding to a Mn oxidation state of +2.18(2), and neutron powder diffraction revealed the presence of a sole highly asymmetric Warren-type magnetic peak, characteristic of magnetic ordering that is highly two-dimensional and not fully developed over a long range. Topotactic oxidation by the chemical deintercalation of further copper using a solution of I-2 in acetonitrile offers control over the Mn oxidation state and, hence, the magnetic ordering: oxidation yielded Sr2MnO2Cu1.58(2)Te2 (Mn oxidation state of +2.42(2)) in which ferromagnetic interactions between Mn ions result from Mn-2(+/3)+ mixed valence, resulting in a long-range-ordered A-type antiferromagnet with ferromagnetic MnO2 layers coupled antiferromagnetically.