The cell wall, a major barrier protecting cells from their environment, is an essential compartment of both bacteria and archaea. It protects the organism from internal turgor pressure and gives a defined shape to the cell. The cell wall serves also as an anchoring surface for various proteins and acts as an adhesion platform for bacteriophages. The walls of bacteria and archaea are mostly composed of murein and pseudomurein, respectively. Cell wall binding domains play a crucial role in the non-covalent attachment of proteins to cell walls. Here, we give an overview of the similarities and differences in the biochemical and functional properties of the two major murein and pseudomurein cell wall binding domains, i.e., the Lysin Motif (LysM) domain (Pfam PF01476) and the pseudomurein binding (PMB) domain (Pfam PF09373) of bacteria and archaea, respectively.