May a child begin to wear a Tallis Katan if he is not yet potty trained?[1]

Yes. Nevertheless, some are accustomed not to do so.

[1] See customs in previous footnote; Nitei Gavriel Upsherinish 16:1