Rare region induced avoided quantum criticality in disordered three-dimensional Dirac and Weyl semi-metals