Hole dynamics in exactly solvable gapped and gapless spin liquids