I don't think that would be the case. Mainly because the universe is just that large, and so few places in it are even potentially habitable even to bacteria.
I'm not supporting panspermia as the actual explanation for Earth, but as a phenomenon it is entirely plausible.
__________________
| (• ◡•)| (❍ᴥ❍ʋ)
|