Yeah, I found that if you lure each of them over to at least the edge of the doors over there (since they won't go past those for some reason) with a few chippunks, you can just punch them in 1st person into the hole and they won't yell and scream. If you start any ruckous outside, however, down there the clakker will go inside to hide from you. I suppose it's all about stealth
Also, if you run out of chippunks, just buy some more at the general store. Those clakkerz won't go anywhere.