Flipping the bird is an American (I think American) phrase for raising your middle finger to someone, signaling "**** you."
That song is a bit disturbing.. a bit entertaining... interesting lyrics.
Edit: What? Part of my post got cut off!
Edit: Let's see if this fixes it..
Edit: Fixed!