The short answer is yes. Soundproofing is like waterproofing and is only as good as the weakest point. Sound can travel through very small gaps, so if you were just to soundproof part of the floor you would be wasting your money.