You're exactly right: it`s about balance. Some freedoms (dangerous drugs, etc) come with costs that we consider too high a burden. It`s the singing in the shower and annoying your neighbour thing: sometimes one man`s freedoms to do one thing impinges on another man`s freedom to do another thing. A balance is always needed when people live together.
Sometimes our opinion on that balance shifts. It`s shifting on some drugs, for example. And people`s opinions vary on where the balance should lie.
Our disagreement on guns is simply one of where the balance should lie. I`m of the view that the cons outweigh the pros, and you`re of the opposite view. We`re not fighting over the concept of things being banned...just on whether or not certain things should or should not be banned.