Great article entitled Why I am not a Libertarian by Nathan Schlueter

Read the whole thing.  It sums up and articulates what I have found troubling about Libertarianism. It also gives an answer to those who oppose all group rights, such as the religious freedom of groups to worship and to build institutions such as schools and hospitals.   Here's the section on that aspect.

3. “Only individuals exist, therefore there is no such thing as a ‘common good.’” The statement reflects the corrosive nominalism that Richard Weaver decried in Ideas Have Consequences, and which fatally undercuts the principled limits to coercive authority identified above. Every human association, whether a marriage, business partnership, or sports team, has a common good, or why would it exist?

Common goods are not substantial entities standing over and against individual persons; they are the good of individual persons. But this does not mean common goods are always divisible into individual shares, like a cake. An orchestra, a marriage, an army cannot be divided without being destroyed. Within such associations individual persons exist as bandmates, spouses, and soldiers.

The common good of the political association consists in the ensemble of conditions in which persons and associations can more easily flourish. These are nicely summarized in the Preamble to the Constitution of the United States: “to . . . establish justice, insure domestic tranquility, provide for the common defense, promote the general welfare, and secure the blessings of liberty to ourselves and our posterity.”