I think I can agree to some of what you say, I distinguish it as being the difference between right libertarian vs left libertarian. While they both agree on cutting government regulations, cutting government soending, cutting government power, I would argue that a right libertarian has more in common with a conservative, although also some very large differences, than a right libertarian has in common with a left libertarian.