I have recentlly created a data directory in my home dir, and moved almost everything I need to it. Even configs and program data are in it somewhere I find ok, and symlinked to the xdg dirs (I know i can make my new location the xdg dir for config and data, but this way I selectively add stuff to my now main config, so it remains more pristine)