However, since it actually doesn’t matter how the word China is written, it just stands out as weird.

Fair enough but I think it does (almost certainly unintentionally) add to the joke. Rather than modern English it looks like someone wrote “China” on the Great Wall centuries ago like they’d write Hanzi with a brush. Could be just me though.