Actually this entire construction is wrong: currently people who improve their land get penalized by higher taxes. If there are only land value and not property taxes, we are in fact increasing your freedom to make changes to your land without penalty.
Your argument ignores that changes to neighbors' property would then cause an increased burden to a land owner. This would not seem to be an improvement for freedom
