Another benefit is that it encourages more efficient use of land. Existing taxes mean that if you demolish a high density retail strip and replace it with a McDonald’s or Walmart with large parking lot/drive thru, the tax income plummets while the cost to maintain the roads and plumbing remains the same.
Just to be clear: land value taxes by themselves don't encourage more efficient use of land. Removing taxes on improvements (and on capital and labour) encourages more efficient use of land, and a land value tax can help finance those other tax reductions.