They don't. Use better tools

Context favors the newst tokens. To get closing tages means to find much older tags.

HTML is simply oppositive with LLMs favoring the next token based on the just made.

There must be some interface for LLMs tocdeal directly with the tree structure of programming and computer languages. Like, something similar to Emacs paredit interface, but for arbitrary languages