With the Series B round, my startup began actively managing tech debt. When an engineer finds something major we create a Jira issue, user story style. The head of product (a technical person) prioritizes a blend of product features vs tech debt for each sprint. Usually that's 10-25% tech debt, which includes mostly non-critical but beneficial refactoring as you described. It's worked well for us.