We have this in the UK except for the enforcement bit which is only vary rare headline seeking click-bait and the consequences are obvious. Some remote spots have large amounts of industrial-scale waste dumped on regular basis, I walk past 3 of them every week yet the local council always feigns surprise when it happens.
The answer is, as you have, severe enforcement or provision of an affordable alternative.
I would argue the answer is twofold. Make it easy to do the right thing and make it very expensive to not do the right thing. Just making it very expensive doesn't work and will feel unjust when you get fined.
The answer is, as you have, severe enforcement or provision of an affordable alternative.