>Doesn't "under color of law" mean that it is unlawful, just appears to be lawful?

Which is exactly the category that "basically stalking, but don't worry we're the government so it's fine" would fall into since "basically stalking" is illegal generally.

Edit: The answer to your question is yes.