Wikipedia make dumps of their data available for exactly this type of use.

Those dumps are taken and stored in other places.

There's some weird GPL stuff that people need to be wary of, I guess.