We had logic in place to drop (most) metadata, but the change
had a small bug: During saving, we were still using the one with
metadata...

Maybe doesn't quite close it, but big enough of an improvement
for now, I think, so

Closes numpygh-14142