There is another bug here

self.server needs to start out set to None as well as server_key.

Otherwise we could have addresses in the cache for the ptr name but it actually uses a different name in the dev record and a different address so we end up returning the addresses for the ptr name instead of the srv

Everything that returns self.server might need to be adjusted as well