Neural network surrogates fail to generalize across geometry families