Eflman said in an interview years ago that Jerry Goldsmith had been very sweet to him early in his career. I’m not sure if he was referring to something Goldsmith said about him or what, but in any case, there was some affection, at least early on.
As Ryan said, though, Goldsmith could be quite a cranky son of a bitch… In the end, his opinion of Elfman really doesn’t matter much. He _really_ didn’t think too much of Bernard Herrmann (as we know, another of Elfman’s big influences). For that matter, I doubt Herrmann would have thought too much of Elfman either!
The chapters from Goldsmith’s daughter’s book (available on Joel Goldsmith’s site) seem to suggest that Goldsmith saw John Williams as a something of a shill for doing things like conducting the Rose Bowl Parade, etc!