Heh, no, I can't "prove" that he had affairs. And I will give him the benefit of the doubt that he didn't. We'll stipulate that, as far as anyone knows, he was working and doing sheerly chaste flitting.
My point in all of this is that he was off doing whatever it is famous young actors do while his wife was struggling with depression. She divorced him because whatever he was doing while he was off being young and famous and actorly exacerbated that. Maybe he was banging other women or maybe she just thought he was. But really, it may have been as little as the fact that she was tired of him not being there when she needed him. She was classy enough not to elaborate.
Do I find him less attractive because of this? Yeah. It makes it impossible for me to suspend my disbelief entirely. Is he still as pretty as he ever was? Yes. I just can't help putting myself in her place and thinking that she probably would have loved to see his face, pretty or not, when she needed him. It interferes with my objectification of this particular male.