Fallout from the revelation that former California Gov. Arnold Schwarzenegger fathered a child outside his marriage has been "very hard" for him, and the actor "is doing everything he can to take full responsibility to take all of the spotlight off his children and wife," a source said.