The actor must prioritize if he wants to be involved in his son's life