At what point should a divorced/single father give up on seeing his children?

If you love your children and want to be part of there lives then never give up fight as long as you possibly can they are worth every penny. Sue her for custody if you have to. Go to another judge anything just don't give up because if you give up your children will lose respect for you.