Prince Harry made sad admission about his kids after revealing his ‘worst fears have been confirmed’