Staying away is not enough you have to get legal divorce. but this much duration is valid ground for divorce.
unless there is some legal agreement or bond or fathers will other lady/son cant claim anything.
but other lady is staying with your father as a husband and wife then its counted as live in relation and she has rights too.
Please browse http://mynation.net/docs/sitemap/ for relavent judgments