I changed my last name at the age of 18 to that of my step-father. Today, almost 20 years later I am close with both my father and my step-father. There is no issues as my father understands my reasons.

Go for it!