Silky tie with oxford shirt

I've heard a silk tie looks a bit out of place with the rougher texture of an oxford shirt. I only remembered this recently when I sort of noticed it myself...I was wearing a new checked shirt that I didn't really realize was oxford cloth until I was struck by the difference between the finer look of the tie and the texture of the shirt.

as someone who is trying to dress nicer lately...and trying to learn do's and don'ts a little late in life....should I avoid this?

Silky tie with oxford shirt