Pure vacation or visiting family?
If it’s pure vacation, I’d probably hold off (besides, I’ve been on a pure vacation with a 2 year old, not very fun, jet lag and early nights in a hotel room.)
If you are going to visit with family you haven’t seen in a while I vote for going. There is something special about your child meeting family members for the first time and seeing the instant bond.