Usually worth doing
If the costs are recovered inside twelve months and you expect to hold the property longer than that, the case is strong. Check there is no fixed-rate break cost, and that your loan-to-value ratio still clears the new lender's threshold.