"Taking my business elsewhere" is a colloquial phrase meaning that a customer will no longer use a particular business. It implies they are switching to a different provider or competitor. This usually happens due to dissatisfaction with the current service or the business's pricing, service quality, or other reasons.