A food supplies firm says it is leaving a Herefordshire town after 45 years because of a lack of space locally to expand.