Mk1 wheel clunking and wobble

Hi guys im having a very weird issue on my chico for the past few months i've been getting intermittent clunking scratching sounds from my driver side wheel however this only happens if i let my foot off the gas and in gear, if i press the gas again the knocking stops and i drive normal even when i'm coasting the car in neutral the knocking sound goes away, its getting bad to a point the car starts pulling to each side unable to keep the wheels straight when it happens. i had a look under last night and noticed my outer tie rod was shot so i replaced that and still no luck i doubt its a bearing issue because its only doing it in a specific driving condition. so guys what do i check from here break calipers, cv's, drive shaft, wheel bearing ?   note this problem only occurs when car is in gear and foot of the gas.

The method I remember for checking cv joints was to find an empty car park and drive slowly on full lock one way, and repeat the other, listen for odd noises. Could also be a wheel bearing. As a youth I let one get so bad I had to replace the hub! Jack the car up and hold the wheel top and bottom and give it a wiggle - any movement will indicate a wheel bearing on it's way out.
From what you've described though it sounds like a CV joint.

Seems all is well now i removed the outer cv and fitted a new one on, my wheel is much more  and the annoying clunking is gone. Thanks you for the help paceman