Sounds to me like your slides are worn and you've adjusted the idle to compensate, but as the cable starts pulling, the slide moves to one side and seals its leaky gap before sliding up the carb bore and doing its job.
It'll be ok for a while still, but then it'll start idling badly.