Why not just use a cv modulatable panner?
Or 2 vca's and invertor?