Hello
Of course, you can first buy a semimodular synthesizer. Personally, I would not urge you to buy a moog synthesizer. Nothing against moog. I also have a voyager. I just think that the moog sound is least well integrated into mixes coming from modular synthesizers. Arp, Korg, Roland etc., in my opinion, fit much better in terms of sound. I would put directly on modules. Doepfer has a huge catalog of modules and is comparatively cheap. By the way, Doepfer is often underestimated. If it's supposed to be a moog I would recommend you the Behringer Model D Clone. Sounds fantastic and is cheap and taxable via cv. In addition a nices sequencer module. Personally, I'm a big fan of Intellijel products.
Have fun with the patching.