I can’t speak specifically to hardware synths, as I use software. However, for midi keyboards I started with a second-hand Kurzweil that had some limited built-in synth capabilities, then got a new Yamaha electronic piano that was pretty good and had fully-weighted keys, but wasn’t as useful for things like strings, and now use a Roland midi-keyboard which only has five octaves, but the velocity keys are wonderful and it weighs like a third of the Yamaha. Anyway, I know the Roland Juno synths are highly regarded, but I don’t know what they cost. Moog is also very popular, and my understanding is they have a unique yet versatile sound.
In fact, my main library of virtual instruments, Native Instruments Komplete Ultimate 11, came with a software Moog. I mostly use the pianos and strings, but the soft-synths are dauntingly complex. In half a decade I’ve barely scratched the surface with Absynth, and believe the jokes that you can do anything in Reaktor with unlimited patience.
That said, if you’re more comfortable with hardware, that’s what I’d go for. Software synths have a way of lingering on the hard drive unable to call to you like physical instruments. They’re also a pain the ass to install. 
