Bidule is indeed a fine idea. Do you have an analog joystick ? Chances are (unless you are into gaming, especially flight sims) you have a digital joystick which means perhaps 8 microswitches and a few buttons - not very responsive for midi CCs.
A true analog joystick has two potentiometers which offer seperate, infinitely variable control voltages. You can buy expensive ones from industrial motor control supplies or get an 80's games console off the bay for ?5.
If you can get your dreams to work with 16 midi CCs, I would suggest you get think about a cheap analog stick (or two) with a
doepfer pocket electronic. One joystick with two buttons would use 4 of the 16 available midi CCs. You could have four sticks like this, or one stick with 14 buttons/switches! All you need to know is how to solder and mount a switch.
brzap!