I have always wanted to build something like this. In the old days it would have been a ton of big screens but now with a VR headset, as long as you can get things lined up and calibrated to what your physical controls are it would hugely simplify things.