I won't be arm-chair minister - Dr Nsoh