You forget about genders, cases and the other language elements. If you just replace english prompts with Czech ones – you will get “me talk english very poor” sort of IVR. Probably in most cases your customer can figure out what you meant, but it will sound confusing and extremely unprofessional.