If you queue voice packets your speech quality will be very bad.
Voice packets MUST be given the highest priority, along with any signalling packets associated with the voice (ie telephone controll signals)
If you cant give these priority you should reconsider attempting to use VoIP.
Use Erlang B.