Do you have debugs? It sounds like you didnt negotiate the media stream.
Possibly some issues with Fast start media negotiation vs slow start.
Reply To: OpenPhone call to PSTN phone
Erlang and call center software