Yes obviusoly you can establish the voip setup.
it is good that u ve good bandwidth.now for two offices if offices are within the building then you need a single server installe a call manager on it and but two ip phones . and configure them throught call manager server.
do it and enjoy the charm of voip
best of luck