Your units can move through a Teleport Gate to any province where you or an ally has another Gate. This does mean that a single Teleport Gate is useless.

Your units can move through a Teleport Gate only if they begin the turn in the Gate's province.

Teleport Gates are particularly vital if you have conquered wide territories, as they allow you to transport troops to the front quite quickly.