Flavor symmetry plays a crucial role in the standard model of particle physics but its origin is still unknown. A new method is presented to determine flavor symmetries within compactified string theory. This method is based on the outer automorphisms of the Narain space group of an orbifold. The resulting flavor symmetries are hence closely related to modular symmetries (i.e. T-duality). By applying this method to the T2/Z3 orbifold, one observes that the generic Delta(54) flavor symmetry gets enhanced on certain loci in moduli space. In contrast to Delta(54), which induces a geometrical CP-violation, these higher order flavor groups contain CP-like symmetries. Hence flavor, CP, and modular symmetries are combined. Furthermore, this setup allows for models where CP is spontaneously broken by the VEV of the T-modulus.