If there is one people the nazis hate it would be the turks, why? because they are the ones that introduced islam and established muslim states in europe. And because nazis are ultra white they wouldnt really want muslims taking over or living in their lands.

And although hitler had a mighty military at the time, so many wars on so many fronts he could not risk another war, and hence he left the turks in peace, also they were a former ally in the Great War (WW1) so he thought he owed them that.