Chai is black tea steeped in milk with spices, like star anise, cardamon, peppercorn, cinnamon, and allspice. When making ice cream, the freezing can mellow the flavors. Make sure your flavors are strong when you're brewing the milk tea mixture.
Adding extra spices will enhance the flavor. There's no limit to the different versions you can create.