Blend rice, water, and cinnamon sticks until rice and cinnamon begin to break up, about 1 minute. Transfer to a pitcher and let sit at least 3 hours or overnight in the refrigerator.
Strain the rice and cinnamon and discard. Stir milk, vanilla extract, and sugar to the rice water. Serve chilled.
