Orange Flower Water

4 large oranges, 2 t fennel, toasted and crushed, 1 clove garlic, crushed, 2 T lemon juice,

2½ cups sugar, divided, 3 cups milk, 2 cups whipping cream, 1 T vanilla paste or vanilla extract,