Use a vegetable peeler to remove zest from orange and meyer lemon. Juice half the orange and half the lemon. Add the juice, zest, garlic, chili flakes or fresh chilis, rosemary, and olive oil to a small saucepan, and heat about 5 minutes. Do not fry the garlic, just heat it til it softens. Add the olives and turn off heat. Allow to cool, drain and serve. You can also store the olives in the infused oil. Keep the infused oil for making salad dressing.