Olive oil isn't a high heat oil, so lots of carcinogens are getting into the food because of it's low smoke point.
Coconut oil and ghee are high heat oils. (ghee is not vegan, it's made from butter with the milk solids removed)
You can do what you like. A very good question to ask is "What does my body want?" If the answer is sugar, that can be the bad bacteria or parasites in your gut. Yes, they "talk/think/respond", that's why your stomach is sometimes called your second brain.