You can, but it always depends on the oil. For example, tea tree oil doesn't dilute very well in water. Usually, the best option is to dilute in a carrier oil. Some oils also don't need to be diluted, depending on the usage, as is the case for lavender oil when used in bath bombs or soaps.