Unfortunately, instant relief is very hard to achieve. You might try an ice pack for pain, although a warm compress will allow the boil to drain faster. Your doctor may be able to provide a topical lidocaine pain ointment or check your local pharmacy for over-the-counter options.