To clean the cap on a stainless steel water bottle, start by rinsing the cap under a stream of water. Use a brush to loosen up any stains or gunk. Next, soak the cap in a small bowl of vinegar for 30 minutes or so. Rinse it thoroughly when you're done. It's really important to clean the cap regularly since bacteria can build up on it.