It's almost certain that just washing your car is not enough!
Contaminants dig into the paintwork and start eroding at the miniscule level, you can't see it with the naked eye but it's there (honest)
Here's a diagram of what contaminants look like as far as paint is concerned
Don't believe me, do a ‘Bag Test’ place some saran wrap or a zip lock bag over your hand and rub across the finish lightly. Every snag you feel is a surface contaminant that the clay bar can remove but you may not be able to see.
What you're actually feeing is a combination of Rail Dust, SAP, pollen and road type debris
CLAY BAR (ing) your car removes these and other contaminants that make your paint feel like sandpaper without harming your actual paintwork.