Maybe that's a poor choice of words on his part. Yet cleaning out ash trays in particular is a nasty thing to ask someone to do who didn't make the mess.As a supervisor, I would never accept an employe telling me 'that's not my job', assuming the task was not illegal. "My Job" is normally performing tasks that needed to get done, not necessarily only the jobs that I want to do.
I'm not just trying to offend you and your ideals, but I assure you, your name would be at the top of my cut list, should that need come up.