We have had instances of a particular patron at a local Hardees that was asked by management to not come back. He was one of the group of older gentlemen that meet at the restaurant every morning for coffee. All of the other group stay at their tables and eat and drink coffee and talk among themselves. However, the one particular fella was leave the group and wander around the restaurant, go up to every table that someone was setting at and start a conversation. This may sound harmless, but it became annoying to several other diners, including my wife and I. Many of the diners told the manager that so long as "Earl" (name changed to protect the innocent) was present, they would no longer be coming to eat. The manager tried to accommodate everybody by asking Earl to stay at his table, but he would not oblige, thus he was asked not to return.
He took his business to the local McDonalds, where, believe it or not, the same thing happened after a short time.
I don't think any of the restaurants mind the local loiterers in these cases - because they usually buy a breakfast biscuit or meal and drink coffee and generally aren't taking up space that other patrons need.
I too take notice of how busy a restaurant is and try to expedite my time at the table. We don't often eat out at "sit-down, table service" restaurants, and I'm certainly not one to stay at my table after the ticket is paid. Very often, I'm ready with my payment by the time the server arrives with the check because I'm done eating and ready to go - I'm not usually in that big of a hurry, I just generally have other things to do rather than sit at the table once I'm done.
Good luck and take care.