There are adjustments that you can make to compensate for wear.
Also, if they get rusty inside, they have a tendency to stick and the brakes are hard to fully engage, leaving you thinking they are weak. Of course, they can stick in the engaged position too, which is worse as it causes extra wear...