This is how it should work:
Select a Swatch in the Swatches palette, choose from the menu: ':Select all object that use this swatch' (as Fill / Stroke).
Comes in very handy to select items via the Swatches palette in complex cartoon style drawings. It is also a way to - kind of - create long awaited multi layer groups.
