I've found that the gold sparkly pencils from party supply stores always come back to me. It's not just a regular yellow pencil, so they remember where it came from...even if it wanders off for a few days, it comes back.
Although I can't say I worry about losing the pencils...that's why they are there, after all...