Some fish prefer certain bait but as long as the bait is usable at the hole (won't get anything using freshwater lures for ocean fishing, for example) the chance is there.

In general, desirable fish for crafting or leves tend to favor consumable baits over reusable ones (and the time between bites will be shorter).