I tried wiping down the counters with a bleach solution, which made the place smell clean, but didn't noticeably impact the ant flow. A friend suggested that ants hate Dr. Bronner's peppermint soap, and since I had some of the Trader Joe's Dr. B knockoff, I decided to try it.
So far, seems to be working. I wiped down the counters with a little on a sponge for the last 2 days , and I haven't seen more than one ant in the last 24 hours. So file that away if you run into the same problem and feel weird about putting poisons in your kitchen.
KILL ANT! KILL ANT! OK!