Do You Have to Count Every Beat in Jazz? No — Target the ‘Head of the Beat’

You don't count every beat when you play jazz guitar. You aim at targets — the places where melody and harmony line up, especially beat one of each bar, the 'head of the beat.' Everything in between is free.