Are the bike markings (sharrows) going to be on every street that does not have a bike lane?

No, these markings will be on streets that are designated in the City of Harrisonburg Bicycle & Pedestrian Plan.