So, the issue here is Harvest Jack doesn't hit too hard, and I think you may have difficulties trying to hit HP, Crit Rate and Damage along with Speed and Accuracy. I think your best bet might be to focus on using him as a crowd control champ, focusing on speed/accuracy/hp. I think I'd focus on the first two stats, then get in HP where you can.
As for sets, if you're able to get to them without hurting your stats then Perception, Speed and Accuracy would be nice.
i'll echo what thorne said. harvest jack really isn't intended to work as a damage dealer and trying to force it will just make him worse at the things he does excel at. your two chief concerns should be stacking him with hp and accuracy, as well as getting making sure he has an adequate amount of speed (the first thing you'll want to change with your current setup is putting a set of speed boots on him). regarding accessories, you'll likely want to go hp/hp/acc, but you can swap out his ring or amulet for def if you get one with particularly good substats or if his defense is otherwise too low.