The problem with kits is they require more work than miners! A full miner has to be built [heatsinks, case, fan etc] to quality test the hashing boards - the same as a normal unit. But they then have to be disassembled and cleaned in order to be sold as board only kits. That's time consuming = more expensive / not as cost efficient as one might imagine.
That's one way of doing it, but it's pretty inefficient.
Building a test jig to cycle through boards would be relatively trivial and quite cheap though. For something like the S5 boards you just need a flat heatsink on the bottom with some pin guides to align the boards. Slide the board in, attach a PCIe connector and the data cable, and push a button. A small air piston pushes the top plate down which provides pressure to the back of each chip, barcode scanner logs the serial number and the attached controller runs a known test data set that allows you to characterize and record the true error rate.
Test jigs are pretty standard in electronics manufacturing, and something simple like this that doesn't require fancy network connected instruments could be made for a few hundred bucks each if you build a dozen or so. Build twenty and a few workers could pump out 1000 boards in a 12 hour shift.