Beefy Boxes and Bandwidth Generously Provided by pair Networks
Bob Your skill will accomplish what the force of many cannot
Re^4: tight loop regex optimization  by superawesome (Initiate)
on Nov 03, 2011 at 00:43 UTC ( #935526=note: print w/ replies,
xml ) Need Help??  in reply to Re^3: tight loop regex
optimization in thread tight loop regex optimization  That
smacks of very poor parallelisation.  Yep, this is exactly as
you describe. Each repo being processed takes a different amount
of time, and I'm simply running X of them and waiting for all X
to finish before starting the next round of X jobs. If they take
roughly the same amount of time, this works pretty well... if
they are very disparate, it's not much better than serial. By my
estimation I'm within 20% of optimal on this data set. I don't
think this algorithm will get much closer without some hand-
optimization. Still, even this simple algorithm has reduced the
running time by more than half.  The calling script is currently
a shell script, not Perl