Hi @qqilihq,
I frequently process a large volumne of URLs. Parallelization is a suitable appraoch to speed things up but I had another idea.
While data is being extracted from a website and the next URL is already known, wouldn’t it be nice to do a “preflight” / prefetch of the next to squeeze even more out of that jucy throughput and CPU power at our finger tips
Best
Mike