Why is this regex so slow? Am I missing something obvious?

1 point

a year ago

I’ve been trying to optimize a script that processes a huge text file, but my regex seems to be the bottleneck. Here’s the snippet:

python Copy code import re

pattern = re.compile(r"(?:https?|ftp)://[^\s/$.?#].[^\s]*") with open("large_file.txt", "r") as f: matches = [pattern.search(line) for line in f] It works, but it’s painfully slow on large datasets. I tried using find all instead of search, but it didn’t help much.

2 comments