I am interested in developing a python CLI app which efficiently downloads a large number of image URLs (http/https protocols). I am currently using the tool aria2c (https://aria2.github.io/) which appears to be decent. However, I wish to put together a python application leveraging big data technologies (Are AWS spot instances a good choice for this type of application?) to develop a downloader program which is concurrent and possibly even distributed. What would you recommend I take a look at? I am willing to put in the required effort to learn as well as release the code as open source for the community. Thanks in advance for your suggestions/help.