Python useful library collections

  1. Web Spider
  2. Terminal

Web Spider

requests
lxml
scrapy
scrapy-redis
scrapy-redis-bloomfilter

Terminal

# terminal interaction
fire
# show progess
tqdm