smart-open

Utils for streaming large files (S3, HDFS, GCS, Azure Blob Storage, gzip, b..

Here are some articles that you may find helpful