Projects

Bulk Downloads

Skills
Redis Node.js / Express Amazon Web Services
Company
Katerra

Wrote a bulk downloads service to download large files from Azure Blob Storage and S3 where each request would be offloaded to a Redis queue with a worker processing the tasks sequentially. The code was hosted on an EC2 with a 30GB EBS volume attached to it. The transfer from S3 to the EC2 was exceptionally fast since they were placed in the same VPC. The customer requesting the download would receive a mail with a link to download the zipped files.