I know memory is fairly cheap but e.g. there are millions of new videos on youtube everyday, each probably few hundred MBs to few GBs. It all has to take enormous amount of space. Not to mention backups.
I know memory is fairly cheap but e.g. there are millions of new videos on youtube everyday, each probably few hundred MBs to few GBs. It all has to take enormous amount of space. Not to mention backups.
Three additional things that you have to keep in mind are that:
1 - Enterprise storage is much, much denser (as in, capacity per physical space occupied) than you would expect.
2 - These systems have capacity recovery features (primarily compression and deduplication) that save a lot more storage than you would expect.
3 - The elements in the infrastructure are periodically refreshed by migrating them to newer infrastructure (think of how you could migrate two old 500GB disks to a single modern 1TB disk to save the physical space of a disk).
As an example about point 1, this is what IBM advertises in their public whitepaper for their Storage Scale systems (https://www.ibm.com/downloads/cas/R0Q1DV1X):
“IBM Storage Scale System is based on proven IBM Storage 2U24 hardware that can be expanded with additional storage enclosures up to 15.4PB of total capacity in a single node and 633YB in a single cluster. You can start with 48TB using half-populated flash nodes or create a fully-populated NVMe flash solution with 24, 2.5” drives in capacities of 3.84TB, 7.68TB, 15.36TB or 30TB. Using the largest capacity 30TB NVMe drives, up to 720TB total flash capacity, in a 2U form factor, along with associated low weight and low power consumption. Adding storage enclosures is easy as up to 8 enclosures (each 4u with 102 drives) can accommodate up to 816 drives of 10TB, 14TB or 18TB or 14.6PB of total raw HDD capacity.”
In short, you end up packing a stupid amount of storage in relatively moderate spaces. Combined with the other two points, it helps keep things somewhat under control. Kinda.