NSA’s Yottabytes of Data

Aerial view of NSA HQ at Fort Meade, via NSA

The NSA is building two new storage facilities to house yottabytes of data. One in Utah and one in Texas. The scale is staggering. There are a thousand gigabytes in a terabyte, a thousand terabytes in a petabyte, a thousand petabytes in an exabyte, a thousand exabytes in a zettabyte, and a thousand zettabytes in a yottabyte. A yottabyte is 1,000,000,000,000,000 GB¹.

This data is mostly pocket litter: trillions of phone calls, email messages, web searches, parking receipts, bookstore visits, and other data trails.

The issue is critical because at the NSA, electrical power is political power. In its top-secret world, the coin of the realm is the kilowatt. More electrical power ensures bigger data centers.

Does this scare you? As for myself, no. As a mathematician, I’ve often fantasized working at the NSA. From the article, it seems like they don’t have enough supercomputing power to deal with the vasts amounts of data that they are harnessing and storing.

I like the term infoweapons used in this article. Infoweapons are supercomputers running complex algorithmic programs.

On a remote edge of Utah’s dry and arid high desert, where temperatures often zoom past 100 degrees, hard-hatted construction workers with top-secret clearances are preparing to build what may become America’s equivalent of Jorge Luis Borges’s “Library of Babel,” a place where the collection of information is both infinite and at the same time monstrous, where the entire world’s knowledge is stored, but not a single word is understood. At a million square feet, the mammoth $2 billion structure will be one-third larger than the US Capitol and will use the same amount of energy as every house in Salt Lake City combined.

Unlike Borges’s “labyrinth of letters,” this library expects few visitors. It’s being built by the ultra-secret National Security Agency—which is primarily responsible for “signals intelligence,” the collection and analysis of various forms of communication—to house trillions of phone calls, e-mail messages, and data trails: Web searches, parking receipts, bookstore visits, and other digital “pocket litter.” Lacking adequate space and power at its city-sized Fort Meade, Maryland, headquarters, the NSA is also completing work on another data archive, this one in San Antonio, Texas, which will be nearly the size of the Alamodome.

Just how much information will be stored in these windowless cybertemples? A clue comes from a recent report prepared by the MITRE Corporation, a Pentagon think tank. “As the sensors associated with the various surveillance missions improve,” says the report, referring to a variety of technical collection methods, “the data volumes are increasing with a projection that sensor data volume could potentially increase to the level of Yottabytes (1024 Bytes) by 2015.”[1] Roughly equal to about a septillion (1,000,000,000,000,000,000,000,000) pages of text, numbers beyond Yottabytes haven’t yet been named. Once vacuumed up and stored in these near-infinite “libraries,” the data are then analyzed by powerful infoweapons, supercomputers running complex algorithmic programs, to determine who among us may be—or may one day become—a terrorist. In the NSA’s world of automated surveillance on steroids, every bit has a history and every keystroke tells a story.

Author: range

I'm mathematician/IT strategist/blogger from Canada living in Taipei.

7 thoughts on “NSA’s Yottabytes of Data”

  1. Man that is so terribly messed up. First, this is obviously going to be used to store biometric data and with the amounts being discussed the could probably create a profile of just about every person in the so called “developed” world. Secondly, I can’t believe you don’t have a problem with this as our government is run at the highest levels by corrupt corporate fascist, not the type of folks I would want to work for even if they do employ more mathematicians than any other organization on the planet.

    gaia punk

    I write at http://www.punkrockpermaculture.com

  2. Well, I’m Canadian and our privacy laws are very strict. This reassures me. I don’t like the fact that the data is stored, but I can understand the reasons why. It’s sort of leading to a Big Brother type of thing.

  3. No it already is a big brother thing everything that happens in 1984 has already happened….
    for example
    torture,
    secret prisons,
    constant surveillance,
    wars to no end,
    propaganda machines,
    the distraction of the masses,
    all of it.

    And you really want to work for these people? I guess if you agree with everything the government does Tar sands, clear cutting, stepping on indigenous rights, mining subsides, bending over backwards for the US, ect , well your fine, but if you disagree in anyway then your a suspect and suspicious people have to be watched right? The funny thing is surveillance doesn’t make society safer just look at the London underground bombing which took place in the most watched city in the world “ironically” during a training event looking for bomb threats.

  4. Actually, I’d probably like working more for a university doing math research than the NSA, but you never know.

    They tried doing the same thing in the UK and it was stopped. This wouldn’t work in Canada, but I have no doubt that the NSA spies on Canadians as well.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s