We answer your questions about what this migration means to you!
Every day, people depend upon NOAA data in ways they don’t even think about. From building better homes to the products you see on store shelves, NOAA data helps drive our scientific research, resource management and economy. Now that information will be easier to access than ever as NOAA NCEI moves its data to the cloud!
What can you expect from this modernization effort? We answer your questions below:
First things first. What is NOAA NCEI?
NOAA’s National Centers for Environmental Information (NCEI) houses one of the largest collections of environmental data in the world. More specifically, NCEI archives over 229 terabytes of data each month from more than 130 observing platforms. This provides an ever-expanding repository of atmospheric, oceanic, geophysical and climate data used daily by researchers, emergency managers, businesses and communities across the U.S. and the globe.
When is the data being moved to the cloud?
In one of the largest undertakings in its history, NCEI will migrate all of its data, products, and services to the cloud over the next 10 months. Data and applications housed in servers at locations in Asheville, North Carolina and Boulder, Colorado, will be migrated (moved) to the Amazon Web Services (AWS) Cloud. During the migration, data will still be accessible via normal access locations and methods. Once the migration is complete, you will continue to access the data via the NCEI website.
Why is the data being moved to the cloud?
Fully-cloud based datasets will make it easier and faster to test and release new products for customers and industry. This will enable NCEI, one of the pillars of the Department of Commerce, considered “America’s Data Agency,” to lead in the global digital economy.
It is extremely time consuming and resource intensive to download NOAA’s largest datasets from physical servers for every use. Cloud-based data means no download is necessary—data is available on-demand, which is key for artificial intelligence and machine learning uses.
The transition away from relying solely on physical servers to preserve data and science products will mean vital information is more secure and protected. The move to the cloud will also necessitate the use of virtual servers rather than physical ones, because even top-of-the-line computer hardware eventually wears out and fails. Virtual servers are much easier to upgrade and maintain to keep pace with the latest technology, providing the best possible service.
Through the entire migration process, NCEI will continue its legacy of impeccable data stewardship and gold standard science. Benefits of the migration will include more modern and optimized public access. This is especially true for large datasets and artificial intelligence applications.
How does the migration work?
The NCEI cloud migration will use a process known as “lift and shift”. NCEI’s data, products and services will be “lifted” from their current location in on-premise servers and “shifted” directly to the AWS cloud. Teams that include NCEI experts will then ensure that all of the critical products customers rely on are functioning, and the integrity of the data is maintained.
Immediately upon completion of the “lift and shift,” NCEI will enter immediately into a “modernization and optimization” phase, integrating seamlessly into the NESDIS Cloud System and Common Cloud Framework. This will allow NCEI to effectively leverage NESDIS common data services, resulting in both better and more efficient data service to the public.
Will I notice the migration happening?
Preserving the integrity of the data, products and services NCEI provides for the nation is the key goal of the migration. Occasional and temporary data delays may occur throughout the 10-month process, but users will be notified with as much advance notice as possible. Keep an eye on the NCEI home page and product pages for notifications.
I use NCEI data frequently. Where can I get more information?
If you need more technical information about the cloud migration and its potential impacts, please see individual product pages or our in-depth Frequently Asked Questions page.
