The GVSU Offshore Wind Assessment Project buoy generates approximately 20 gigabytes of raw, longitudinal data each year. It has been running from the end of 2011 to early 2014 with potentially continuing operation for several years. Our data warehousing measures receives the data as unindexed files with loosely defined variable sets to an organized database with standardized message types and date span folders. In order to utilize and share our large data most efficiently, we created a streamlined database file structure for internal analytical use and a web based data retrieval system for portable external environment use.
Spoelma, Tyson, "Staged Data Warehousing with Gigabytes of Longitudinal Data" (2014). 2014 Presentations. 14.