If that much data is being collected it's time to start asking what we're looking for within it, and if the rate of collection, retention, and range if inputs is worth it.
Maybe it only makes sense to store sections which deviate in a significant way from a range of error (lossy compression).
Maybe some of those inputs just don't make sense for the questions being asked.
A concrete reasoning for why the data should be kept needs to be presented, and THAT is what should call for the funding to back that need.
Maybe it only makes sense to store sections which deviate in a significant way from a range of error (lossy compression).
Maybe some of those inputs just don't make sense for the questions being asked.
A concrete reasoning for why the data should be kept needs to be presented, and THAT is what should call for the funding to back that need.