Processing Large Data Files

A number of functions have been modified to improve dealing with large data files. Large data files are files with more than one million data points per channel and up to some hundred million data points per channel.

Some notes about dealing with large datasets:

• Select the netCDF-up file format. The format can be enabled in the Tools=>More Options dialog box under “Data Import and Data Browser”. The files are usually much smaller than standard netCDF files and easier to modify.

  

• The number of data points that are loaded into a datasets can be limited, for example, to 1 million points in the Tools=>More Options dialog box.

  When the memory required to create a dataset is larger than the available memory, an out of memory error occurs. In this case, the number of data points can be reduced in the Tools=>More Options dialog box.

  If you have data with multi-million points and you would like to load a certain range from the data, use the browser to scroll to the first data point or use Ctrl+G to go to the first data row (for example, row 5,000,000) and then press Load. UniPlot will start the import at the first visible row.

• If the dataset was loaded from a large data file, you can change the x-axis range and reload the data for the range using the “Reload-Button” (see Toolbar=>Scaling).

  

• You should use the command File=>Close (Save Compact) from time to time to remove unused file sections.

_id-426410