Datasource Tools

Overview

Datasource Tools is a toolbox for processing and converting original time-series data imported into Ecoplot into various secondary data by resampling, accumulating, or missing values handling, etc.

Example of processing time-series data in Datasource Tools tab
Example of processing time-series data in Datasource Tools tab
1
Resample

Resample offers a tool to compress time-series data by summarize or average time series data over a new time period.

Example of resampling time-series data
Example of resampling time-series data
Select data to resample

Click the Datasource button on the upper left area of the screen and select the data to resample.

Datasource selection menu
Datasource selection menu
Select resample level and method

On the upper center area of the screen, select resample level and method.

Resample configuration
Resample configuration
Preview and save data

Preview the processed data and click the Save button on the upper right corner of the screen to save the processed data as a new datasource. The newly added datasource can be used right away.

Save data button
Save data button
2
Merge

Merge is a tool for merging multiple time-series data into one datasource. Missing values, which may appear due to differences in time indexes, will be treated as NA.

Example of merging time-series data
Example of merging time-series data
Select or import data to merge

Click the Datasource button on the upper left area of the screen and select the datasources to merge. You can also import files from your computer by clicking the Import button.

Datasource selection menu and Import button
Datasource selection menu and Import button
Preview and save data

Once the datasources are successfully selected, they will be automatically merged right away. Preview the merged data, then enter a name for it and click the Save button on the upper right corner of the screen to save the merged data as a new datasource. The newly added datasource can be used right away.

Enter file name to save merged data
Enter file name to save merged data
3
Stationarity

Stationarity tool computes time series with a specified lag.

Example of processing time-series data using the Stationarity tool
Example of processing time-series data using the Stationarity tool
Select data to calculate

Click the Datasource button on the upper left area of the screen and select the data to calculate.

Datasource selection menu
Datasource selection menu
Configure offset

On the upper center area of the screen, specify an offset level for stationarity to start calculating. The value must be a positive integer.

Offset configuration
Offset configuration
4
Missing Values

Missing Values is a tool for handling missing values (or "NA") by filling or removing them from your data.

Example of handling missing values in time-series data
Example of handling missing values in time-series data
Select data to process

Click the Datasource button on the upper left area of the screen and select the data to process.

Datasource selection menu
Datasource selection menu
Select method

On the upper center area of the screen, select a method to process missing values.

Missing values handling methods
Missing values handling methods

How different methods work is described below:

  • Zero: fill all missing values by 0
  • Forward: fill missing values by the value of the data entry before them
  • Backward: fill missing values by the value of the data entry after them
  • Linear interpolation: fill missing values based on the value of all data entries of the same data item
  • Cubic spline interpolation: fill missing values almost in the same way as linear interpolation but more smoothly
  • Remove: remove all time indexes that contain NA value
5
Formula

Formula is a useful tool for adding new data entries that are calculated based on existing data.

Example of processing time-series data using the Formula tool
Example of processing time-series data using the Formula tool
Select data to calculate

Click the Datasource button on the upper left area of the screen and select the data to calculate.

Datasource selection menu
Datasource selection menu
Add blank column

Click the Add Column button on the upper left area of the screen to add a blank column to the end of the data table. Calculated data will be written into this column. You can add multiple columns at the same time.

Add Column button
Add Column button
Enter formula

On the calculator panel on the right side of the screen, enter your formula, and then click the "=" button to calculate and show result. If you have multiple blank columns added, you should specify the one for each formula.

Calculator panel
Calculator panel

If your original datasource contains missing values (or "NA"), you can check the option "Treat "NA" as 0" so that all NA values will be assigned to value 0 when being calculated.

6
Unit Converter

Unit Converter is used for calculating data of one unit into those of other unit. Currently, Ecoplot supports converting units of the following types: time, distance, mass, velocity, volume, area, and temperature.

Example of processing time-series data using the Unit Converter tool
Example of processing time-series data using the Unit Converter tool
Select data to calculate

Click the Datasource button on the upper left area of the screen and select the data to calculate.

Datasource selection menu
Datasource selection menu
Add blank column

Click the Add Column button on the upper left area of the screen to add a blank column to the end of the data table. Calculated data will be written into this column. You can add multiple columns at the same time.

Select source column and converter

On the converter panel on the right side of the screen, select a source column, choose a suitable unit converter, and then click the Calculate button to convert and show result. If you have multiple blank columns added, you should specify the one for each converting attempt.

Converter panel
Converter panel
7
Cumulative

Cumulative is a tool for adding cumulative data to an existing datasource. Cumulative data are calculated by accumulating data entries of a column in the original datasource table.

Example of processing time-series data using the Cumulative tool
Example of processing time-series data using the Cumulative tool
Select data to calculate

Click the Datasource button on the upper left area of the screen and select the data to calculate.

Datasource selection menu
Datasource selection menu
Add blank column

Click the Add Column button on the upper left area of the screen to add a blank column to the end of the data table. Calculated data will be written into this column. You can add multiple columns at the same time.

Select source column to calculate

On the upper left area of the screen, select a source column from the Select Column drop-down menu. Cumulative data will be calculated and written into the added column right after a source column is specified. If you have multiple blank columns added, you should specify the one for each calculating attempt.

Select Column menu
Select Column menu
Specify the number of samples

You can configure the number of samples will be used for calculating cumulative data by specifying any integer value in "Number of samples" settings. Leave the field blank or enter value "0" to reset this setting to default.

Number of samples configuration
Number of samples configuration
8
Outlier Removal

Outlier Removal offers a tool for handling data entries that fall outside of a specified data range.

Example of processing time-series data using the Outlier Removal tool
Example of processing time-series data using the Outlier Removal tool
Select data to process

Click the Datasource button on the upper left area of the screen and select the data to process.

Datasource selection menu
Datasource selection menu
Enter minimum and maximum values and select handling method

On the upper center area of the screen, specify your own data range by enter minimum and maximum values, which will be visualized on the preview plot with 2 straight dotted lines. After that, select a removal method to preview new data.

Outlier removal configuration
Outlier removal configuration

How different removal methods work is described below:

  • Min-max: Based on the fact that outliers fall beyond the minimum or maximum value of the specified data range, they will be assigned the respective value.
  • Zero: All outliers will be treated as 0.
  • Remove: All outliers will be treated as NA.