How to use data subscription

Overview

The Data Model is updated in line with the release process for the wholesale system. The release cycle is normally every six months and usually there are changes to the Data Model, for example, new tables and new columns added to existing tables. After each new release of the Data Model, you use Data Subscription to:

For help upgrading, see Upgrading a Data Interchange environment.

    AEMO recommends subscribing to all files and activating or deactivating them so you have greater flexibility to access historical data.

  1. Download and apply scripts to upgrade your existing database to the latest version of the Data Model.
  2. Check if there are any new files to subscribe to. For help, see Files not subscribed to on page 1.
  3. Check if there are any Legacy (redundant) files your are subscribed to. If yes, load the new versions of the files into your local DBMS at least once before unsubscribing. For an example of Legacy files, see .
  4. Unsubscribe from Legacy files. For help, see.Unsubscribe from legacy files.
  5. Download any upgrades to the Data Interchange software (pdrLoader and pdrBatcher). For help, see Release Schedules and Technical Specifications.

To receive the new release data, participants must keep their Data Model version in line with AEMO's. AEMO only supports the current and previous versions of software.

Populating a new DBMS

You use Baseline Data to populate a new Data Interchange environment. The data is in the same folder as the participant ID’s file server folders. AEMO updates the \MarketData\Baseline folder daily with current baseline data.

Historical data

Older files are moved to the Reports Archive and kept for 13 months. The data is in csv format and conforms to the Data Model. To obtain historical data, see http://www.nemweb.com.au/Reports/ARCHIVE/.

Data Model documentation

You can find detailed explanation of the packages, tables, and files in the following documentation:

  • Data Model Report: Describes all packages and tables.
  • Data Model table to file to report relationships: describes the relationships between packages, tables, and files.

    • For details about other Data Interchange documents, see Data Interchange Help.