How to use Data Subscription

Overview

The Data Model The definition of the interface to participants of data published by AEMO for gas or electricity. A database conforming to the Data Model can contain a local copy of all current participant-specific data recorded in the main database. The Data Model includes database tables, indexes, and primary keys. is updated in line with the release process for the wholesale system. The release cycle is normally every six months and usually there are changes to the Data Model, for example, new tables and new columns added to existing tables. After each new release of the Data Model, you use Data Subscription A web application in the Markets Portal used to subscribe to Data Interchange files and to obtain the latest MMS Data Model. These files are typically csv files containing public data and participant’s private data. AEMO recommends participant use of the Data Interchange suite of products, supplied by AEMO, to automate receiving and storage of the files to their systems. AEMO provides working sample software for FTP access (Participant Batcher) to MarketNet and working sample software for Data Interchange. to:

For help upgrading, see Upgrading a Data Interchange environment.

    AEMO recommends subscribing to all files and activating or deactivating them so you have greater flexibility to access historical data.

  1. Download and apply scripts to upgrade your existing database to the latest version of the Data Model.
  2. Check if there are any new files to subscribe to. For help, see Files not subscribed to.
  3. Check if there are any Legacy (redundant) files your are subscribed to. If yes, load the new versions of the files into your local DBMS at least once before unsubscribing. For an example of Legacy files, see Figure 23.
  4. Unsubscribe from Legacy files. For help, see.Unsubscribe from Legacy files.
  5. Download any upgrades to the Data Interchange software (pdrLoader and pdrBatcher). For help, see Release Schedules and Technical Specifications.

To receive the new release data, participants must keep their Data Model version in line with AEMO's. AEMO only supports the current and previous versions of software.

Populating a new DBMS

You use Baseline Data to populate a new Data Interchange A set of cooperating applications used to replicate data between AEMO's energy market systems and a participant's DBMS conforming to the MMS Data Model. environment. The data is in the same folder as the participant ID’s file server folders. AEMO Australian Energy Market Operator updates the \MarketData\Baseline folder daily with current baseline data.

Historical data

Older files are moved to the Reports Archive and kept for 13 months. The data is in csv Comma Separated Values. A file format for data using commas as delimiters. format and conforms to the Data Model. To obtain historical data, see http://www.nemweb.com.au/Reports/ARCHIVE/.

Data Model documentation

You can find detailed explanation of the packages, tables, and files in the following documentation:

  • Data Model Report: Describes all packages and tables.
  • Data Model table to file to report relationships: describes the relationships between packages, tables, and files.

    • For details about other Data Interchange documents, see Data Interchange Help.