Managing csv files

Activating and deactivating are different from subscribing and unsubscribing.

This section explains the difference between activation, deactivation, subscribing, and unsubscribing.

Subscribing

AEMO recommends subscribing to all files and activating or deactivating them so you have greater flexibility to access historical data.

Subscribing means subscribing to files in the Data Subscription A web application in the Markets Portal used to subscribe to Data Interchange files and to obtain the latest MMS Data Model. These files are typically csv files containing public data and participant’s private data. AEMO recommends participant use of the Data Interchange suite of products, supplied by AEMO, to automate receiving and storage of the files to their systems. AEMO provides working sample software for FTP access (Participant Batcher) to MarketNet and working sample software for Data Interchange. web application allowing delivery of the files to your participant folder on AEMO Australian Energy Market Operator's Participant File Server The publishing point from AEMO systems to participant systems. Each participant is allocated an account and access to private and public areas. Participants are responsible for interfacing with the participant file server. where the pdrBatcher Software responsible for transferring files to and from AEMO's participant file server to the participant's local Data Interchange folders. It can be installed in any environment supporting Java. software can move them to your local folder.

The files remain on AEMO's Participant File Server for approximately six months.

Unsubscribing

Unsubscribing from files means they are not delivered to your participant folder on AEMO's Participant File Server.

AEMO systems keep an archive of all subscribed-to files for approximately six months. Unsubscribing from files in the Data Subscription web application means you cannot access six months of historical files in the future.

Activate

Once the files arrive at your site, you can activate them so the pdrLoader Software responsible for loading files to and from participant's local Data Interchange folders to the participant's DBMS. It can be installed in any environment supporting Java. loads them into your local Data Model The definition of the interface to participants of data published by AEMO for gas or electricity. A database conforming to the Data Model can contain a local copy of all current participant-specific data recorded in the main database. The Data Model includes database tables, indexes, and primary keys. database. If they are not activated, they remain in the folder at your local site.

Deactivate

Deactivating the files stops them loading into your local Data Model database. It does not stop the delivery of the files to your local folder.

If you deactivate a file without unsubscribing, then AEMO continues to keep an archive of the file so you can retrieve and load it in the future.

If you unsubscribe from a file, it is not possible to retrieve and load in the future.

Replication Manager

For help, see Replication Manager User Guide.

AEMO provides the Replication Manager software, a Windows-based application that runs locally, to activate or deactivate the loading of .csv Comma Separated Values. A file format for data using commas as delimiters. files into their local Data Model database.