Releases: SKA-ScienceDataProcessor/AdiosStMan
AdiosStMan v0.7.1
Fixed bugs for:
Array write for some data types
Scalar write from multiple MPI processes using ADIOS POSIX method
Added scripts for running on:
Titan at ORNL
Galaxy at Pawsey
Added / changed unit test code
AdiosStMan v0.7
Now compatible with casacore, python-casacore and CASA.
Measurement set table compatibility tested ([SDP Jira tickets] https://jira.ska-sdp.org/browse/PRO-214 ). This was done by:
- duplicating a measurement set using python-casacore's table.copy() with DATA column set to use AdiosStMan;
- run CASA's mstransform on the AdiosStMan measurement set data for frequency split;
- run CASA's mstransform on the original measurement set data for frequency split; and
- check if the two results match.
Other changes / improvements:
- Restructured AdiosStManColumnA and AdiosStManColumnV classes to AdiosStManScaColumn, AdiosStManDirColumn and AdiosStManIndColumn to handle scalar columns, direct array columns and indirect array columns separately.
- Added cache mechanism for reading (scalar column and direct array column).
- Added a FORCE_DIRECT_ARRAY compiler macro to force AdiosStMan to treat any array columns as direct (fixed shape) array columns. This should be only used when users are convinced that a non-fixed-shape array column actually hold fixed-shape array data. For example, a measurement set table defines its DATA column as a non-fixed-shape array column whereas in most cases the data stored within this column is fixed-shape. In this case, when duplicating the measurement set table with FORCE_DIRECT_ARRAY enabled, AdiosStMan will treat the DATA column as a direct (fixed-shape) array column, and thus the performance can be improved significantly compared with treating it as an indirect array column.
- Added logging for debug use.
- And other minor changes...
AdiosStMan v0.6
The first release that supports casacore 2.0 interface, and the first version compatible with both casacore and CASA (casapy).
AdiosStMan v0.5
This is probably the last release based on casacore 1.7.0. Will move to casacore 2.x.
AdiosStMan v0.4.13
v0.4.13 - Added Slurm job scripts to benchmark ms_converter
AdiosStMan v0.1.11
This release only supports writing casa tables with scalar and direct array columns. It has been intensively tested on the iVEC Fornax supercomputer.