daops package

Dataset-Aware Operations.

daops._config_cached()

daops.config_()

Subpackages

• daops.catalog package
  • IntakeCatalog
    • IntakeCatalog._query()
    • IntakeCatalog.catalog
    • IntakeCatalog.load()
  • get_catalog()
  • Submodules
  • daops.catalog.base module
    • Catalog
      • Catalog._query()
      • Catalog.search()
    • Result
      • Result._records()
      • Result.download_urls()
      • Result.files()
      • Result.matches
    • make_list()
  • daops.catalog.intake module
    • IntakeCatalog
      • IntakeCatalog._query()
      • IntakeCatalog.catalog
      • IntakeCatalog.load()
  • daops.catalog.util module
    • parse_time()
• daops.data_utils package
  • Submodules
  • daops.data_utils.attr_utils module
    • add_global_attrs_if_needed()
    • edit_global_attrs()
    • edit_var_attrs()
    • remove_coord_attr()
  • daops.data_utils.common_utils module
    • handle_derive_str()
  • daops.data_utils.coord_utils module
    • add_coord()
    • add_scalar_coord()
    • squeeze_dims()
  • daops.data_utils.var_utils module
    • add_data_var()
• daops.ops package
  • Submodules
  • daops.ops.average module
    • average_over_dims()
    • average_shape()
    • average_time()
  • daops.ops.base module
    • Operation
      • Operation._consolidate_collection()
      • Operation._resolve_params()
      • Operation.calculate()
      • Operation.get_operation_callable()
  • daops.ops.regrid module
    • regrid()
  • daops.ops.subset module
    • subset()
• daops.utils package
  • Submodules
  • daops.utils.base_lookup module
    • Lookup
      • Lookup._convert_id()
      • Lookup.convert_to_ds_id()
  • daops.utils.common module
    • _logging_examples()
    • enable_logging()
  • daops.utils.consolidate module
    • consolidate()
    • get_files_matching_time_range()
    • get_year()
    • get_years_from_file()
    • to_year()
  • daops.utils.core module
    • Characterised
      • Characterised.lookup_characterisation()
    • _wrap_sequence()
    • is_characterised()
    • open_dataset()
  • daops.utils.fixer module
    • Fixer
      • Fixer._gather_fixes()
      • Fixer._lookup_fix()
    • FuncChainer
  • daops.utils.normalise module
    • ResultSet
      • ResultSet.add()
    • normalise()
  • daops.utils.testing module
    • ContextLogger
    • get_esgf_file_paths()
    • write_roocs_cfg()

Submodules

daops.cli module

Console script for daops.

daops.cli.check_env()

Check that ROOCS_CONFIG points to a valid config file.

Although for certain types of invalid file, in fact main is never called, so exit might not always be graceful in these cases. Call this after get_params() so that ‘help’ still works even if this is not set.

daops.cli.get_params(args)

Get the parameters.

daops.cli.main()

Console script for daops.

daops.cli.parse_args()

Parse the command line arguments.

daops.processor module

Module to dispatch the processing operation to the correct mode (serial or parallel).

daops.processor.dispatch(operation, dset, **kwargs)

Dispatch the operation to the correct mode (serial or parallel).

daops.processor.process(operation, dset, mode='serial', **kwargs)

Run the processing operation on the dataset in the correct mode (in series or parallel).