armlet.data package

Subpackages

• armlet.data.cleaning package
  • Subpackages
    • armlet.data.cleaning.missing_values package
      • Module contents
  • Module contents
    • DataCleaningMethod
      • DataCleaningMethod.clean_client_errors()
      • DataCleaningMethod.clean_errors()
      • DataCleaningMethod.clean_errors_dataloader()
      • DataCleaningMethod.clean_server_errors()
      • DataCleaningMethod.compute_cleaning_metrics()
      • DataCleaningMethod.count_n_samples_by_sensitive_attributes()
      • DataCleaningMethod.init_counters()
    • compute_global_stat_values()
    • data_cleaning_pipeline()
• armlet.data.processing package
  • Submodules
    • armlet.data.processing.feature_encoding module
      • one_hot_encoding_pipeline()
      • transform_data_with_one_hot_encoding()
    • armlet.data.processing.format_conversion module
      • convert_bool_and_cat_to_num()
      • convert_dataframes_to_tensors()
      • convert_tensors_to_fast_data_loaders()
      • convert_tensors_to_fluke_data_format()
    • armlet.data.processing.image_loading module
      • load_and_convert_images_to_tensors()
      • load_images_tensor_from_df()
    • armlet.data.processing.normalization module
      • normalization_pipeline()
      • transform_data_with_scaler()
    • armlet.data.processing.utils module
      • apply_processing_to_data()
      • merge_all_X_data()
  • Module contents
    • data_processing_pipeline()

Submodules

• armlet.data.datasets module
  • load_ARS_dataset()
  • load_Adult_dataset()
  • load_CelebA_dataset()
  • load_DC_dataset()
  • load_FairFace_dataset()
  • load_Heart_dataset()
  • load_KDD_dataset()
  • load_MEPS_dataset()
• armlet.data.loading module
  • load_data_from_folder()
  • load_pkl_data()
  • load_pt_data()
• armlet.data.saving module
  • save_data()
  • save_data_to_pkl()
  • save_tensors_to_pt()
• armlet.data.splitter module
  • ArmletDataSplitter
    • ArmletDataSplitter.assign()
    • ArmletDataSplitter.iid()
    • ArmletDataSplitter.label_dirichlet_skew()
    • ArmletDataSplitter.safe_label_dirichlet_skew()
  • DummyDataSplitter
    • DummyDataSplitter.assign()
• armlet.data.utils module
  • dataframe_safe_train_test_split()
  • dataframe_train_test_split()

Module contents

This module contains the data components for armlet.

armlet.data.data_pipeline(cfg: DDict) → Tuple[DummyDataSplitter, dict]

Launch the data pipeline before performing the FL training process.

Parameters:

cfg (DDict) – configuration dict.

Returns:

the DummyDataSplitter and a dict with val data.

Return type:

Tuple[DummyDataSplitter, dict]