Class foreign_storage::LocalMultiFileReader¶

class LocalMultiFileReader : public foreign_storage::MultiFileReader ¶

Public Functions

LocalMultiFileReader(const std::string &file_path, const import_export::CopyParams &copy_params, const std::optional<std::string> &regex_path_filter, const std::optional<std::string> &file_sort_order_by, const std::optional<std::string> &file_sort_regex)¶

LocalMultiFileReader(const std::string &file_path, const import_export::CopyParams &copy_params, const rapidjson::Value &value)¶

void checkForMoreRows(size_t file_offset, const ForeignServer *server_options, const UserMapping *user_mapping)¶

Rescan the target files Throws an exception if the rescan fails (ie files are not in a valid appended state or not supported)

Parameters

file_offset: - where to resume the scan from (end of the last row) as not all of the bytes may have been consumed by the upstream compoennet
server_options: - only needed for S3 backed files
user_mapping: - only needed for S3 backed files

Private Functions