The EDX Development team has created the EDX BRIDGE Toolset (Bulk Record Integration, Directory & metadata Generation for EDX) to facilitate the ingestion of large datasets into EDX. This toolset, used internally by the EDX Dev team, comprises several new EDX API functions and multiple custom scripts.

Custom scripts are a key component of the BRIDGE toolset. They are specifically designed for data preparation and ingestion into EDX from the temporary GCP bucket and for creating the EDX metadata and records necessary for successful data ingestion. These scripts work in tandem with the new EDX API functions, which enable users to create both public and private submissions, finalize them, and submit them.

If you have a large dataset for inclusion into EDX, please reach out to EDX support at edxsupport@netl.doe.gov.