Add harvest sources
Connect external data sources to automatically import and synchronise datasets into your GDI Data Catalogue. The process is the same for all source types—only the configuration differs.
All datasets must belong to an organisation. Before adding a harvest source, ensure the managing organisation exists in the system. If not, create an organisation first.
In this guide
Identify your source type
Add a harvest source
Configure source settings
Identify your source type
The GDI Data Catalogue supports three harvest source types:
- FAIR data points: Import from research data repositories following FAIR principles. Example: Health-RI↗
- Generic DCAT RDF: Import from European public sector data portals. Example: OpenData.swiss↗
- CKAN catalogue: Import from partner CKAN instances. Example: Partner institution catalogues, regional data hubs
Add a harvest source
-
Go to Harvest Sources and select Add Harvest Source.
-
Fill out the harvest source form based on the source type you are connecting to.
Field Description URL The source endpoint URL. See the URL formats for different sources in the source-specific pages Title A descriptive name for this harvest source Name A unique URL-friendly identifier for this source. This becomes part of the harvest source's URL path. Source type The appropriate harvester for your source. See the source-specific configuration for your source type. Update frequency How often the harvest runs:
• Manual: You must select Reharvest each time
• Daily: Runs at the end of each day
• Weekly: Runs at the end of each week
• Biweekly: Runs every two weeks
• Monthly: Runs at the end of each month
• Always: Runs continuouslyConfiguration Enter the source-specific configurations Organisation The organisation that will own the imported datasets -
Select Save to create the harvest source.
Use manual harvest to test new configuration changes, import urgent dataset updates, or verify the harvest after fixing an issue.
Configure source settings
Select your source type for detailed configuration instructions:
- FAIR data points: Research data repositories following FAIR principles.
- HealthDCAT-AP endpoints: European data portals using HealthDCAT-AP standard.