Data Portal Architecture - Revision history

WikiSysop: /* Data flow */

2025-01-30T11:05:25Z

Data flow

← Older revision		Revision as of 13:05, 30 January 2025
Line 10:		Line 10:

	[[File:GGBN Portal Architecture.jpg\|center\|700px]]		[[File:GGBN Portal Architecture.jpg\|center\|700px]]
	'''General data architecture of the GGBN Dta Portal.''' Specimen and DNA sample databases (on top left) are operated by the Network partners. Their data content is structured and provided by using BioCASe or IPT and the GGBN Data Standard extensions. The '''[http://wiki.bgbm.org/bhit/index.php/Main_Page Berlin Harvesting and Indexing Toolkit (click to see documentation)]''' is used to harvest GGBN data and store them in a ~~MySQL~~ database~~. In addition we use a SOLR instance to speed the query~~. After harvesting the data are cleaned and enriched by e.g. a match against certain datasets of the GBIF checklist bank. Finally the data are aggregated from multiple sources in the ~~'''[http://wiki.bgbm.org/gps/index.php/Main_Page data portal (click to see documentation)]'''~~ to be displayed. GGBN offers a web service, documentation will follow soon.		'''General data architecture of the GGBN Dta Portal.''' Specimen and DNA sample databases (on top left) are operated by the Network partners. Their data content is structured and provided by using BioCASe or IPT and the GGBN Data Standard extensions. The '''[http://wiki.bgbm.org/bhit/index.php/Main_Page Berlin Harvesting and Indexing Toolkit (click to see documentation)]''' is used to harvest GGBN data and store them in a MadriaDB database. After harvesting the data are cleaned and enriched by e.g. a match against certain datasets of the GBIF checklist bank. In addition we update the CITES status as this is important for the sample request system. In addition we use a SOLR instance to speed up the query and prepare the data (e.g. aggregate associations, backbone core). Finally the data are aggregated from multiple sources in the Data Portal to be displayed. GGBN offers a web service for basic statistics, the documentation will follow soon.

	=DNA and Tissue Bank databases=		=DNA and Tissue Bank databases=

WikiSysop: /* Data flow */

2017-03-01T13:29:44Z

Data flow

← Older revision		Revision as of 15:29, 1 March 2017
Line 10:		Line 10:

	[[File:GGBN Portal Architecture.jpg\|center\|700px]]		[[File:GGBN Portal Architecture.jpg\|center\|700px]]
	'''General data architecture of the GGBN Dta Portal.''' Specimen and DNA sample databases (on top left) are operated by the Network partners. Their data content is structured and provided by using BioCASe or IPT and the GGBN Data Standard extensions. The '''[http://wiki.bgbm.org/bhit/index.php/Main_Page Berlin Harvesting and Indexing Toolkit (click to see documentation)]''' is used to harvest GGBN data and store them in a MySQL database. In addition we use a SOLR instance to speed the query. After harvesting the data are cleaned and enriched by e.g. a match against certain datasets of the GBIF checklist bank. Finally the data are aggregated from multiple sources in the '''[~~http://~~http://wiki.bgbm.org/gps/index.php/Main_Page data portal (click to see documentation)]''' to be displayed. GGBN offers a web service, documentation will follow soon.		'''General data architecture of the GGBN Dta Portal.''' Specimen and DNA sample databases (on top left) are operated by the Network partners. Their data content is structured and provided by using BioCASe or IPT and the GGBN Data Standard extensions. The '''[http://wiki.bgbm.org/bhit/index.php/Main_Page Berlin Harvesting and Indexing Toolkit (click to see documentation)]''' is used to harvest GGBN data and store them in a MySQL database. In addition we use a SOLR instance to speed the query. After harvesting the data are cleaned and enriched by e.g. a match against certain datasets of the GBIF checklist bank. Finally the data are aggregated from multiple sources in the '''[http://wiki.bgbm.org/gps/index.php/Main_Page data portal (click to see documentation)]''' to be displayed. GGBN offers a web service, documentation will follow soon.

	=DNA and Tissue Bank databases=		=DNA and Tissue Bank databases=

WikiSysop: /* Data flow */

2017-03-01T13:29:25Z

Data flow

← Older revision		Revision as of 15:29, 1 March 2017
Line 10:		Line 10:

	[[File:GGBN Portal Architecture.jpg\|center\|700px]]		[[File:GGBN Portal Architecture.jpg\|center\|700px]]
	'''General data architecture of the GGBN Dta Portal.''' Specimen and DNA sample databases (on top left) are operated by the Network partners. Their data content is structured and provided by using BioCASe or IPT and the GGBN Data Standard extensions. The '''[http://wiki.bgbm.org/bhit/index.php/Main_Page Berlin Harvesting and Indexing Toolkit]''' is used to harvest GGBN data and store them in a MySQL database. In addition we use a SOLR instance to speed the query. After harvesting the data are cleaned and enriched by e.g. a match against certain datasets of the GBIF checklist bank. Finally the data are aggregated from multiple sources in the '''[http://http://wiki.bgbm.org/gps/index.php/Main_Page data portal]''' to be displayed. GGBN offers a web service, documentation will follow soon.		'''General data architecture of the GGBN Dta Portal.''' Specimen and DNA sample databases (on top left) are operated by the Network partners. Their data content is structured and provided by using BioCASe or IPT and the GGBN Data Standard extensions. The '''[http://wiki.bgbm.org/bhit/index.php/Main_Page Berlin Harvesting and Indexing Toolkit (click to see documentation)]''' is used to harvest GGBN data and store them in a MySQL database. In addition we use a SOLR instance to speed the query. After harvesting the data are cleaned and enriched by e.g. a match against certain datasets of the GBIF checklist bank. Finally the data are aggregated from multiple sources in the '''[http://http://wiki.bgbm.org/gps/index.php/Main_Page data portal (click to see documentation)]''' to be displayed. GGBN offers a web service, documentation will follow soon.

	=DNA and Tissue Bank databases=		=DNA and Tissue Bank databases=

WikiSysop: /* Data flow */

2017-03-01T13:28:41Z

Data flow

← Older revision		Revision as of 15:28, 1 March 2017
Line 10:		Line 10:

	[[File:GGBN Portal Architecture.jpg\|center\|700px]]		[[File:GGBN Portal Architecture.jpg\|center\|700px]]
	'''General data architecture of the GGBN Dta Portal.''' Specimen and DNA sample databases (on top left) are operated by the Network partners. Their data content is structured and provided by using BioCASe or IPT and the GGBN Data Standard extensions. The [http://wiki.bgbm.org/bhit/index.php/Main_Page Berlin Harvesting and Indexing Toolkit] is used to harvest GGBN data and store them in a MySQL database. In addition we use a SOLR instance to speed the query. After harvesting the data are cleaned and enriched by e.g. a match against certain datasets of the GBIF checklist bank. Finally the data are aggregated from multiple sources in the portal to be displayed. GGBN offers a web service, documentation will follow soon.		'''General data architecture of the GGBN Dta Portal.''' Specimen and DNA sample databases (on top left) are operated by the Network partners. Their data content is structured and provided by using BioCASe or IPT and the GGBN Data Standard extensions. The '''[http://wiki.bgbm.org/bhit/index.php/Main_Page Berlin Harvesting and Indexing Toolkit]''' is used to harvest GGBN data and store them in a MySQL database. In addition we use a SOLR instance to speed the query. After harvesting the data are cleaned and enriched by e.g. a match against certain datasets of the GBIF checklist bank. Finally the data are aggregated from multiple sources in the '''[http://http://wiki.bgbm.org/gps/index.php/Main_Page data portal]''' to be displayed. GGBN offers a web service, documentation will follow soon.

	=DNA and Tissue Bank databases=		=DNA and Tissue Bank databases=

WikiSysop: /* DNA and Tissue Bank databases */

2015-12-16T16:02:09Z

DNA and Tissue Bank databases

← Older revision		Revision as of 18:02, 16 December 2015
Line 13:		Line 13:

	=DNA and Tissue Bank databases=		=DNA and Tissue Bank databases=
	You can use any database system to manage your DNA or tissue bank. IPT and BioCASe can handle most of them. Please check out [Mandatory_and_recommended_fields_for_sharing_data_with_GGBN \| which parameters] are required to share data via GGBN.		You can use any database system to manage your DNA or tissue bank. IPT and BioCASe can handle most of them. Please check out [[Mandatory_and_recommended_fields_for_sharing_data_with_GGBN \| which parameters]] are required to share data via GGBN.

	The [[DNA_Module \| DNA Module]] has been developed as an open source solution for administer a DNA and tissue bank. A new version is currently planned. Some of our partners are already using it, but you can use any suitable software.		The [[DNA_Module \| DNA Module]] has been developed as an open source solution for administer a DNA and tissue bank. A new version is currently planned. Some of our partners are already using it, but you can use any suitable software.

WikiSysop: /* DNA and Tissue Bank databases */

2015-12-16T16:01:56Z

DNA and Tissue Bank databases

← Older revision		Revision as of 18:01, 16 December 2015
Line 13:		Line 13:

	=DNA and Tissue Bank databases=		=DNA and Tissue Bank databases=
	You can use any database system to manage your DNA or tissue bank. IPT and BioCASe can handle most of them. Please check out [Mandatory_and_recommended_fields_for_sharing_data_with_GGBN which parameters] are required to share data via GGBN.		You can use any database system to manage your DNA or tissue bank. IPT and BioCASe can handle most of them. Please check out [Mandatory_and_recommended_fields_for_sharing_data_with_GGBN \| which parameters] are required to share data via GGBN.

	The [[DNA_Module \| DNA Module]] has been developed as an open source solution for administer a DNA and tissue bank. A new version is currently planned. Some of our partners are already using it, but you can use any suitable software.		The [[DNA_Module \| DNA Module]] has been developed as an open source solution for administer a DNA and tissue bank. A new version is currently planned. Some of our partners are already using it, but you can use any suitable software.

WikiSysop: /* DNA and Tissue Bank databases */

2015-12-16T16:01:46Z

DNA and Tissue Bank databases

← Older revision		Revision as of 18:01, 16 December 2015
Line 13:		Line 13:

	=DNA and Tissue Bank databases=		=DNA and Tissue Bank databases=
	You can use any database system to manage your DNA or tissue bank. IPT and BioCASe can handle most of them. Please check out []Mandatory_and_recommended_fields_for_sharing_data_with_GGBN \| which parameters]] are required to share data via GGBN.		You can use any database system to manage your DNA or tissue bank. IPT and BioCASe can handle most of them. Please check out [Mandatory_and_recommended_fields_for_sharing_data_with_GGBN which parameters] are required to share data via GGBN.

	The [[DNA_Module \| DNA Module]] has been developed as an open source solution for administer a DNA and tissue bank. A new version is currently planned. Some of our partners are already using it, but you can use any suitable software.		The [[DNA_Module \| DNA Module]] has been developed as an open source solution for administer a DNA and tissue bank. A new version is currently planned. Some of our partners are already using it, but you can use any suitable software.

WikiSysop: /* Data flow */

2015-12-16T14:37:50Z

Data flow

← Older revision		Revision as of 16:37, 16 December 2015
Line 10:		Line 10:

	[[File:GGBN Portal Architecture.jpg\|center\|700px]]		[[File:GGBN Portal Architecture.jpg\|center\|700px]]
	'''General data ~~architectur~~ of the GGBN Dta Portal ~~architecture~~.''' Specimen and DNA sample databases (on top left) are operated by the Network partners. Their data content is structured and provided by using BioCASe or IPT and the GGBN Data Standard extensions. The [http://wiki.bgbm.org/bhit/index.php/Main_Page Berlin Harvesting and Indexing Toolkit] is used to harvest GGBN data and store them in a MySQL database. In addition we use a SOLR instance to speed the query. After harvesting the data are cleaned and enriched by e.g. a match against certain datasets of the GBIF checklist bank. Finally the data are aggregated from multiple sources in the portal to be displayed.		'''General data architecture of the GGBN Dta Portal.''' Specimen and DNA sample databases (on top left) are operated by the Network partners. Their data content is structured and provided by using BioCASe or IPT and the GGBN Data Standard extensions. The [http://wiki.bgbm.org/bhit/index.php/Main_Page Berlin Harvesting and Indexing Toolkit] is used to harvest GGBN data and store them in a MySQL database. In addition we use a SOLR instance to speed the query. After harvesting the data are cleaned and enriched by e.g. a match against certain datasets of the GBIF checklist bank. Finally the data are aggregated from multiple sources in the portal to be displayed. GGBN offers a web service, documentation will follow soon.

	=DNA and Tissue Bank databases=		=DNA and Tissue Bank databases=

WikiSysop: /* Data flow */

2015-12-16T14:37:06Z

Data flow

← Older revision		Revision as of 16:37, 16 December 2015
Line 10:		Line 10:

	[[File:GGBN Portal Architecture.jpg\|center\|700px]]		[[File:GGBN Portal Architecture.jpg\|center\|700px]]
	'''General data architectur of the GGBN Dta Portal architecture.''' Specimen and DNA sample databases (on top left) are operated by the Network partners. Their data content is structured and provided by using BioCASe or IPT and the GGBN Data Standard extensions. The [[http://wiki.bgbm.org/bhit/index.php/Main_Page \| Berlin Harvesting and Indexing Toolkit]] is used to harvest GGBN data and store them in a MySQL database. In addition we use a SOLR instance to speed the query. After harvesting the data are cleaned and enriched by e.g. a match against certain datasets of the GBIF checklist bank. Finally the data are aggregated from multiple sources in the portal to be displayed.		'''General data architectur of the GGBN Dta Portal architecture.''' Specimen and DNA sample databases (on top left) are operated by the Network partners. Their data content is structured and provided by using BioCASe or IPT and the GGBN Data Standard extensions. The [http://wiki.bgbm.org/bhit/index.php/Main_Page Berlin Harvesting and Indexing Toolkit] is used to harvest GGBN data and store them in a MySQL database. In addition we use a SOLR instance to speed the query. After harvesting the data are cleaned and enriched by e.g. a match against certain datasets of the GBIF checklist bank. Finally the data are aggregated from multiple sources in the portal to be displayed.

	=DNA and Tissue Bank databases=		=DNA and Tissue Bank databases=

WikiSysop: /* Data flow */

2015-12-16T14:29:46Z

Data flow

← Older revision		Revision as of 16:29, 16 December 2015
Line 10:		Line 10:

	[[File:GGBN Portal Architecture.jpg\|center\|700px]]		[[File:GGBN Portal Architecture.jpg\|center\|700px]]
	'''General data architectur of the GGBN Dta Portal architecture.''' Specimen and DNA sample databases (on top left) are operated by the Network partners. Their data content is structured and provided by using BioCASe or IPT and the GGBN Data Standard extensions. The Berlin Harvesting and Indexing Toolkit is used to harvest GGBN data and store them in a MySQL database. In addition we use a SOLR instance to speed the query. After harvesting the data are cleaned and enriched by e.g. a match against certain datasets of the GBIF checklist bank. Finally the data are aggregated from multiple sources in the portal to be displayed.		'''General data architectur of the GGBN Dta Portal architecture.''' Specimen and DNA sample databases (on top left) are operated by the Network partners. Their data content is structured and provided by using BioCASe or IPT and the GGBN Data Standard extensions. The [[http://wiki.bgbm.org/bhit/index.php/Main_Page \| Berlin Harvesting and Indexing Toolkit]] is used to harvest GGBN data and store them in a MySQL database. In addition we use a SOLR instance to speed the query. After harvesting the data are cleaned and enriched by e.g. a match against certain datasets of the GBIF checklist bank. Finally the data are aggregated from multiple sources in the portal to be displayed.

	=DNA and Tissue Bank databases=		=DNA and Tissue Bank databases=