Annotation Database Import: Difference between revisions

From MediaWiki
Jump to navigation Jump to search
No edit summary
No edit summary
 
(4 intermediate revisions by the same user not shown)
Line 1: Line 1:
= Background =
The database is intended as a retrospective view on data collected by many potentially narrowly-focused surveys. Each survey produces a large number of entities with distinctive forms and purposes that must be mapped onto entities in the database, whose structure is roughly static and which must remain comparable through time.  
The database is intended as a retrospective view on data collected by many potentially narrowly-focused surveys. Each survey produces a large number of entities with distinctive forms and purposes that must be mapped onto entities in the database, whose structure is roughly static and which must remain comparable through time.  


Line 11: Line 9:
* Annotators are responsible for providing the video and photo annotations, information about annotation protocols and species guides and for label mapping.
* Annotators are responsible for providing the video and photo annotations, information about annotation protocols and species guides and for label mapping.
* The importer combines the information provided by the other three actors to actually import a cruise and all of its associated data into the database.
* The importer combines the information provided by the other three actors to actually import a cruise and all of its associated data into the database.


== Chief Scientists/Principal Investigators ==
== Chief Scientists/Principal Investigators ==
Line 34: Line 33:
The final step in the import process is for the importer to run a script which combines the information compiled by the other actors into a single unified dataset.
The final step in the import process is for the importer to run a script which combines the information compiled by the other actors into a single unified dataset.


* More information about the [[Annotation Database Importer]] tool.
* More information about the [[Annotation Database Import App|Annotation Database Importer]] tool.

Latest revision as of 16:59, 28 February 2024

The database is intended as a retrospective view on data collected by many potentially narrowly-focused surveys. Each survey produces a large number of entities with distinctive forms and purposes that must be mapped onto entities in the database, whose structure is roughly static and which must remain comparable through time.

As a trivial example, one survey might identify a fine substrate as comprising silt, sand and fine gravel while another might identify fine sediment as only silt. Ideally, the database will provide a way to preserve this distinction without introducing so much complexity that it becomes impossible to use and maintain.

The database import process consists of three main steps, each the responsibility of a distinct actor:

  • The Chief Scientist or Principal Investigator is responsible for providing high-level metadata concerning the cruise, its scientific objectives, summaries and associated programs, personnel and contacts.
  • NDST (Non-Destructive Survey Tools) is responsible for providing operational metadata for the cruise, dives and transects, along with platform and instrument configuration information and navigation and water properties data streams. NDST maintains the video/photo media library, but those data are not imported into the database.
  • Annotators are responsible for providing the video and photo annotations, information about annotation protocols and species guides and for label mapping.
  • The importer combines the information provided by the other three actors to actually import a cruise and all of its associated data into the database.


Chief Scientists/Principal Investigators

Chief Scientists can use the online tool to enter information about a cruise, its start and end dates, which vessel was used, scientific objectives, operational notes and a summary. The tool permits the assignment of personnel and roles, the optional selection of scientific programs under whose auspices the research is occurring as well as a list of optional First Nations contacts.

Non-Destructive Survey Tools

NDST crews can use the Dive Logging App to record cruise, dive and transect metadata, personnel and equipment configuration. The app is available online, but is intended to be used in the field. The online import tools currently only allow import from the online Dive Logging app, but an issue has been created in Gitlab to allow uploading from field computers.

Annotators

Annotators can use the online tool to create an annotation project, which includes selecting or creating an annotation protocol and mapping the annotation labels (i.e., those generated by Biigle) to database entities.

Importer

The final step in the import process is for the importer to run a script which combines the information compiled by the other actors into a single unified dataset.