iData

iData is a set of features that enhances HUBzero's Project-Files. It was initially developed during the GABBs Project and then renovated as part of the GeoEDF Project.

Features

• Extended Metadata ("metadata")
  • Derived, geospatial, user-defined
  • Automated extraction on file creation, change, or deletion
  • User view and edit
  • Search via metadata value
  • Search via geographic area
  • Publications: attach metadata in XML format
• Previews
  • Map (raster, vector, markers)
  • Geospatial (.dbf, .prj)
  • Tabular/charts (.csv, .tsv, .tab)
  • Images (.gif, .jpg, .png)
  • Archives (.gz, .zip)
  • Text (.txt)

Implementation

• Metadata pipeline
  • Auditbeat detects tool-initiated filesystem changes and sends notifications messages.
  • Logstash collects notification messages, reformats them, and forwards to RabbitMQ.
  • RabbitMQ enqueues messages for polling Python scripts.
  • Python scripts perform metadata extraction and update Solr.
  • The hub's Solr installation is stores extracted metadata.
• HUBzero CMS extensions ("apps", iData specific PHP code)
  • Detect web-initiated filesystem changes and sends notifications directly to RabbitMQ.
  • Support metadata editing and file previews
  • Dump relevant metadata to XML for inclusion in publications