ARHUT-Roadmap.md

+# ARHUT Roadmap
+
+Below is an overview of the major ARHUT milestones. While many of these can be worked on in parallel, this list helps us track our progress and the overall scope.
+
+---
+
+## Milestone Overview
+
+- [TARA in Active Use](#tara-in-active-use)  
+- [Kohainfo in Active Use](#kohainfo-in-active-use)  
+- [PaleoMIX System Structure & Initial Data (IN PROGRESS)](#paleomix-system-structure--initial-data-in-progress)  
+- [PaleoMIX System in Active Use](#paleomix-system-in-active-use)  
+- [Web Researchers UI in Use](#web-researchers-ui-in-use)  
+- [Advanced Search Functionality](#advanced-search-functionality)  
+- [End-User Documentation](#end-user-documentation)  
+- [Development Workflows & DevOps HOWTO](#development-workflows--devops-howto)  
+- [Finding Responsible Tech Persons](#finding-responsible-tech-persons)  
+- [Procedure for Automatic Association of Imported Data](#procedure-for-automatic-association-of-imported-data)  
+- [Workflow Spreadsheets -> ARHUT](#workflow-spreadsheets---arhut)  
+- [Advanced Date Formats in Management & UI](#advanced-date-formats-in-management--ui)  
+- [TARA Data Quality Check & Normalization](#tara-data-quality-check--normalization)  
+- [Kohainfo Data Quality Check & Normalization](#kohainfo-data-quality-check--normalization)  
+- [Integrating External Data Sources](#integrating-external-data-sources)  
+- [Documentation: Create & Manage Your Own Datasets](#documentation-create--manage-your-own-datasets)  
+- [Ongoing Feedback & Small Implementation Projects](#ongoing-feedback--small-implementation-projects)
+
+---
+
+## TARA in Active Use
+- **Current Status**: TARA system running and imported (**DONE**)
+- **Description**:  
+  - Train staff to use TARA daily; gather real-world usage insights.  
+  - Address any immediate support issues or bug fixes.  
+  - [ ] Track feedback in GitLab issues.
+
+---
+
+## Kohainfo in Active Use
+- **Current Status**: Kohainfo system running and imported (**DONE**)  
+- **Description**:  
+  - Similar approach to TARA; ensure staff know how to enter, find, and maintain data.  
+  - [ ] Monitor for data consistency or workflow problems.
+
+---
+
+## PaleoMIX System Structure & Initial Data (IN PROGRESS)
+- **Description**:  
+  - Establish core schema for PaleoMIX.  
+  - Import initial datasets; verify data integrity in Directus/PostGIS.  
+  - [ ] Collaborate with researchers to finalize what fields and relationships are needed.
+
+---
+
+## PaleoMIX System in Active Use
+- **Prerequisite**: Basic structure defined, initial data imported.  
+- **Description**:  
+  - Provide training for relevant staff/researchers.  
+  - [ ] Gather feedback on usability and data coverage.
+
+---
+
+## Web Researchers UI in Use
+- **Description**:  
+  - Deploy the Next.js-based UI for researcher access.  
+  - [ ] Perform usability tests; refine as needed.  
+  - [ ] Confirm data from TARA, Kohainfo, and PaleoMIX is visible (where relevant).
+
+---
+
+## Advanced Search Functionality
+- **Urgency**: High  
+- **Description**:  
+  - Implement advanced filtering, full-text search, or faceted search across all integrated systems.  
+  - [ ] Ensure performance is adequate for large datasets.
+
+---
+
+## End-User Documentation
+- **Description**:  
+  - High-level “how to use the system” for archaeologists, researchers, and other stakeholders.  
+  - [ ] Possibly host guides in the GitLab Wiki, with screenshots or quick-start examples.  
+  - [ ] Link to any official Directus documentation if helpful.
+
+---
+
+## Development Workflows & DevOps HOWTO
+- **Description**:  
+  - Document the process for code changes, plugin additions, environment upgrades, etc.  
+  - [ ] Outline GitLab CI/CD steps and environment setups.  
+  - [ ] Include upgrade testing and rollback strategies.
+
+---
+
+## Finding Responsible Tech Persons
+- **Description**:  
+  - Identify the main or backup contacts for ARHUT’s technical maintenance, user support, and data analysis needs.  
+  - [ ] Ensure continuity if the primary contact is unavailable.
+
+---
+
+## Procedure for Automatic Association of Imported Data
+- **Description**:  
+  - Define how new spreadsheet records link automatically to existing entries (e.g., by site ID, artifact ID).  
+  - [ ] Minimize manual data mapping.
+
+---
+
+## Workflow Spreadsheets -> ARHUT
+- **Description**:  
+  - Document a standard pipeline for Excel/CSV imports into ARHUT, including validation steps.  
+  - [ ] Provide instructions for staff to self-serve this process.
+
+---
+
+## Advanced Date Formats in Management & UI
+- **Description**:  
+  - Standardize date and timezone handling, particularly relevant to archaeological data (sometimes uncertain or partial dates).  
+  - [ ] Ensure Directus and Next.js display consistent formats.
+
+---
+
+## TARA Data Quality Check & Normalization
+- **Description**:  
+  - Long-term effort to systematically review and correct TARA records.  
+  - [ ] Define naming conventions, fix missing fields, etc.
+
+---
+
+## Kohainfo Data Quality Check & Normalization
+- **Description**:  
+  - Similar to TARA; ongoing process for improving data consistency and completeness.  
+  - [ ] Align with ARHUT’s naming conventions and required fields.
+
+---
+
+## Integrating External Data Sources
+- **Description**:  
+  - Scope out new APIs or external databases to enrich ARHUT data.  
+  - [ ] Evaluate feasibility and define integration approach.
+
+---
+
+## Documentation: Create & Manage Your Own Datasets
+- **Description**:  
+  - Provide advanced guidance for power users or researchers who want to add entirely new datasets.  
+  - [ ] Cover recommended data modeling, relationship building, permissions, etc.
+
+---
+
+## Ongoing Feedback & Small Implementation Projects
+- **Description**:  
+  - Establish an ongoing process to collect user feedback and quickly spin up improvements.  
+  - [ ] Might involve periodic sprints or mini-projects for new features.
+
+---
+
+_Last updated: 2025-01-18_