Lee Chagolla-Christensen 5d7b9bb31d Centralized workflow purging/tracking, perf improvements ...

Infrastructure:
- Enable pg_stat_statements extension for query monitoring
- Increase Postgres max connections and shared buffers
- Bump RabbitMQ prefetchCount to 100
- Add curl/netstat/htop to dev Docker image

Database:
- Add indexes for findings and workflows
- Add workflow status constraint and is_purged column
- Index workflows by object_id for active workflows

Workflow tracking:
- Add WorkflowStatus enum
- Added finalize_workflow activity
- Generate instance IDs with name prefix pattern
  (<name>.<instance>.<object_id>)

Workflow purging:
- Create WorkflowPurger to purge Dapr workflow data (kills perf over
  time)
- added to file_enrichment/document_conversion
- New workflows column to track purge workflows

File linking:
- Optimize upserts to single query (perf)

Configuration:
- PII info in env.example

2025-11-08 16:08:11 -08:00

..

dev.Dockerfile

Centralized workflow purging/tracking, perf improvements

2025-11-08 16:08:11 -08:00

prod.Dockerfile

add code

2025-06-13 11:33:07 +02:00