19 Commits

Author SHA1 Message Date
Will 679f1e3a76 Fixes for large file processing
- Fixes for large file processing
2024-04-05 15:52:25 -07:00
Will 5f5337b473 Change client to better handle large file uploads
- Change client to better handle large file uploads
- Added minikube export/import scripts
2024-04-05 11:46:54 -07:00
Will 205cdc4bd4 Merge branch 'main' into helm 2024-03-08 14:20:06 -08:00
Will 76559874b1 Added Minio storage expiration policy for bucket on creation
- Added Minio storage expiration policy for bucket on creation
2024-03-08 11:07:57 -08:00
Will 14ae409912 /reset route now clears minio files as well
/reset route now clears minio files as well
2024-03-08 00:21:12 -08:00
Max Harley 7ad3e68ecf Merge branch main into helm 2024-02-22 16:06:31 +01:00
Will 5b24179120 NLP modifications
-NLP container now splits large docs and submits them through an additional queue for embedding
-Added overall plaintext size limit that prevents larger docs from being split/indexed
-Memory and CPU limits added to NLP container to prevent starvation via the NLP container
-Average embedding vector approach eliminated due to the new streaming approach
-Additional model options pre-loaded for NLP container
-Changed default embedding model to TaylorAI/gte-tiny
-Vector and normalization added as k8s options for the NLP container
-Removed /indexing web endpoint for NLP service as text should be submitted through the Nemesis frontend
-Tokenization fixed for NLP container - now using the chosen model's tokenizer
2024-02-07 00:59:39 -08:00
Max Harley 7e8ec79220 Integrate Helm 2024-02-02 19:06:41 -05:00
Will 3f81957c33 Added document average embedding vector indexing
-Added document average embedding vector indexing
2024-02-01 14:06:16 -08:00
Will cc0ebb89e5 Bumped cryptography package in nemesiscommon
-Bumped cryptography package in nemesiscommon
2024-01-31 11:18:35 -08:00
Will 098e6c496f Bumped pycryptodomex package in nemesiscommon
-Bumped pycryptodomex package in nemesiscommon
2024-01-31 11:17:01 -08:00
Will c993c68b7f Updated poetry.lock for nemesiscommon to update aiohttp depdendency
-Updated poetry.lock for nemesiscommon to update aiohttp depdendency
2024-01-30 17:45:09 -08:00
Lee Christensen 6366136af5 update deprecated settings 2024-01-08 22:04:41 -05:00
Lee Christensen 0d37364a4b update dependencies 2023-10-04 01:44:34 -04:00
Lee Christensen 37284cf622 'environment' settings, cleanup nemesis-cli, increase MAX_LOGIN_ATTEMPTS on pgadmin, messaging errors get dropped 2023-10-02 11:48:00 -04:00
Lee Christensen 06e850843f update packages 2023-09-28 18:13:26 -04:00
HarmJ0y f1f0ea985f Small wording tweak
-Small wording tweak
2023-09-06 11:08:01 -07:00
HarmJ0y e1562f96b6 Start of File Viewer page for the Dashboard
-Start of File Viewer page for the Dashboard
-Alerting currently not working correctly
2023-09-05 21:39:02 -07:00
Lee Christensen fe4e0d70a4 commited for life 2023-08-09 13:14:44 -07:00