743b6f715f
speed up nlp/enrichment builds, decrease image size via dockerignore
2024-04-24 04:17:17 -04:00
6e554019e0
update docs
2024-04-23 04:33:13 -04:00
dc3ec95c51
update docs, update workspace
2024-04-23 04:10:24 -04:00
1e538c973b
standardize poetry.toml
2024-04-23 03:45:40 -04:00
750cb69cb6
update lock files, protobuf update
2024-04-23 03:37:55 -04:00
298ed4ba00
Merge branch 'main' into host_analysis
2024-04-23 03:24:46 -04:00
ba0f3ce6c0
Lots of changes...
...
more test examples, readd registry/service objects
fix agentmapping, process, host
fix env settings
add DB files
update tables, ruff, formatting, lots of changes...
Merge remote-tracking branch 'origin/main' into host_analysis
return raw HTLM on landing page
and more...
2024-04-23 02:14:21 -04:00
679f1e3a76
Fixes for large file processing
...
- Fixes for large file processing
2024-04-05 15:52:25 -07:00
5f5337b473
Change client to better handle large file uploads
...
- Change client to better handle large file uploads
- Added minikube export/import scripts
2024-04-05 11:46:54 -07:00
205cdc4bd4
Merge branch 'main' into helm
2024-03-08 14:20:06 -08:00
76559874b1
Added Minio storage expiration policy for bucket on creation
...
- Added Minio storage expiration policy for bucket on creation
2024-03-08 11:07:57 -08:00
14ae409912
/reset route now clears minio files as well
...
/reset route now clears minio files as well
2024-03-08 00:21:12 -08:00
7ad3e68ecf
Merge branch main into helm
2024-02-22 16:06:31 +01:00
5b24179120
NLP modifications
...
-NLP container now splits large docs and submits them through an additional queue for embedding
-Added overall plaintext size limit that prevents larger docs from being split/indexed
-Memory and CPU limits added to NLP container to prevent starvation via the NLP container
-Average embedding vector approach eliminated due to the new streaming approach
-Additional model options pre-loaded for NLP container
-Changed default embedding model to TaylorAI/gte-tiny
-Vector and normalization added as k8s options for the NLP container
-Removed /indexing web endpoint for NLP service as text should be submitted through the Nemesis frontend
-Tokenization fixed for NLP container - now using the chosen model's tokenizer
2024-02-07 00:59:39 -08:00
7e8ec79220
Integrate Helm
2024-02-02 19:06:41 -05:00
4934355a53
Update protobuf
2024-02-01 19:23:07 -05:00
4761e97f16
Merge remote-tracking branch 'origin/main' into host_analysis
2024-02-01 19:21:59 -05:00
3f81957c33
Added document average embedding vector indexing
...
-Added document average embedding vector indexing
2024-02-01 14:06:16 -08:00
416f7642ed
Removed tensorflow-serving password model
...
-Removed tensorflow-serving password model as it proved not effective in production.
-Remove classic NLP summarization as it wasn't useful in production
2024-02-01 12:11:12 -08:00
981bad2e71
update protobuf
2024-02-01 13:45:13 -05:00
83fa3faa76
Fix process categories in postgres, Add filesystem objects to host model
2024-01-31 15:07:17 -05:00
cc0ebb89e5
Bumped cryptography package in nemesiscommon
...
-Bumped cryptography package in nemesiscommon
2024-01-31 11:18:35 -08:00
098e6c496f
Bumped pycryptodomex package in nemesiscommon
...
-Bumped pycryptodomex package in nemesiscommon
2024-01-31 11:17:01 -08:00
c993c68b7f
Updated poetry.lock for nemesiscommon to update aiohttp depdendency
...
-Updated poetry.lock for nemesiscommon to update aiohttp depdendency
2024-01-30 17:45:09 -08:00
7d40cea54d
add host_information ODS
2024-01-23 19:08:11 -05:00
16308b6e17
UTF-8/UTF-16 strings handling in Yara Matches
...
-UTF-8/UTF-16 strings handling in Yara Matches
2024-01-18 12:45:42 -08:00
67fdfc57a2
Expanded Yara rule context
...
-Expanded Yara rule context parsed by the file enrichment service, now includes matching strings as well as the rule definition itself
2024-01-17 23:29:10 -08:00
f144c30751
Initial mods for more complex Yara rule context
...
-Initial mods for more complex Yara rule context
2024-01-17 19:30:32 -08:00
6e1e8769a2
Fix for large files downloaded in Chromium
...
-Large files downloaded in Chromium now handled properly
-Added batching for Chromium downloads
2024-01-16 21:14:14 -08:00
0452bd04a4
added process data type to DB
2024-01-12 23:56:28 -05:00
6366136af5
update deprecated settings
2024-01-08 22:04:41 -05:00
c733e87f00
NoseyParker update
...
-Fixed rule format and output parsing for new NoseyParker version
2024-01-02 15:08:42 -08:00
0f2fdf25b9
fix protobuf HasField checking
2023-12-14 22:07:23 -08:00
78001ee6a9
fix messages types, remove decprecated settings
2023-12-14 21:01:24 -08:00
974fa9ebbe
initial named_pipe host modeling
2023-10-23 16:15:25 -04:00
0d37364a4b
update dependencies
2023-10-04 01:44:34 -04:00
37284cf622
'environment' settings, cleanup nemesis-cli, increase MAX_LOGIN_ATTEMPTS on pgadmin, messaging errors get dropped
2023-10-02 11:48:00 -04:00
06e850843f
update packages
2023-09-28 18:13:26 -04:00
f1f0ea985f
Small wording tweak
...
-Small wording tweak
2023-09-06 11:08:01 -07:00
e1562f96b6
Start of File Viewer page for the Dashboard
...
-Start of File Viewer page for the Dashboard
-Alerting currently not working correctly
2023-09-05 21:39:02 -07:00
fe4e0d70a4
commited for life
2023-08-09 13:14:44 -07:00
Lee Christensen