mirror of
https://github.com/activecm/rita
synced 2026-06-08 13:02:45 +00:00
b923c39e2d
* Update on config structure, functionality, and tests Co-Authored-By: Naomi Kramer <naomiagoddard@gmail.com> * Extend subnet type to read/write from db, update tests Co-Authored-By: Liza Tsibur <liza@activecountermeasures.com> * updated read file config test and subnet tests * fixed config and util tests, updated subnet related functions Co-Authored-By: Naomi Kramer <naomiagoddard@gmail.com> * Remove error return from GetDefaultConfig Co-Authored-By: Liza Tsibur <liza@activecountermeasures.com> * added json tags to database struct * Updated beacon weights validation for config * updates to score thresholds validation tags * changes to config subnet validation and testing * Update subnet.go * Write missing host entries to http to populate http_proto * Updating some fields to uint64 * WIP update some field types * Update zeek count types and fix tests * Add clickhouse credentials * Misc fixes * Update pointer * Add ability to mark datasets as sample datasets * fix column name * Fix datasets exiting import if hour is empty * Fix zeek count parsing from TSV files * Remove storing dns conns in arrays, Fix historical first seen dns lag * Remove unused columns * Update config.hjson * Update config.hjson * updated impact category score functions to use float64 Co-Authored-By: Naomi Kramer <naomiagoddard@gmail.com> * Update subnet.go * Store import version in imports table * Fix duplicated SNI/IP long connections * Update subnet_test.go * Cleanup output * Rolling files updates (#39) * Limit number of days to import for rolling datasets * Fix breaking imports when import was interrupted * Remove debug output --------- Co-authored-by: Naomi Kramer <naomi@activecountermeasures.com> * Omit parts of env from output * Set max for threat intel datasize * Remove SELinux neutering for QA * Add network size column * Fix http_proto for missing host, update tests for missing host fixes * Add online feeds to default config * Update sshprep (#45) * Update sshprep Co-Authored-By: William Stearns <3538265+william-stearns@users.noreply.github.com> * Update sshprep Add Bradley's suggestion of using head -1 to limit to a single address. --------- Co-authored-by: Naomi Kramer <naomi@activecountermeasures.com> Co-authored-by: William Stearns <3538265+william-stearns@users.noreply.github.com> * Installer Behavior Tweaks (#41) * Add --yes flag to add-apt-repository command * Add missing sudo flags, make sure we're using the SUDO variable instead * Add ability to perform zone transfers (#48) * Store zone transfer records Co-Authored-By: moth <25512187+0x6d6f7468@users.noreply.github.com> * Update config * Add tests * Tests, connectivity test * Update tests --------- Co-authored-by: moth <25512187+0x6d6f7468@users.noreply.github.com> * Support RedHat/RHEL as a valid target (#47) * Update sshprep Co-Authored-By: William Stearns <3538265+william-stearns@users.noreply.github.com> * Supporrt RedHat/RHEL as a valid target --------- Co-authored-by: Naomi Kramer <naomi@activecountermeasures.com> Co-authored-by: William Stearns <3538265+william-stearns@users.noreply.github.com> Co-authored-by: moth <moth@blackhillsinfosec.com> * Fix tests (#49) * Fix tests * Update WalkFiles to use UTC * fixed issue with rolling datasets over 24hours old not getting historical first seen timestamp set (#52) * Change values from float32 to float64 (#50) * Switch float32 to float64 * Update threat category calculation to match CalculateBucketedScore (#51) --------- Co-authored-by: Liza Tsibur <liza@activecountermeasures.com> * Bump max query execution time default value * Use string instead of error for ZoneTransferConnectivityErrors struct fields (#61) * Upgrade Golang to version 1.24 (#59) (#60) * Replace get_url with shell and curl (#58) * Update sshprep Co-Authored-By: William Stearns <3538265+william-stearns@users.noreply.github.com> * Replace get_url with shell and curl * Use get_url by default, fall back to curl if it fails --------- Co-authored-by: Naomi Kramer <naomi@activecountermeasures.com> Co-authored-by: William Stearns <3538265+william-stearns@users.noreply.github.com> Co-authored-by: moth <moth@blackhillsinfosec.com> * add automated log transfer, AC-Hunter issue 135 (#62) * Update sshprep Co-Authored-By: William Stearns <3538265+william-stearns@users.noreply.github.com> * add automated log transfer, PR135 * cron requires non-executable permission * Specify suggested YAML plugin and config in VSCode workspace * Linting and light cleanup * Update generate_installer.sh Download zeek_log_transport.sh to send to the sensor. * Create cron file if remote zeek installation * Only run zeek log import steps for remote sensor installations --------- Co-authored-by: Naomi Kramer <naomi@activecountermeasures.com> Co-authored-by: William Stearns <3538265+william-stearns@users.noreply.github.com> Co-authored-by: moth <moth@blackhillsinfosec.com> * Temporarily disable RITA/Zeek log transport until installer is modular (#66) * Uniform -y flag usage for repo management/package installation; Uniform SUDO variable usage (#68) * Resolve Installer Side Effects and Formalize RHEL Support (#73) * Add missing necessary wildcards for RHEL versions * Remove Ansible task replacing python3-requests to avoid RHEL distro installation side effects * Update supported distros in README * Update scoring defaults * Resolve Ansible Reboot Errors (#75) * Clean up conditionals; Fix reboot step for Ubuntu * Suppress erroneous error output on RPM systems, ignore errors on reboot necessity checks * Ignore missing host rows for openhttp (#76) * Fix integration tests due to prevalence (#77) --------- Co-authored-by: Liza Tsibur <liza@activecountermeasures.com> Co-authored-by: moth <moth@blackhillsinfosec.com> Co-authored-by: William Stearns <william.l.stearns@gmail.com> Co-authored-by: William Stearns <3538265+william-stearns@users.noreply.github.com> Co-authored-by: moth <25512187+0x6d6f7468@users.noreply.github.com>
164 lines
5.3 KiB
Go
164 lines
5.3 KiB
Go
package viewer_test
|
|
|
|
import (
|
|
"context"
|
|
"fmt"
|
|
"log"
|
|
"os"
|
|
"path/filepath"
|
|
"testing"
|
|
"time"
|
|
|
|
"github.com/activecm/rita/v5/cmd"
|
|
"github.com/activecm/rita/v5/config"
|
|
"github.com/activecm/rita/v5/database"
|
|
"github.com/activecm/rita/v5/viewer"
|
|
|
|
tea "github.com/charmbracelet/bubbletea"
|
|
"github.com/joho/godotenv"
|
|
"github.com/spf13/afero"
|
|
"github.com/stretchr/testify/require"
|
|
"github.com/stretchr/testify/suite"
|
|
"github.com/testcontainers/testcontainers-go"
|
|
"github.com/testcontainers/testcontainers-go/modules/clickhouse"
|
|
)
|
|
|
|
const ConfigPath = "../integration/test_config.hjson"
|
|
|
|
type ViewerTestSuite struct {
|
|
suite.Suite
|
|
db *database.DB
|
|
maxTimestamp time.Time
|
|
minTimestamp time.Time
|
|
useCurrentTime bool
|
|
clickhouseContainer *clickhouse.ClickHouseContainer
|
|
clickhouseConnection string
|
|
}
|
|
|
|
func (s *ViewerTestSuite) SetupSuite() {
|
|
t := s.T()
|
|
|
|
// load environment variables
|
|
err := godotenv.Overload("../.env", "../integration/test.env")
|
|
require.NoError(t, err, "cannot load .env file")
|
|
|
|
// set up file system interface
|
|
afs := afero.NewOsFs()
|
|
|
|
cfg, err := config.ReadFileConfig(afs, ConfigPath)
|
|
require.NoError(t, err)
|
|
|
|
s.SetupClickHouse(t)
|
|
|
|
cfg.Env.DBConnection = s.clickhouseConnection
|
|
|
|
// // import data
|
|
_, err = cmd.RunImportCmd(time.Now(), cfg, afs, "../test_data/valid_tsv", "dnscat2_ja3_strobe", false, true)
|
|
require.NoError(t, err)
|
|
|
|
// connect to database
|
|
db, err := database.ConnectToDB(context.Background(), "dnscat2_ja3_strobe", cfg, nil)
|
|
require.NoError(t, err)
|
|
|
|
// determine which max timestamp to use for relative time calculations
|
|
minTimestamp, maxTimestamp, _, useCurrentTime, err := db.GetTrueMinMaxTimestamps()
|
|
require.NoError(t, err)
|
|
|
|
s.maxTimestamp = maxTimestamp
|
|
s.minTimestamp = minTimestamp
|
|
s.useCurrentTime = useCurrentTime
|
|
s.db = db
|
|
}
|
|
|
|
// SetupClickHouse creates a ClickHouse container using the test.docker-compose.yml and handles taking it down when complete
|
|
func (s *ViewerTestSuite) SetupClickHouse(t *testing.T) {
|
|
t.Helper()
|
|
|
|
version := os.Getenv("CLICKHOUSE_VERSION")
|
|
require.NotEmpty(t, version, "CLICKHOUSE_VERSION environment variable must be set")
|
|
|
|
ctx := context.Background()
|
|
clickHouseContainer, err := clickhouse.RunContainer(ctx,
|
|
testcontainers.WithImage(fmt.Sprintf("clickhouse/clickhouse-server:%s-alpine", version)),
|
|
clickhouse.WithUsername("default"),
|
|
clickhouse.WithPassword(""),
|
|
clickhouse.WithDatabase("default"),
|
|
clickhouse.WithConfigFile(filepath.Join("../deployment/", "config.xml")),
|
|
)
|
|
require.NoError(t, err)
|
|
|
|
s.clickhouseContainer = clickHouseContainer
|
|
connectionHost, err := clickHouseContainer.ConnectionHost(ctx)
|
|
require.NoError(t, err)
|
|
s.clickhouseConnection = connectionHost
|
|
|
|
}
|
|
|
|
func TestViewer(t *testing.T) {
|
|
viewerSuite := new(ViewerTestSuite)
|
|
suite.Run(t, viewerSuite)
|
|
}
|
|
|
|
func (s *ViewerTestSuite) TearDownSuite() {
|
|
if err := s.clickhouseContainer.Terminate(context.Background()); err != nil {
|
|
log.Fatalf("failed to terminate container: %s", err)
|
|
}
|
|
}
|
|
|
|
func (s *ViewerTestSuite) TestViewerUpdate() {
|
|
t := s.T()
|
|
require := require.New(t)
|
|
|
|
// create new ui model
|
|
m, err := viewer.NewModel(s.maxTimestamp, s.minTimestamp, s.useCurrentTime, s.db)
|
|
require.NoError(err)
|
|
|
|
// toggle help on
|
|
m.Update(tea.KeyMsg{Type: tea.KeyRunes, Runes: []rune("?")})
|
|
require.True(m.ViewHelp, "expected help to be toggled on, got off")
|
|
|
|
// toggle help off
|
|
m.Update(tea.KeyMsg{Type: tea.KeyRunes, Runes: []rune("?")})
|
|
require.False(m.ViewHelp, "expected help to be toggled off, got on")
|
|
|
|
// toggle sidebar scrolling to be enabled
|
|
m.Update(tea.KeyMsg{Type: tea.KeyTab})
|
|
require.True(m.SideBar.ScrollEnabled, "expected sidebar scrolling to be enabled, got disabled")
|
|
|
|
// toggle sidebar scrolling to be disabled
|
|
m.Update(tea.KeyMsg{Type: tea.KeyTab})
|
|
require.False(m.SideBar.ScrollEnabled, "expected sidebar scrolling to be disabled, got enabled")
|
|
|
|
// toggle search bar focus
|
|
m.Update(tea.KeyMsg{Type: tea.KeyRunes, Runes: []rune("/")})
|
|
require.True(m.SearchBar.TextInput.Focused(), "expected search bar to be focused, got unfocused")
|
|
|
|
// toggle search bar help on
|
|
m.Update(tea.KeyMsg{Type: tea.KeyRunes, Runes: []rune("?")})
|
|
require.True(m.ViewSearchHelp, "expected search bar help to be toggled on, got off")
|
|
|
|
// toggle search bar help off
|
|
m.Update(tea.KeyMsg{Type: tea.KeyRunes, Runes: []rune("?")})
|
|
require.False(m.ViewSearchHelp, "expected search bar help to be toggled off, got on")
|
|
|
|
// toggle search bar help back on so that we can make sure that unfocusing the search bar will also turn off the search bar help
|
|
m.Update(tea.KeyMsg{Type: tea.KeyRunes, Runes: []rune("?")})
|
|
require.True(m.ViewSearchHelp, "expected search bar help to be toggled on, got off")
|
|
|
|
// toggle search bar focus off
|
|
m.Update(tea.KeyMsg{Type: tea.KeyEsc})
|
|
require.False(m.ViewSearchHelp, "expected search bar help to be toggled off, got on")
|
|
require.False(m.SearchBar.TextInput.Focused(), "expected search bar to be unfocused, got focused")
|
|
|
|
// quit the program with 'q'
|
|
_, command := m.Update(tea.KeyMsg{Type: tea.KeyRunes, Runes: []rune("q")})
|
|
fmt.Printf("cmd: %v\n", command)
|
|
require.Equal(tea.Quit(), command(), "expected quit command, got %v", command)
|
|
|
|
// quit the program with ctrl+c
|
|
_, command = m.Update(tea.KeyMsg{Type: tea.KeyCtrlC})
|
|
fmt.Printf("cmd: %v\n", command)
|
|
require.Equal(tea.Quit(), command(), "expected quit command, got %v", command)
|
|
|
|
}
|