Files
basicmachines-co-basic-memory/docs/cloud-cli.md
T
phernandez 84c0b36dee feat: Add comprehensive cloud mount CLI commands and documentation
This commit implements SPEC-7 Phase 4 by adding local file access capabilities
to the Basic Memory Cloud CLI, enabling users to mount their cloud files locally
for real-time editing.

New features:
- Cloud mount setup with automatic rclone installation
- Mount/unmount/status commands with three performance profiles
- Cross-platform rclone installer with package manager fallbacks
- Mount configuration management with tenant-specific credentials
- Comprehensive documentation with examples and troubleshooting

Mount profiles:
- fast: 5s sync for active development
- balanced: 10-15s sync (recommended)
- safe: 15s+ sync with conflict detection

Technical implementation:
- Uses rclone NFS mount (no FUSE dependencies)
- Tigris object storage with scoped credentials
- Bidirectional sync with configurable cache settings
- Process management and cleanup

Fixes Python module conflict by moving cloud.py commands to cloud/core_commands.py
to resolve typer CLI loading issues with cloud.py file vs cloud/ directory.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
Signed-off-by: phernandez <paul@basicmachines.co>
2025-09-22 17:47:06 -05:00

12 KiB

Basic Memory Cloud CLI Guide

The Basic Memory Cloud CLI provides commands for interacting with Basic Memory Cloud instances, including authentication, project management, file synchronization, and local file access. This guide covers installation, configuration, and usage of the cloud features.

Overview

The cloud CLI enables you to:

  • Authenticate with Basic Memory Cloud using OAuth
  • List and create projects on cloud instances
  • Upload local files and directories to cloud projects via WebDAV
  • Mount cloud files locally for real-time editing with rclone
  • Check the health status of cloud instances
  • Automatically filter uploads using gitignore patterns

Authentication

Initial Setup

Before using cloud commands, you need to authenticate with Basic Memory Cloud:

bm cloud login

This command will:

  1. Open your browser to the Basic Memory Cloud authentication page
  2. Prompt you to authorize the CLI application
  3. Store your authentication token locally for future use

Project Management

Listing Projects

View all projects on a cloud instance:

bm cloud project list

Example output:

     Cloud Projects
┏━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ Name             ┃ Path                     ┃
┡━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ my-research      │ my-research              │
│ work-notes       │ work-notes               │
└──────────────────┴──────────────────────────┘

Found 2 project(s)

Creating Projects

Create a new project on a cloud instance:

bm cloud project add my-new-project

Create and set as default:

bm cloud project add my-new-project --default

File Upload

Basic Upload

Upload files or directories to a cloud project:

# Upload a directory
bm cloud upload my-project /path/to/local/files

# Upload a single file
bm cloud upload my-project /path/to/file.md

Upload Options

Timestamp Preservation

By default, file modification times are preserved during upload:

# Preserve timestamps (default)
bm cloud upload my-project ./docs

# Don't preserve timestamps
bm cloud upload my-project ./docs --no-preserve-timestamps

Gitignore Filtering

The CLI automatically respects .gitignore patterns and includes smart defaults for development artifacts:

# Respect .gitignore and defaults (default behavior)
bm cloud upload my-project ./my-repo

# Upload everything, ignore .gitignore
bm cloud upload my-project ./my-repo --no-gitignore

Default ignore patterns include:

  • .git, .venv, venv, env, .env
  • node_modules, __pycache__, .pytest_cache
  • *.pyc, *.pyo, *.pyd
  • .DS_Store, Thumbs.db
  • .idea, .vscode
  • build, dist, .tox, .cache
  • .mypy_cache, .ruff_cache

Upload Examples

# Upload a local knowledge base
bm cloud upload my-research ~/Documents/research

# Upload specific documentation, preserving structure
bm cloud upload docs-project ./docs

# Upload without gitignore filtering for a complete backup
bm cloud upload backup-project ./ --no-gitignore

Upload Output

During upload, you'll see progress and filtering information:

$ bm cloud upload my-project ./my-repo

Ignored 45 file(s) based on .gitignore and default patterns
Uploading 23 file(s) to project 'my-project' on https://cloud.basicmemory.com...
  ✓ README.md
  ✓ src/main.py
  ✓ src/utils.py
  ✓ docs/guide.md
  ...
Successfully uploaded 23 file(s)!

Local File Access

Basic Memory Cloud supports mounting your cloud files locally using rclone, enabling real-time editing with your favorite text editor or IDE. Changes made locally are automatically synchronized to the cloud.

Setup

Before mounting files, you need to set up the local access system:

bm cloud setup

This command will:

  1. Check if rclone is installed (and install it if needed)
  2. Retrieve your tenant information from the cloud
  3. Generate secure, scoped credentials for your tenant
  4. Configure rclone with your tenant's storage settings
  5. Display instructions for mounting your files

Mounting Files

Mount your cloud files to a local directory:

# Mount with default (balanced) profile
bm cloud mount

# Mount with specific profile
bm cloud mount --profile fast
bm cloud mount --profile balanced
bm cloud mount --profile safe

Mount Profiles

Different profiles optimize for different use cases:

  • fast: Ultra-fast development (5s sync, higher bandwidth)

    • Cache time: 5s, Poll interval: 3s
    • Best for: Active development, frequent file changes
  • balanced: Fast development (10-15s sync, recommended)

    • Cache time: 10s, Poll interval: 5s
    • Best for: General use, good balance of speed and reliability
  • safe: Conflict-aware mount with backup (15s+ sync)

    • Cache time: 15s, Poll interval: 10s
    • Includes conflict detection and backup functionality
    • Best for: Collaborative editing, important documents

Mount Status

Check the current mount status:

bm cloud mount-status

Example output:

                               Cloud Mount Status
┏━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ Property         ┃ Value                                                     ┃
┡━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ Tenant ID        │ 63cd4020-2e31-5c53-bdbc-07182b129183                      │
│ Mount Path       │ ~/basic-memory-63cd4020-2e31-5c53-bdbc-07182b129183       │
│ Status           │ ✓ Mounted                                                 │
│ rclone Processes │ 1 running                                                 │
└──────────────────┴───────────────────────────────────────────────────────────┘

Available mount profiles:
  fast: Ultra-fast development (5s sync, higher bandwidth)
  balanced: Fast development (10-15s sync, recommended)
  safe: Conflict-aware mount with backup

Unmounting Files

Unmount your cloud files and clean up processes:

bm cloud unmount

This command will:

  1. Unmount the filesystem
  2. Kill any running rclone processes
  3. Clean up temporary files

Working with Mounted Files

Once mounted, your cloud files appear as a regular directory on your local system. You can:

  • Edit files with any text editor or IDE
  • Create new files and directories
  • Move and rename files
  • Use command-line tools like grep, find, etc.

Example Workflow

# Set up local access
bm cloud setup

# Mount your files
bm cloud mount --profile balanced

# Navigate to your mounted files
cd ~/basic-memory-{your-tenant-id}

# Edit files with your preferred editor
code my-notes.md
vim research/paper.md

# Changes are automatically synced to the cloud
# Check sync status
bm cloud mount-status

# When done, unmount
bm cloud unmount

Technical Details

  • Protocol: Uses rclone with NFS mount (no FUSE dependencies)
  • Storage: Files are stored in Tigris object storage (S3-compatible)
  • Sync: Bidirectional synchronization with configurable cache settings
  • Security: Uses scoped, time-limited credentials for your tenant only
  • Compatibility: Works on macOS, Linux, and Windows

Instance Management

Health Check

Check if a cloud instance is healthy and get version information:

bm cloud status

Example output:

Cloud instance is healthy
  Status: ok
  Version: 0.14.4
  Timestamp: 2024-01-15T10:30:00Z

WebDAV Protocol

File uploads use the WebDAV protocol for efficient, resumable file transfers. The CLI handles:

  • Directory structure preservation
  • File metadata preservation (timestamps)
  • Error handling and retry logic
  • Progress reporting

WebDAV Endpoints

Files are uploaded to: {host_url}/{project}/webdav/{file_path}

Example:

  • Host: https://cloud.basicmemory.com
  • Project: my-research
  • File: docs/notes.md
  • WebDAV URL: https://cloud.basicmemory.com/proxy/my-research/webdav/docs/notes.md

Authentication Configuration

By default, the CLI uses production authentication settings. For development or custom deployments, you can override these settings.

Production vs Development

  • Production (default): Uses client_01K4DGBWAZWP83N3H8VVEMRX6W and https://eloquent-lotus-05.authkit.app
  • Development: Uses client_01K46RED2BW9YKYE4N7Y9BDN2V and https://exciting-aquarium-32-staging.authkit.app

Environment Variables

# For development environment
export BASIC_MEMORY_CLOUD_HOST="https://development.cloud.basicmemory.com"
export BASIC_MEMORY_CLOUD_CLIENT_ID="client_01K46RED2BW9YKYE4N7Y9BDN2V"
export BASIC_MEMORY_CLOUD_DOMAIN="https://exciting-aquarium-32-staging.authkit.app"

bm cloud login

Configuration File

You can also set the values in ~/.basic-memory/config.json:

development

{
  "cloud_host": "http://development.cloud.basicmemory.com", 
  "cloud_client_id": "client_01K46RED2BW9YKYE4N7Y9BDN2V",
  "cloud_domain": "https://exciting-aquarium-32-staging.authkit.app"
}

Troubleshooting

Authentication Issues

Problem: "Not authenticated" errors Solution: Re-run the login command:

bm cloud login

Problem: Wrong environment (dev vs prod) Solution: Check and set the correct environment variables or config

Upload Issues

Problem: "No files found to upload" Solution: Check gitignore filtering or use --no-gitignore:

bm cloud upload my-project ./path --no-gitignore

Problem: Upload timeouts Solution: The CLI uses a 5-minute timeout for large uploads. For very large files, consider breaking them into smaller chunks.

Connection Issues

Problem: "API request failed" errors Solution:

  1. Verify the cloud instance is running: bm cloud status
  2. Check your internet connection

Mount Issues

Problem: "rclone not found" during setup Solution: The setup command will attempt to install rclone automatically. If this fails:

  • macOS: brew install rclone
  • Linux: sudo snap install rclone or sudo apt install rclone
  • Windows: winget install Rclone.Rclone

Problem: Mount fails with permission errors Solution:

  • Ensure you have proper permissions for the mount directory
  • On Linux, you may need to add your user to the fuse group
  • Try unmounting any existing mounts: bm cloud unmount

Problem: Files not syncing or appearing outdated Solution:

  1. Check mount status: bm cloud mount-status
  2. Try remounting with a faster profile: bm cloud mount --profile fast
  3. Unmount and remount: bm cloud unmount && bm cloud mount

Problem: Multiple mount processes running Solution: Clean up orphaned processes:

bm cloud unmount  # This will clean up all processes
bm cloud mount    # Fresh mount

Security

  • All communication uses HTTPS
  • OAuth 2.1 with PKCE provides secure authentication
  • Tokens automatically refresh when needed
  • Tokens are stored locally in ~/.basic-memory/basic-memory-cloud.json

Command Reference

# Authentication
bm cloud login

# Project management
bm cloud project list
bm cloud project add <name> [--default]

# File operations
bm cloud upload <project> <path>  [--no-preserve-timestamps] [--no-gitignore]

# Local file access
bm cloud setup                           # Set up local access with rclone
bm cloud mount [--profile <profile>]     # Mount cloud files locally
bm cloud mount-status                    # Check mount status
bm cloud unmount                         # Unmount cloud files

# Instance management
bm cloud status

For more information about Basic Memory Cloud, visit the official documentation.