Skip to main content
v1.0.0 will introduce breaking changes to this documentation

​
Introduction

The core architecture components, that is; Core Agent, Vector Embedding Engine and Vector Enhanced Search can be configured using their specific configuration TOML files. Specific configuration options for each component are explained. As much as these explanations are considered a good starting point, it is recommended you play around with your configuration options to find what works best for you.
v0.1.0 only supports configuration for the core agent, see Coming Soon

​
Core Agent Configuration

The agent’s default configuration can be found at the project’s config directory on your local repo 
cd VES/services/log-collector/src/config
This is the default configuration file, ensure this is exactly how the configuration file looks like before you set your own configuration options 
[general]
enable_local_mode = true
enable_network_mode = true

[watcher]
enabled = true
checkpoint_path = "path/to/checkpoint.json"
log_dir = "path/to/log/file(s)/directory"
poll_interval_ms = 5000
recursive = false

[parser]

[buffer]
capacity_option = "unbounded"
buffer_capacity = 10000
batch_size = 200
batch_timeout_ms = 500
overflow_policy = "drop_oldest"
flush_policy = "batch_size"
drain_policy = "batch_size"

[buffer.durability]
type = "s-q-lite"
path = "/var/ves-sqlite-db/parsed_log_buffer.db"

[shipper]
embedder_target_addr = "https://127.0.0.1:50051"
connection_timeout_ms = 500
max_reconnect_attempts = 10
initial_retry_delay_ms = 500
max_retry_delay_ms = 30000
backoff_factor = 2.0
retry_jitter = 0.2
send_timeout_ms = 3000
response_timeout_ms = 10000
  • [general]
  • [watcher]
  • [parser]
  • [buffer]
  • [buffer.durability]
  • [shipper]
Configures Core Agent to expect your observability data locally, over-the-network or from both sources
[general]
enable_local_mode = true
  1. Local mode set to true when Core Agent is running on the same node as your observability data producer
  2. Over-the-network mode set to true when Core Agent is running on a separate node from your observability data producer
  3. Dual mode set both local and over-the-network mode to true, when Core Agent is running on a node producing observability data but should collect data from another node

​
Vector Embedding Engine Configuration

Coming Soon!

​
Vector Enhanced Search Configuration

Coming Soon!

​
Next Steps

Setup an instance

Setup and configure your own instance locally

Learn more about VES

Understand how the platform is designed and works