Mach5 Search v5.10.0

Migration Guide

Upgrading from v5.8.0 or earlier requires following the migration guide introduced in v5.9.0. Migrating to v5.9.0

mach5-sdk-ts version 2.1.0

To use mach5-sdk-ts with v5.10.0, it is necessary to upgrade to version 2.1.0. This update adds support for handling ExecutionEvent in the query result stream. ExecutionEvent contains telemetry data related to query execution.

What’s Changed

Bug Fixes

  • Fixed a hang-inducing bug in replicate stream operations involving query dataflows
  • Fixed various issues with MQL joins

MQL Query & Language Improvements

  • Fixed the MQL parser to correctly accept parenthesized expressions
  • Resolved multiple issues in join processing

Garbage Collection

  • Added support for orphaned file garbage collection
  • Fixed multiple issues related to orphaned file garbage collection
  • Improved robustness and safety of deletion cycles

Configuration Changes

Resource Configuration for `fdb-reconciler`

You can now configure resource requests and limits for the fdb-reconciler pod via values.yaml:

fdbreconciler:
  resources:
    limits:
      memory: "1Gi"
    requests:
      memory: "512Mi"

Garbage Collector Configuration

The following parameters allow fine-grained control over orphaned file garbage collection behavior:

fdbreconciler:
  env:
    orphanedFileGracePeriodDurationSeconds: "604800" # 7 days
    orphanedFilePruneFrequencySeconds: "300"
    orphanedFilePruneDryRun: "true"
    orphanedFileMaxInFlightDeletes: "8"
    orphanedFileMaxFailedDeletesPerCycle: "32"

Notes:

  • orphanedFilePruneDryRun allows safe validation before enabling deletions
  • Grace period ensures files are not prematurely removed
  • Throttling controls help prevent overload during cleanup