SQLite FTS5 full-text search implementation.

Uses FTS5 virtual tables with external-content support, porter/ascii tokenizers, and rowid-based joins to the content table.

Implements

Constructors

Methods

  • Generate DDL to create the full-text search index.

    Run it with exec(), which runs a script of several statements. On PostgreSQL the script holds DO blocks with semicolons inside them, so a caller that splits it on ; itself would cut them.

    Parameters

    • config: {
          table: string;
          columns: string[];
          contentTable?: string;
          tokenizer?: string;
      }
      • table: string

        Name for the FTS index/virtual table.

      • columns: string[]

        Columns to index.

      • OptionalcontentTable?: string

        Source table (for external-content FTS5).

      • Optionaltokenizer?: string

        Tokenizer config (e.g. 'porter ascii').

    Returns string

  • Generate a WHERE clause fragment for full-text matching. SQLite: memory_traces_fts MATCH ? Postgres: _tsv @@ websearch_to_tsquery('english', $1), in the index's own language

    Parameters

    • indexName: string
    • queryPlaceholder: string

    Returns string

  • A rank value, in each engine's own direction. SQLite FTS5: memory_traces_fts.rank (lower is better) SQLite FTS4: length(offsets(memory_traces_fts)) (higher is better) Postgres: ts_rank(_tsv, websearch_to_tsquery('english', $1)) (higher is better) Use relevanceOrder to order the same way on every engine.

    Parameters

    • indexName: string
    • Optional_queryPlaceholder: string

    Returns string

  • An ORDER BY fragment that puts the best match first on every engine. SQLite FTS5: memory_traces_fts.rank SQLite FTS4: length(offsets(memory_traces_fts)) DESC Postgres: ts_rank(_tsv, websearch_to_tsquery('english', $1)) DESC

    Parameters

    • indexName: string
    • Optional_queryPlaceholder: string

    Returns string

  • Generate the rebuild/reindex command. SQLite: INSERT INTO fts_table(fts_table) VALUES('rebuild') Postgres: UPDATE content_table SET _tsv = to_tsvector('english', col1 || ' ' || col2)

    Parameters

    • indexName: string

    Returns string

  • Generate an INSERT to sync external-content FTS after a row insert. SQLite: INSERT INTO fts_table (rowid, col1, col2) VALUES (expr, ?, ?) Postgres: UPDATE content_table SET _tsv = to_tsvector(...) WHERE ...

    Parameters

    • indexName: string
    • rowIdExpr: string
    • columns: string[]

    Returns string

  • Sanitize natural-language input into a safe search query. Every engine: the words, quoted, joined with OR, with the operators of the query syntax stripped, so it matches the same rows everywhere.

    Parameters

    • input: string

    Returns string

  • Generate a SELECT joining the FTS index to the content table. This handles the structural difference between FTS5 (separate virtual table joined via rowid) and Postgres (tsvector column on the content table itself).

    Parameters

    • contentTable: string

      The base table (e.g. 'memory_traces').

    • contentAlias: string

      Alias for the content table (e.g. 't').

    • ftsAlias: string

      Alias for the FTS table/column (e.g. 'fts').

    • indexName: string

      FTS index/virtual table name.

    Returns string

    FROM/JOIN clause fragment.