Skip to content

Multi-statement DML on one Lance table in a transaction: partial commit and no read-your-writes #313

Open

Description

@jackylee-ch

Several DML statements on one Lance table inside BEGIN ... COMMIT lose a change or fail COMMIT part-way with earlier statements already published (e.g. UPDATE; UPDATE conflicts, INSERT (11); DELETE WHERE id=11 keeps row 11). Each statement builds its own Lance transaction on the last committed version, and Lance 14.0.x cannot read or atomically commit uncommitted writes.

#312 fails closed for these combinations. The proper fix is Lance Transaction V2 staged transactions (lance-format/lance#7954, #8646, #10722), which currently cover append only. I propose keeping the guard and adopting V2 here, then removing the guard, once it covers delete and update.

Activity

  1. Xuanwo commented on Nov 18, 2026

    @Xuanwo
    Member

    Checked the upstream state today; the prerequisite is still not met, so this stays open.

    The #312 guard therefore remains correct. This issue stays open until Lance can stage and atomically commit delete/update, that lands on main and ships in a release, and this extension adopts the V2 path and removes the guard.

  2. jackylee-ch commented on Nov 18, 2026

    @jackylee-ch
    ContributorAuthor

    Thanks for the detailed update! That was exactly my intention in opening this issue: to document the current limitation and track the upstream Lance work needed to support multi-statement transactions on a Lance table.

    I agree with keeping the guard in place and leaving this issue open until the required upstream support is released and integrated into lance-duckdb.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions