java-topology/docs/tickets/cockroachdb-0001-indexes-used-slice-contains-per-add.md
russell@unturf.com 9934133dcf whitepaper: 312 sites / 151 ecosystems — wave2+3 defect tables and PDF rebuild
Add 88 new defect entries to HIGH and MEDIUM tables:
  HIGH: mysql-0001/0002, mariadb-0001, redis-0001/0002, valkey-0001/0002, openvpn-0001,
        vlc-0001, prometheus-0001, otel-collector-0001, cockroachdb-0001..0004,
        tidb-0001..0008, kubernetes-0001/0002, go-0001, kotlin-0002, scala-0001,
        allegro5-0001, sdl2-0001, grafana-0001, clickhouse-0001, duckdb-0001,
        mongodb-0001, envoy-0001, istio-0001, cilium-0001, linkerd2-0001,
        linux-0001/0002/0003, tor-0002/0003, curl-0001, julia-0001, lua-0001,
        perl5-0001, nats-0001, spring-0003/0004, tomcat-0001, onos-0002, odl-0002

  MEDIUM: helm-0001, mariadb-0002, openssl-0001/0002, memcached-0001,
          cassandra-0001..0004, flink-0001, storm-0001/0002, zookeeper-0001..0003,
          pip-0001, gradle-0001, nginx-0001, haproxy-0001, caddy-0001, varnish-0001,
          ffmpeg-0001, gstreamer-0001, raylib-0001, love2d-0001, php-0001/0002,
          r-source-0001, cpython-0002, ruby-0001, rabbitmq-0003/0004, activemq-0001,
          ovs-0001, onos-0003, odl-0002, jetty-0001

PDF: 976K
2026-03-27 15:23:43 -04:00

2 KiB
Raw Blame History

cockroachdb-0001: IndexesUsed.add() slices.Contains on growing slice — O(N²)

Severity: MEDIUM File: pkg/sql/opt/exec/execbuilder/builder.go Line: 206216 Status: PATCHED

Description

IndexesUsed accumulates the set of (tableID, indexID) pairs referenced by a query. Its add method deduplicates by scanning the existing slice:

func (iu *IndexesUsed) add(tableID, indexID cat.StableID) {
    s := struct{ tableID cat.StableID; indexID cat.StableID }{tableID, indexID}
    if !slices.Contains(iu.indexes, s) {
        iu.indexes = append(iu.indexes, s)
    }
}

add is called once per index reference during execution plan building (relational.go lines 859, 1009, 2475, 2999, 3197, 3339×2, 4123, 4170). A query joining N tables each with multiple indexes calls add O(N) times; each call scans the slice from position 0, giving O(N²) total comparisons.

For a 200-table star-schema query this is ~20 000 struct comparisons where a map lookup would be ~200.

Root Cause

IndexesUsed uses []struct{...} as its backing store. slices.Contains performs a linear scan. No map or set is used to track membership separately.

Fix

Replace the slice with a map for O(1) deduplication; keep the slice for ordered iteration in Strings():

type IndexesUsed struct {
    indexes []struct {
        tableID cat.StableID
        indexID cat.StableID
    }
    seen map[[2]cat.StableID]struct{}
}

func (iu *IndexesUsed) add(tableID, indexID cat.StableID) {
    key := [2]cat.StableID{tableID, indexID}
    if iu.seen == nil {
        iu.seen = make(map[[2]cat.StableID]struct{})
    }
    if _, ok := iu.seen[key]; !ok {
        iu.seen[key] = struct{}{}
        iu.indexes = append(iu.indexes, struct {
            tableID cat.StableID
            indexID cat.StableID
        }{tableID, indexID})
    }
}

Strings() is unchanged — it still iterates iu.indexes.

Speedup

O(N²) → O(N). ~100x at N=200 indexes per complex query.