All pull requests

Pull requests

• perf: preserve supported Iceberg residual conjuncts

  area:Icebergarea:scanenhancementperformance
  #6847·rich7420 opened Oct 10, 2026Contributor·

  ·
  1

• chore: re-enable unused-parameter warnings in strict profile

  area:aggregationarea:expressionsarea:Icebergarea:scanenhancement
  #6846·rich7420 opened Oct 10, 2026Contributor·

  ·
  1

• perf: reduce retained buffers for nested map lookups

  area:expressionsenhancementperformance
  #6845·rich7420 opened Oct 10, 2026Contributor·

  ·
  1

• fix: cast string to date for years outside chrono's NaiveDate range

  area:expressionsbug
  #6844·viirya opened Oct 10, 2026Member·

  ·
  1

  3

• fix: accept all BMP Unicode decimal digits in cast(string as decimal)

  area:expressionsbug
  #6841·viirya opened Oct 10, 2026Member·

  ·
  1

  3

• fix: read fs.comet.libhdfs.schemes for the scan rule from the Hadoop conf

  area:scanbug
  #6838·dwsmith1983 opened Oct 10, 2026Contributor·

  ·
  1

  1

• test: count the partitions and batches the native cache scan reads

  area:scanenhancementrun-spark-4.1-teststest
  #6836·andygrove opened Oct 10, 2026Member·

  ·

• fix: keep a streamed side sorted outside the native plan in order through outer hash joins

  bug
  #6835·andygrove opened Oct 10, 2026Member·

  ·
  1

• Integral sequence optimisation

  area:expressions
  #6833·nat-openai opened Oct 10, 2026·

  ·

• fix: handle truncation operands in scalar evaluation and rewrites

  area:expressionsbug
  #6831·nat-openai opened Oct 9, 2026·

  ·

• fix: raise DIVIDE_BY_ZERO from native corr on a zero denominator in ANSI mode

  area:aggregationbug
  #6830·kazuyukitanimura opened Oct 9, 2026Contributor·

  ·
  1

  3

• fix: match Spark percentile ordering for negative NaNs

  area:aggregationbug
  #6829·rich7420 opened Oct 9, 2026Contributor·

  ·
  1

• docs: list the S3A settings the Iceberg native-write gate ignores

  area:Icebergdocumentation
  #6828·andygrove opened Oct 9, 2026Member·

  ·

• fix: preserve CASE WHEN struct field names from the first THEN branch

  area:expressionsbug
  #6827·pingzh opened Oct 9, 2026Contributor·

  ·
  1

  1

• fix: do not fail planning on a cast of a literal that fails to evaluate

  area:expressionsbug
  #6826·viirya opened Oct 9, 2026Member·

  ·
  2

  11

• perf: bulk-append long nullable primitive arrays in SparkUnsafeArray conversion

  area:shuffleenhancementperformance
  #6824·andygrove opened Oct 9, 2026Member·

  ·
  1

  11

• fix: run InsertIntoHadoopFsRelationCommand's post-write steps in the Spark 3.x native writer

  area:writerbugrun-all-spark-profiles
  #6821·viirya opened Oct 9, 2026Member·

  ·
  1

  3

• Introduce a budget for integral sequence byte allocations and improve native kernel performance

  area:expressions
  #6819·nat-openai opened Oct 9, 2026·

  ·
  6

• docs: add draft proposal to establish Apache Comet as a top-level project

  documentation
  #6817·andygrove opened Oct 9, 2026Member·

  ·
  3

• fix: [spark34] preserve empty Iceberg partitions after dynamic pruning

  area:Icebergarea:scanbug
  #6814·LinSimon-901101 opened Oct 9, 2026Contributor·

  ·
  1

  3

• refactor: share the missing task entry retry between the shuffle allocator and the native pool

  area:memoryarea:shufflebugrun-all-spark-profiles
  #6813·viirya opened Oct 9, 2026Member·

  ·
  1

  9

• fix: keep a native hash join's streamed order when Spark drops the sort above it

  bug
  #6810·dwsmith1983 opened Oct 9, 2026Contributor·

  ·
  1

  7

• fix: don't let S3A committer, delete and read defaults block native Iceberg writes

  area:Icebergarea:writerbug
  #6808·andygrove opened Oct 8, 2026Member·

  ·
  3

• perf: read shuffle blocks in 64 KiB pieces instead of through Channels.newChannel

  area:shuffleenhancementperformance
  #6805·comphead opened Oct 8, 2026Contributor·

  ·
  4

• feat: run broadcast joins natively when an unsupported scan is on the build side

  area:joinsenhancementrun-all-spark-profilesrun-iceberg-testsrun-spark-3.4-testsrun-spark-4.1-hive-testsrun-spark-4.1-tests
  #6786·parthchandra opened Oct 8, 2026Contributor·

  ·
  20