Skip to content

[Autoloop: perf-comparison] - #435

Merged
mrjf merged 127 commits into
mainfrom
autoloop/perf-comparison
Aug 24, 2026
Merged

[Autoloop: perf-comparison]#435
mrjf merged 127 commits into
mainfrom
autoloop/perf-comparison

Conversation

@github-actions

Copy link
Copy Markdown
Contributor

🤖 This PR is maintained by Autoloop. Each accepted iteration adds a commit to this branch.

Autoloop: perf-comparison

Goal: Benchmark every tsb function vs pandas equivalent.

Current Best Metric: 756 benchmarked function pairs

Program Issue: #221


Latest Iteration (418)

Added firstValidIndex / lastValidIndex benchmarks:

  • TypeScript: benchmarks/tsb/bench_first_last_valid_index.ts — 100k-row Series with NaN at start, end, and scattered; 500 measured iterations
  • Python: benchmarks/pandas/bench_first_last_valid_index.py — matching dataset and loop structure using Series.first_valid_index() / Series.last_valid_index()

Metric: 755 → 756 (+1)

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • releaseassets.githubusercontent.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "releaseassets.githubusercontent.com"

See Network Configuration for more information.

Generated by Autoloop · 1.4K AIC · ⌖ 12.1 AIC · ⊞ 51.8K ·
Comment /autoloop to run again

…ndex benchmark

Run: https://github.com/githubnext/tsb/actions/runs/30010910150

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
github-actions Bot and others added 2 commits July 23, 2026 13:33
Benchmark BooleanArray extension array (100k elements, ~10% nulls, 50 iters):
from/any/all/sum/and/or/not/fillna. TS: arrays.BooleanArray from tsb;
Python: pd.array(dtype='boolean').

Run: https://github.com/githubnext/tsb/actions/runs/30058807058

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 402ebd6

Generated by Autoloop · 983.4 AIC · ⌖ 11.9 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 8d70dac

Generated by Autoloop · 1.2K AIC · ⌖ 12 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

🤖 Iteration 420✅ Accepted

  • Change: Added StringArray extension array benchmarks (bench_string_array.ts / bench_string_array.py)
  • Metric: 758 (best: 758, delta: +1)
  • Commit: 8d70dac
  • Result: Benchmarks cover from/upper/lower/strip/contains/len/fillna on 100k-element arrays with ~10% nulls (50 measured iterations). Python uses pd.array(dtype="string") with equivalent .str accessor methods.

Generated by Autoloop · 1.2K AIC · ⌖ 12 AIC · ⊞ 51.8K ·
Comment /autoloop to run again

Add bench_datetime_array.ts and bench_datetime_array.py benchmarking
nullable datetime extension array: from/year/month/day/isna/notna/fillna.
100k elements with ~10% nulls, 50 iterations.

Run: https://github.com/githubnext/tsb/actions/runs/30138360760

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 7500ea9

Generated by Autoloop · 669.6 AIC · ⌖ 11.8 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 25, 2026 01:30
Add bench_timedelta_array.ts and bench_timedelta_array.py benchmarks for
TimedeltaArray (100k elements, ~10% nulls, 50 iters): from/days/hours/
totalSeconds/isna/notna/sum/min/max/fillna.

Run: https://github.com/githubnext/tsb/actions/runs/30159549081

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 744e7b2

Generated by Autoloop · 845.1 AIC · ⌖ 11.9 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 25, 2026 13:32
Add matched TypeScript + Python benchmarks for Gaussian KDE (evaluate + integrate)
on a bimodal 10k-point dataset with 200 evaluation points, 20 iterations.

Run: https://github.com/githubnext/tsb/actions/runs/30182788398

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: dfda6b1

Generated by Autoloop · 1.8K AIC · ⌖ 12 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 66c5b82

Generated by Autoloop · 678.6 AIC · ⌖ 11.6 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 26, 2026 13:29
…tropy/jsDivergence/jsDistance/crossEntropy benchmark

Run: https://github.com/githubnext/tsb/actions/runs/30248425219

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 6fdb111

Generated by Autoloop · 1.1K AIC · ⌖ 12.1 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 27, 2026 08:17
…alEntropy/variationOfInformation benchmark

1000-element paired observations, 10 categories, 50 iters each.
Python: pure-numpy implementations matching tsb semantics.

Run: https://github.com/githubnext/tsb/actions/runs/30297867311

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 320e47d

Generated by Autoloop · 1.2K AIC · ⌖ 12 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: c70d0c3

Generated by Autoloop · 8.8K AIC · ⌖ 11.9 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 20, 2026 13:54
Add JS divergence/distance, cross-entropy, and conditional-entropy benchmarks
comparing tsb information-theory functions against numpy equivalents.

Run: https://github.com/githubnext/tsb/actions/runs/32406958975

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 1306df5

Generated by Autoloop · 1.5K AIC · ⌖ 12 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 20, 2026 19:18
Add renyiEntropy, tsallisEntropy, variationOfInformation benchmarks (N=1000, 50 iters).
Run: https://github.com/githubnext/tsb/actions/runs/32457469342

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 1ac58e2

Generated by Autoloop · 884.6 AIC · ⌖ 12 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 21, 2026 07:23
Add benchmark pair for seriesBetween() standalone function with all four
inclusive modes (both/left/right/neither) on 100k-element numeric Series.
Mirrors pandas Series.between(inclusive=...) benchmark.

Run: https://github.com/githubnext/tsb/actions/runs/32516695675

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: cf899e3

Generated by Autoloop · 5.8K AIC · ⌖ 12 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 21, 2026 19:32
…et — MO/TH/FR weekday offsets

Add benchmark pair for Holiday with weekday offset constructors (MO, TH, FR).
Benchmarks floating holidays (3rd Monday of January, 4th Thursday of November, etc.)
over a 10-year range. This specifically exercises the MO/TU/WE/TH/FR/SA/SU
weekday offset factory functions that were not previously covered.

Run: https://github.com/githubnext/tsb/actions/runs/32558735667

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: a73895b

Generated by Autoloop · 5.9K AIC · ⌖ 12.3 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 22, 2026 07:33
…— crossEntropy, jointEntropy, conditionalEntropy from information.ts

Run: https://github.com/githubnext/tsb/actions/runs/32592447666

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: c46fbfa

Generated by Autoloop · 1.5K AIC · ⌖ 12 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 22, 2026 19:19
… — toOffset and inferFreq from tseries/frequencies.ts

Run: https://github.com/githubnext/tsb/actions/runs/32624724971

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: ea2e516

Generated by Autoloop · 2.5K AIC · ⌖ 12.1 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 23, 2026 07:24
…essors benchmark

Add bench_datetime_array_advanced — hour, minute, second, millisecond,
dayofweek, dayofyear, quarter, min, max on 100k-element DatetimeArray
with ~10% nulls. Mirrors pandas DatetimeArray advanced accessor coverage.

Run: https://github.com/githubnext/tsb/actions/runs/32659855303

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 6e6f772

Generated by Autoloop · 4.7K AIC · ⌖ 12 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 23, 2026 19:25
…tic benchmark

Adds bench_timedelta_array_arithmetic covering TimedeltaArray.add/sub/mul
(scalar and array operands) plus extended component accessors not in the
existing bench_timedelta_array: .minutes, .milliseconds, .totalMilliseconds,
.totalHours, .totalDays.

Run: https://github.com/githubnext/tsb/actions/runs/32700718376

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: a6aea3b

Generated by Autoloop · 8.3K AIC · ⌖ 12.2 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

🤖 Iteration 481✅ Accepted

Added bench_timedelta_array_arithmetic benchmarking TimedeltaArray.add/sub/mul (array and scalar operands) plus extended component accessors (.minutes, .milliseconds, .totalMilliseconds, .totalHours, .totalDays). Metric: 821 (+1 from 820).

Generated by Autoloop · 8.3K AIC · ⌖ 12.2 AIC · ⊞ 51.8K ·
Comment /autoloop to run again

@mrjf
mrjf marked this pull request as ready for review August 24, 2026 15:17
@mrjf
mrjf merged commit c853cbf into main Aug 24, 2026
10 checks passed
@mrjf
mrjf deleted the autoloop/perf-comparison branch August 24, 2026 15:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant