collapse

GitHub - AdrianAntico/Benchmarks: Compare run times for various data frame packages Compare run times for various data frame packages. Contribute to AdrianAntico/Benchmarks development by creating an account on GitHub.

Updated windows benchmarks for in-memory database-like operations by Adrian Antico show that {collapse} still leads on lagging and casting benchmarks (not covered in DuckDB benchmarks) and remains overall very competitive: github.com/AdrianAntico...

#Rstats #DataScience

fastverse/collapse | DeepWiki collapse is a C/C++-based R package providing an integrated suite of statistical and data manipulation functions optimized for performance and memory efficiency. The package implements a class-agnosti

A few updates:
(1) the fastverse now has a domain at fastverse.org
(2) the collapse (kit) repos moved to github.com/fastverse/co... (/kit) and website to fastverse.org/collapse/ (/kit).
(3) A group of maintainers has been granted access.
(4) collapse has a DeepWiki (deepwiki.com/fastverse/co...)

{collapse} 2.1.0 is out! It introduces a new fslice() function (sebkrantz.github.io/collapse/ref...), a new theory-consistent weighted quantile algorithm (sebkrantz.github.io/collapse/ref...) with excellent properties. And some convenience features such as join requirements: #rstats #DataScience

collapse: Advanced and Fast Statistical Computing and Data Transformation in R collapse is a large C/C++-based infrastructure package facilitating complex statistical computing, data transformation, and exploration tasks in R - at outstanding levels of performance and memory eff...

The {collapse} (@rcollapse.bsky.social) arXiv paper has just been updated - following extensive revision: arxiv.org/abs/2403.05038. I believe it is a great resource for anyone doing scientific computing with #rstats.

Benchmarks An Extensible Suite of High-Performance and Low-Dependency Packages for Statistical Computing and Data Manipulation in R - fastverse/fastverse

There is now a #fastverse benchmark wiki (github.com/fastverse/fa...) where users can freely contribute benchmarks. If you have benchmarks involving {fastverse} packages ({collapse}, {data.table}, etc., including extensions) please contribute them (takes 1 min) #rstats #DataScience

I just improved the vignette a bit further, adding some detailed benchmarks and a section on Global Options. I needed to correct myself: it is not true that {collapse} global options should never be invoked in packages - they just need to be reversed like #rstats global options.

It's nice to see an increasing number of #rstats packages use {collapse}. A developer focused vignette was long planned and now it is here - with modest advice on writing efficient R package code in general and using {collapse} in particular: sebkrantz.github.io/collapse/art...