I would start by measuring latency separately for: downloading, gunzipping, and untarring, just to get an idea for where the bottleneck is.
02.01.2026 03:42
👍 2
🔁 0
💬 0
📌 0
I would start by measuring latency separately for: downloading, gunzipping, and untarring, just to get an idea for where the bottleneck is.
You could also preprocess them and create an index to make this not speculative, but that only makes sense if you need to extract the same files more than once.
One thing I'd try to get a baseline (which isn't native rust but is very cool) is rapidgzip. Will burn more CPU but can speculatively decompress to get parallelism where there's usually none.
Do you have control over the files or are they third party?
Do you actually need to unpack to disk or do you just need random access to the file contents? You can avoid a lot of i/o by indexing the tar file and jumping around it.
Also is this x86_64 or aarch64? Or both?
What kind of throughput are you getting now? Are these on a local disk or are you downloading from somewhere? Do you have any CPU to spare?
> carries all the way up Mount Crumpett, and to the king of Grinch Night, simply known as the Grinch, signaling that Grinch Night has come.
> The sour sweet wind awakens the gree-grumps from their slumber in the tree stumps around Punkers Pond, and once woken up, the gree-grumps begin yowling, which upsets pond, which disturbed the hakken-kraks that live in the pond, and causes them to rise out of the water and begin yowling, which
hello
Can confirm I paid ~$35 for popcorn, drink, and candy across the lake. I paid about $5 more for the Wicked popcorn tin, so this math works out.
Owwwwww
Right now I can tell it it passed or failed based on the status, but we use different exit codes to indicate different types of failures, and I would love access to that info without having to scrape logs 🙏
I wonder if I could bribe @steren.fr to expose exit codes on cloud run jobs 🤔
That is so cute omg.
FWIW this series of lectures on compression is really, realy good (it is what finally got me to understand deflate): youtube.com/playlist?lis...
Shipped: ✅
Brilliant!
Once you have bookshelves up you can flip some books around to show the white pages until it all averages out to ~middle grey?
I would be nervous to do this because it would trip up webcam auto-exposure and make me look as bright as a supermoon lol
wow
😭
Decompress DEFLATE using only HTML5 Canvas retr0.id/stuff/canvas...
How's your back?
TIL it's not spelled stalagtites. I think I've only ever heard the word spoken by cave tour guides and never seen it.
Thanks, this is great. It will fix two bugs for me.
Reminds me of factorio logistics network.
They make a plug-in hybrid one, lol.
Add jalapeños next time.
