ruby.git/lib/bundler/compact_index_client, branch v3_4_1

[rubygems/rubygems] Revert to splitting parser due to performance regression

2024-06-20T06:18:56+00:00

* The string search parser was more memory efficient but
  in some cases, much slower. Reverting until a better
  solution is found.
* Handle the situation where the line might be blank (Artifactory bug)

https://github.com/rubygems/rubygems/commit/222d38737d

[rubygems/rubygems] String search based parsing of compact index versions

2024-05-31T20:20:03+00:00

This significantly reduces memory usage.

https://github.com/rubygems/rubygems/commit/8a76506c90

[rubygems/rubygems] Reorganize and refactor CompactIndexClient

2024-05-25T17:47:07+00:00

https://github.com/rubygems/rubygems/commit/71bcf354f5

[rubygems/rubygems] update cache checksums to decrease string allocations

2024-05-24T21:04:21+00:00

https://github.com/rubygems/rubygems/commit/85371a961a

[rubygems/rubygems] Remove MD5 ETag generation from compact index

2024-05-23T22:57:26+00:00

This was an offramp for generated etags to allow existing caches
to be served until people could upgrade. It has been about 6 months
since the transitional version was released, so we can remove this
transitional code now.

https://github.com/rubygems/rubygems/commit/4ec8cfe611

[rubygems/rubygems] Quote Etag in `If-None-Match` header of compact index request

2024-01-05T02:06:58+00:00

https://github.com/rubygems/rubygems/commit/d26bcd7551

[rubygems/rubygems] Use vendored net-http in Bundler

2023-12-13T03:16:55+00:00

https://github.com/rubygems/rubygems/commit/0d758e8926

[rubygems/rubygems] Prefer String#split with block in Bundler::CompactIndexClient::Cache#versions

2023-12-05T05:28:39+00:00

String#split supports a block since Ruby 2.6, avoiding intermediate array.

https://github.com/rubygems/rubygems/commit/4e864a8f2e

Opaque Etags for compact index requests

2023-11-27T06:04:40+00:00

This changes the CompactIndexClient to store etags received from the
compact index in separate files rather than relying on the MD5 checksum
of the file as the etag.

Smoothes the upgrade from md5 etags to opaque by generating them when no
etag file exists. This should reduce the initial impact of changing the
caching behavior by reducing cache misses when the MD5 etag is the same.

Eventually, the MD5 behavior should be retired and the etag should be
considered completely opaque with no assumption that MD5 would match.

[rubygems/rubygems] Reduce allocations when parsing compact index

2023-10-08T04:17:15+00:00

This still allocates a ton (a string for each line, plus a bunch of
splits into arrays), but it helps a bit when Bundler has to go through
dependency resolution.

```
==> memprof.after.txt <==
Total allocated: 194.14 MB (2317172 objects)
Total retained:  60.81 MB (593164 objects)

==> memprof.before.txt <==
Total allocated: 211.97 MB (2404890 objects)
Total retained:  62.85 MB (640342 objects)
```

https://github.com/rubygems/rubygems/commit/c68b41b0e5