Didn't these used to be called Argo Tunnels a long time ago? I think Argo Tunnels got repositioned for connecting to origin servers without needing an incoming connection to the origin but I thought they originally did something like this/ngrok

Yeah, I just checked the page >can connect their server to the Internet with Argo Tunnel for free

There was a problem with the name: toxic mine trailings weren't what was wanted. https://en.wikipedia.org/wiki/Argo_Tunnel

Don't think we had any issues with Warp but Cloudflare APIs are a bit of a mess. Seems like they've cobbled together and then renamed/rearranged things multiple times now and it's a bit hard to keep up.

Terraform has worked decently well especially since there's a few random settings here and there that aren't exposed anywhere in the UI (facepalm)

Yeah but you lose anonymity unless you can devise a scheme to identify advertisers and bots separately from and without identifying real humans.

RIP NAT

https://gitlab.com/gitlab-org/gitlab

Makes 12 graphql API calls and 2 /api/v4 calls... So you get like 4 pages per hour unauth?

Presumably but I wish they'd also focus on optimizing code/making pages fully cacheable instead of rate-limits and blocking

Making requests is inherently cheaper than delivering responses, even with caches. Efficiency improvements can buy a little time on a given resources but won't solve the problem of bot saturation now that everybody can spawn a custom bot in about 12 seconds and is being encouraged to do so.

Rate limits, blocking, and pay-per-use are the only roads out and even those might not last as models get better at hacking and masquerading.

The internet we want to use LLM's with is simply not one that can support LLM's, and with LLM's not going anywhere, the whole experience of the internet is going to be forced into some radically less open and more expensive paradigm.

Policies like this just represent the beginning of the transition.

The limits are for API requests, no? Or is this just an unrelated performance complaint?

Last I checked, they just blanket added `cache-control: max-age=0` to everything.

Loading https://gitlab.com/gitlab-org/gitlab is showing 14 API calls so presumably significantly more DB queries for a public page

I can pay Amazon pennies on the dollar to saturate 100Gbps with arbitrarily high concurrency

Sometimes I also want a smaller version for when I don't need that performance but don't want multiple implementations of storage backends

Edit: before someone says NVMe, highly available across 3 fault domains

For testing/dev setups you can turn sync off and get some performance back but that's only useful for cases where losing data is okay.

I think it's possible to get an LLM to run your business but I think it's still prohibitively expensive to spend the time and money getting guardrails, skills, knowledge, context setup.

Getting it to work reliably is quite the feat. AI coding is a much lower bar when there's (ideally) still a human expert that can set it straight when it goes awry.

I also think some of these debates get hung up on what's possible and ignore what's feasible and practical.

Knowing Meta, I'd be more surprised if they _didn't_ distill frontier models than if they did...

Not a lawyer but distillation sounds like a transformative work.

Same thing as Cliff Notes imo. In every other area of manufacturering and tech I can use a machine to build a new machine that competes with the original machine. Should Milwaukee be able to prevent DeWalt from using their drill to make a competing drill? Should Jetbrains ban Eclipse contributors from using their IDE?

My guess is that when you sign up for either Anthropic or OpenAI, the terms of use specify you can't use their model for purpose A, B, C, D. For example, you can't use their model to try to build biological weapons, or to try to extort people, etc. Most likely there is language there that you can't use their models to train other models. It's as simple as that. You agree to those terms of use, or you don't use their models.

How can we prove intent? I’m sure a clever actor can disguise their prompt and simply claim the LLM suggested such and such on its own.

It’s not like Anthropic or OpenAI have the faintest idea how their models actually work.