Yep - so to be clear the reason we're not putting Crof as the provider for the "general" version of this model and doing this odd workaround is that we've had a few too many reports of people that think the Crof versions of model are (slightly) worse in some ways, so we figure people can decide for themselves which to use.

Thanks. Mimo 2.5 Pro we're aware - but frankly just unable to solve. Every provider we try for it has the same censoring issues (Xiaomi, Atlascloud, Novita, GMICloud) or quality issues (Deepinfra, Crof). If you've tried these providers (or others) and are not getting the censoring would love to hear, because we're at our wits end on that one.

In terms of GLM 5.2 - kind of same question, but any provider there where you do feel like it's good?

I’ve tested on both peak US/CN hours and off-peaks hours along with using providers that Nano may be routed to, the discounted ones for GLM 5.1/5.2 specifically. Is anyone else getting the same quality issue?

Can I ask - which ones DO seem good/okay? So right now for example GLM 5.2 is a lot of Fireworks FP8, Z AI (supposedly FP8) and Novita (FP8).

Someone a few days ago was claiming the ones that worked better were ones like Streamlake, Baidu etc, which we do not use (because of logging policies).

Not saying you're wrong by the way, just trying to figure out what we can do here. Openrouter and us use largely the same providers (though that depends on what you have set in terms of logging policies), so trying to think what we can do.

Same question for others in this thread actually - if people have been experimenting with PAYG/specific providers, would love to hear opinions on which ones DO work well for certain models. Because the most we can generally go off is "what quantization do they run models on" and "what are their logging policies", but that's clearly incomplete.

So what we see is that it has adaptive thinking - it does not always think, even when we try to "force" thinking.

So it's a work in progress - characters never was really a great integration so we kind of started from the ground up.

Pushed this literally just yesterday, but obviously work in progress:

https://nano-gpt.com/roleplay

We're considering making a roleplay.nanogpt.com, which we want to be a sort of.. simple version of SillyTavern, but then we also want to have all the extra options in there so that people can turn on an "advanced" version.

Idea is to make it as easy as possible to get started, because while most here on the SillyTavern subreddit I think are quite deep into how all of this works and the many different options, we figure there are also lots of people that are just looking for a "click character, get started". And we kind of have all the infrastructure at the ready for it.

Either way - work in progress (I know I keep repeating that), hopefully more soon!

As far as we know it has mandatory reasoning.

In our case we don't do it (or not on purpose at least) - but it's technically possible that a provider in a way caches for.. similar words, maybe?

Each chat is completely separate in the sense that we do not send a user identifier along, they're all just "NanoGPT".

We do try to maximize cache hits within a chat, so essentially we compare the hash of the first message in a chat (and system message) with other recent hashes, if it matches then it uses the same provider as was used for that message.

So that could cause this for within-conversation, but across conversations that hash would be different hence no specific routing.

Hope that makes sense, if not let me know.

For what it's worth you can also do that with us, just not in the subscription :)

Even www.nanogpt.com works nowadays - we need to move to that domain fully hah. Looks much better than with the dash. For now it's just a redirect.

Adding it in now.

Edit: added

Edit2: Will add it to subscription for now as well, should be live in ~10 minutes or so

Far as I know there aren't providers for base, unless I've missed them.

Yup - was an issue on our side. They output it slightly differently, we didn't parse it correctly. Thanks for the poke on it.

Were you using the deepseek v4 pro cheaper? Because the "regular" Deepseek v4 pro does not actually route via deepseek themselves, so it'd have to be the open source providers somehow having early access.

Yup! It is.

We might add it to subscription - mostly depends on whether more providers start hosting it. So far it's slim pickings, to be honest with you.

Hi.- when you say responses take extremely long to come through, do you mean it's a minute BEFORE the first response? As in, are you streaming and it takes that long to start returning? Or is this non stream?