Banaxi PRO

you should invite @appvoid

Hey @appvoid

Are you gonna press it?

@Banaxi-Tech nice i joined. whats it for?

https://huggingface.co/bananamind-research-community/bananamind-2.0.1 will be updated for new experiments

idk we will post new arch there before release and other can share their own custom arch too

@Banaxi-Tech excited to see what Bananamind 2.1 brings! i trust it will be very novel lol

if you want previous go joinhttps://huggingface.co/bananamind-research-community

Im doing loops now too lol

I've made an architecture that is arguably better than loops but since there doing so well i might just add them to my arch combining both mechanisms

Do you mean the Qana mini arch?

Also we're now using n-gram embeddings from Qwen Next

That's just called Engram Conditional Memory; it was introduced by DeepSeek, not Qwen.

https://huggingface.co/Qwen/Qwen3.8-Flash-Next

maybe it was but i first saw it here

You should only use some loops, like lets say you have 4 layers then:
L1 🠮 L2 🠮 L2 🠮 L3 🠮 L4 so 5 effective layers not

L1 🠮 L1 🠮 L2 🠮 L2 🠮 L3 🠮 L3 🠮 L4 🠮 L4 because our tests on 1M:

Also we're now using n-gram embeddings from Qwen Next

Very early though we're not going to do loops only probrably 3-6 tower + loops + one new architecture surprise

We also not sure yet if we will use but right now in our testing we got these results:
Model: 1M parameter model on 2B tokens of streamed FW EDU

Why

Im doing loops now too lol

Don't worry we will be releasing our experimental models!