We did an experiment, we wanted to see if AI is good enough to train models. We used GPT 5.6 Sol Max for this because its one of the most powerful ones right now. Our instructions were, it should write the training code, and start the training process and monitor it by itself. We also gave it a link to BananaMind 2 Mini to get our architecture right. The result: It worked, it made the working BananaMind 2 Nano, and even beat our previous MiniBananaMind v4 9M. Its getting way easier to develop your own models now!
We're announcing BananaMind 2 Micro, our smallest model in the BananaMind 2 model family. This model is not released yet, training has not started yet. It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter. The key changes are: No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr. LR goes to 2.2e-2. We're adding the XSA refresh gate from the TX4 architecture into our own. Training will start on August 3, release date is estimated to be August 4-6. On August 3 we will also release our Public Preview of BananaMind 2 Pro. Follow us to know when our models release
Our preview of BananaMind 2 Pro will release on August 3. Before we do that we want to hit a goal Lets get 150 followers on my account and 75 on BananaMind! Me: @Banaxi-Tech BananaMind:
BananaMind Full Release on August 10-14 Would really appreciate it!