---
license: apache-2.0
tags:
- RakutenAI
- RakutenAI Large
- RakutenAI-3.0
- DeepSeek-V3
- Mistral
language:
- ja
- en
pipeline_tag: text-generation
---
 
# RakutenAI-3.0 

## Model Description 
Rakuten AI 3.0, is an approximately 700 billion parameter Mixture of Experts (MoE) model optimized for Japanese. Developed by leveraging the best from the open-source community and building on Rakuten’s high-quality, bilingual original data, engineering and research, it offers a superior grasp of Japanese language and culture. 

For more details, please check the announcement at:  
- [ENGLISH Version](https://global.rakuten.com/corp/news/press/2026/0317_01.html) 
- [JAPANESE Version](https://corp.rakuten.co.jp/news/press/2026/0317_01.html) 

## Model Details 
- **Developed by**: [Rakuten Group, Inc.](https://ai.rakuten.com/) 
- **Language(s)**: Japanese, English 
- **License**: [Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0) 
- **Model Architecture**: Mixture of Experts (MoE) 
- **Total Parameters**: 671B 
- **Activated Parameters per Token**: 37B 
- **Context Length**: 128K 

## How to Run Locally 

### Inference with [SGLang](https://github.com/sgl-project/sglang)  
- Recommended DOCKER Image: [dockerhub-us/lmsysorg/sglang:v0.5.6.post2](https://hub.docker.com/layers/lmsysorg/sglang/v0.5.6.post2/images/sha256-8c5dd4028551e5bf228551d1656cada22d9686408c7cdbbe1948aecd95a99010) 
``` 
python -m sglang.launch_server \ 
    --model-path Rakuten/RakutenAI-3.0 \ 
    --tp 8 \ 
    --mem-fraction-static 0.85 \ 
    --trust-remote-code \ 
    --show-time-cost 
``` 
## Limitations and Bias 
RakutenAI-3.0 can generate human-like text across a wide range of topics. However, like all large language models, it has limitations and may produce biased, inaccurate, or unsafe outputs. Please exercise caution and judgment when interacting with this model, and ensure appropriate safeguards are in place for production deployments. 
## Citation 

```bibtex 
@misc{rakutengroup2026rakutenai3.0, 
  author = {Rakuten Group, Inc.}, 
  title = {RakutenAI-3.0}, 
  year = {2026}, 
  publisher = {Hugging Face}, 
  url = {https://huggingface.co/Rakuten}, 
} 
``` 

## Contact 

For questions or feedback, please open an issue on this repository or visit [ai.rakuten.com](https://ai.rakuten.com/).