---
base_model: ByteDance-Seed/Seed-OSS-36B-Instruct
model_creator: ByteDance-Seed
model_name: Seed-OSS-36B-Instruct
quantized_by: Second State Inc.
pipeline_tag: text-generation
library_name: transformers
---

# Seed-OSS-36B-Instruct-GGUF

## Original Model

[ByteDance-Seed/Seed-OSS-36B-Instruct](https://huggingface.co/ByteDance-Seed/Seed-OSS-36B-Instruct)

## Run with Gaianet

**Prompt template**

prompt template: 

 - `seed-oss-think` for think mode
 - `seed-oss-no-think` for no think mode

**Context size**

chat_ctx_size: `512000`

**Run with GaiaNet**

- Quick start: https://docs.gaianet.ai/node-guide/quick-start

- Customize your node: https://docs.gaianet.ai/node-guide/customize

*Quantized with llama.cpp b6301*