| Prompt | string | The prompt to generate the response | Explain the concept of transformers in large language models in simple terms, with a short example. |
| System Prompt | string | System prompt to provide context or instructions to the model. | Only answer the question, do not provide any additional information or add any prefix/suffix other than the answer of the original question. Don't use markdown. |
| Model | Enum (15 options) | Name of the model to use. Premium models are charged at 10x the rate of standard models, they include: deepseek/deepseek-r1, google/gemini-pro-1.5, openai/gpt-4.1, anthropic/claude-3-5-haiku, openai/gpt-4o, anthropic/claude-3.5-sonnet, openai/o3, meta-llama/llama-3.2-90b-vision-instruct, anthropic/claude-3.7-sonnet, openai/gpt-5-chat. | google/gemini-2.5-flash |
| Reasoning | boolean | Should reasoning be the part of the final answer. | false |
| Priority | Enum (2 options) | Throughput is the default and is recommended for most use cases. Latency is recommended for use cases where low latency is important. | throughput |
| Temperature | int | This setting influences the variety in the model’s responses. Lower values lead to more predictable and typical responses, while higher values encourage more diverse and less common responses. At 0, the model always gives the same response for a given input. | 1 |
| Max Tokens | int | This sets the upper limit for the number of tokens the model can generate in response. It won’t produce more than this limit. The maximum value is the context length minus the prompt length. | null |