Skip to main content

ModelRequest

Struct ModelRequest 

Source
pub struct ModelRequest {
    pub model: String,
    pub max_output_tokens: Option<u32>,
    pub thinking_level: ThinkingLevel,
    /* private fields */
}
Expand description

A complete, attributed model request. Constructed only via ModelRequestBuilder.

Fields§

§model: String§max_output_tokens: Option<u32>§thinking_level: ThinkingLevel

Implementations§

Source§

impl ModelRequest

Source

pub fn builder(model: impl Into<String>) -> ModelRequestBuilder

Source

pub fn fragments(&self) -> &[PromptFragment]

Source

pub fn tools(&self) -> &[ToolDefinition]

Source

pub fn bytes_by_source(&self) -> BTreeMap<ContentSource, usize>

Byte attribution by source category, including tool definitions. The heart of the attribution invariant: this is derivable for every request because no content can bypass fragment construction.

Source

pub fn estimate(&self) -> RequestEstimate

Categorized heuristic estimate. Tokenizer counts and provider-reported usage are separate measurements; this does not count wire framing.

Source

pub fn total_bytes(&self) -> usize

Source

pub fn with_suffix_instruction( &self, source: ContentSource, instruction: &str, ) -> Self

Prefix-cache pattern: the live request, unchanged, with one instruction appended as a suffix (compaction summaries, titles). Tool definitions are dropped — suffix requests want plain text back.

Source

pub fn with_warm_probe(&self) -> Self

Cache-warm probe: the request unchanged — tool definitions kept, they are part of the provider’s cached prefix (Anthropic caches tools → system → messages) — plus one throwaway user fragment (providers reject empty message lists). The fragment sits after the system-block cache breakpoint, so its content never affects the cached prefix. max_output_tokens: 1 caps waste if the caller’s first-event abort is slow.

Source

pub fn without_image_blocks(&self) -> Self

The request with every image block replaced by a text note, for models whose endpoint accepts text content only — sending the image block would fail the whole request at the provider. The session log is untouched: history keeps the real image parts, so switching to an image-capable model replays them as images again. Attribution is preserved per fragment; only the image bytes become the note’s text.

Trait Implementations§

Source§

impl Clone for ModelRequest

Source§

fn clone(&self) -> ModelRequest

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for ModelRequest

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl JsonSchema for ModelRequest

Source§

fn schema_name() -> Cow<'static, str>

The name of the generated JSON Schema. Read more
Source§

fn schema_id() -> Cow<'static, str>

Returns a string that uniquely identifies the schema produced by this type. Read more
Source§

fn json_schema(generator: &mut SchemaGenerator) -> Schema

Generates a JSON Schema for this type. Read more
Source§

fn inline_schema() -> bool

Whether JSON Schemas generated for this type should be included directly in parent schemas, rather than being re-used where possible using the $ref keyword. Read more
Source§

impl PartialEq for ModelRequest

Source§

fn eq(&self, other: &ModelRequest) -> bool

Tests for self and other values to be equal, and is used by ==.
1.0.0 (const: unstable) · Source§

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.
Source§

impl Serialize for ModelRequest

Source§

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>
where __S: Serializer,

Serialize this value into the given Serde serializer. Read more
Source§

impl StructuralPartialEq for ModelRequest

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> DynClone for T
where T: Clone,

Source§

fn __clone_box(&self, _: Private) -> *mut ()

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.