Streaming responses

Learn how to stream responses from your API.

With streaming responses being very common in times of AI, this guide will cover how to stream responses from your API.

export const streamChatResponse = publicProcedure
	.input(
		z.object({
			message: z.string(),
		}),
	)
	.handler(async ({ input }) => {
		const { message } = input;
 
		const response = streamText({
			model: 'gpt-4o',
			messages: [
				{
					role: 'user',
					content: message,
				},
			],
		});
 
		return streamToEventIterator(response.toUIMessageStream());
	});

To learn more about streaming with oRPC, you can read the oRPC documentation.

Streaming responses

On this page