Migrate from Ollama

This document presents a guide for migrating from the Ollama API to the MK1 Flywheel API. This guide will help you understand the differences between the two APIs and how to update your code to use the MK1 Flywheel API.

Take into consideration that specific Modelfiles might have different parameters to the ones described in this document. For more information, refer to the specific Modelfile documentation.

Ollama	MK1 Flywheel	Comments
model		The model is already defined when creating an MK1 Flywheel endpoint.
prompt	text
options.num_predict	max_tokens
(Unavailable)	eos_token_ids	Ollama models have their EOS tokens defined in the model file. For MK1 Flywheel, you need to specify the correct EOS tokens for the model you are using.
options.stop	stop
options.temperature	temperature
options.top_k	top_k
options.top_p	top_p