Mistral 7B has the lowest latency (0.27s) among the compared models, making it suitable for real-time applications.

Relevant Navigation