On devices results: iPhone 12 Pro Max template: {{prompt}} Model Size Q Token/sec Description LLaMA 2 7B Q3_K_S LLaMA 2 7B Q3_K_M LLaMA 2 7B Q3_K_L LLaMA 2 7B Q4_K_S LLaMA 2 7B Q4_K_M ORCA 3B Q4_K_M ORCA 7B Q3_K_S ORCA 7B Q3_K_M ORCA 7B Q3_K_L ORCA 7B Q4_K_S