Ollama

条件 #

要点:需要显存或者内存能够完整容纳模型

安装 #

https://ollama.com/

在 Apple silicon 上最简单的安装方法:

brew install --cask ollama

以上是最简单的安装 ollama 的方式

使用过的模型 #

➜ ollama list
NAME                                    ID              SIZE    MODIFIED
Erosumika-7B.q8_0:latest                0e7f5eb4fb77    7.7 GB  38 hours ago
causallm:14b-dpo-alpha                  ab09d2735a29    10 GB   6 days ago
causallm:14b-dpo-alpha.Q5_K_M           fd5a7a9a811a    10 GB   2 days ago
code-companion:latest                   a531346c68b4    26 GB   6 days ago
codellama:latest                        8fdf8f752f6e    3.8 GB  6 days ago
dan-mixtral:latest                      86c09feb918b    5.1 GB  5 days ago
deepseek-coder:33b                      acec7c0b0fd9    18 GB   8 days ago
dolphin-mistral:latest                  ecbf896611f5    4.1 GB  5 days ago
dolphin-mixtral:latest                  cfada4ba31c7    26 GB   9 days ago
gemma:7b-instruct-fp16                  f689ad351c8d    17 GB   6 days ago
gemma:latest                            430ed3535049    5.2 GB  8 days ago
genaiprompt-comma:latest                fe806deca19a    35 GB   5 days ago
linux-terminal:latest                   89cf55e672a4    3.8 GB  5 days ago
llama2:13b                              d475bf4c50bc    7.4 GB  7 days ago
llama2:latest                           78e26419b446    3.8 GB  5 days ago
llava:latest                            8dd30f6b0cb1    4.7 GB  7 days ago
mistral:latest                          61e88e884507    4.1 GB  9 days ago
mixtral:8x7b                            7708c059a8bb    26 GB   9 days ago
mixtral:8x7b-instruct-v0.1-q5_1         632b8b96ce22    35 GB   5 days ago
nomic-embed-text:latest                 0a109f422b47    274 MB  5 days ago
nous-hermes2-mistral:7b-dpo-q8_0        0e1471f9d688    7.7 GB  38 hours ago
nous-hermes2-mixtral:8x7b-dpo-q5_K_M    bce094d11dd6    32 GB   5 days ago
openchat:7b-v3.5-0106                   537a4e03b649    4.1 GB  2 days ago
openchat:latest                         537a4e03b649    4.1 GB  9 days ago
phi:latest                              e2fd6321a5fe    1.6 GB  8 days ago
qwen:14b                                80362ced6553    8.2 GB  5 days ago
sarah-girlfriend:latest                 e97421687cb2    35 GB   5 days ago
silicon-maid:7b-q5_k_m                  37576a660647    5.1 GB  36 hours ago
stablelm-zephyr:latest                  0a108dbd846e    1.6 GB  5 days ago
starcoder2:3b.q5_1                      1ba529ebb6f2    2.3 GB  2 days ago
yi:34b                                  5f8365d57cb8    19 GB   5 days ago
zephyr:7b-beta-q5_K_M                   482c06dc081a    5.1 GB  6 days ago
zephyr:latest                           bbe38b81adec    4.1 GB  8 days ago
pxlksr/opencodeinterpreter-ds:latest    1e582e157f36    3.8 GB  5 days ago

导入模型到 Ollama #

最好的模型 #

配合使用 #