Debanjum Singh Solanky 4977b55106 Use offline chat prompt config to set context window of loaded chat model ...

Previously you couldn't configure the n_ctx of the loaded offline chat
model. This made it hard to use good offline chat model (which these
days also have larger context) on machines with lower VRAM

2024-04-14 02:35:36 +05:30

3.5 KiB

Raw Blame History

View Raw