Debanjum Singh Solanky 53eabe0c06 Support Gemma 2 for Offline Chat ...

- Pass system message as the first user chat message as Gemma 2
  doesn't support system messages
- Use gemma-2 chat format
- Pass chat model name to generic, extract questions chat actors
  Used to figure out chat template to use for model
  For generic chat actor argument was anyway available but not being
  passed, which is confusing

2024-07-18 03:09:38 +05:30

3.7 KiB

Raw Blame History

View Raw