I’ve developed a couple of fine tuned t5 grammar correction models. Is the model or training open?
scottfr 1 days ago [-]
Interesting, I would love to hear how well those worked.
Grammit uses the Prompt API for the local LLM, which currently uses a version of the Gemma 3n model on Chrome.
Grammit uses prompting instead of fine-tuning or custom training. Simplified, it has a system prompt along the lines of: "Rewrite this text, correcting any grammar or spelling mistakes," combined with a prefilled conversation containing a number of examples showing an input sentence and the corrected output.
doug_life 1 days ago [-]
Any idea why this would not be compatible with Vivaldi 7.5.3735.66? The store says "This item is not compatible with your current Chrome version"
scottfr 1 days ago [-]
I don't know if Vivaldi supports the new Prompt API [0] that Grammit uses to run the local LLM.
As far as I know, the only browsers supporting it currently are Chrome [1] and Edge [2].
Grammit uses the Prompt API for the local LLM, which currently uses a version of the Gemma 3n model on Chrome.
Grammit uses prompting instead of fine-tuning or custom training. Simplified, it has a system prompt along the lines of: "Rewrite this text, correcting any grammar or spelling mistakes," combined with a prefilled conversation containing a number of examples showing an input sentence and the corrected output.
As far as I know, the only browsers supporting it currently are Chrome [1] and Edge [2].
[0] https://github.com/webmachinelearning/prompt-api
[1] https://developer.chrome.com/docs/extensions/ai/prompt-api
[2] https://learn.microsoft.com/en-us/microsoft-edge/web-platfor...