Skip to content

[Feature Request] Add custom prompt and extended parameter support for llama.cpp in batch translation #13671

Description

@emsb8888-prog

Currently, the auto-translation feature is quite basic. Without the ability to use custom prompts, the translation quality is not ideal and sometimes lacks accuracy.

I would like to request the addition of the following features for llama.cpp in the batch translation project:
Custom Prompt Support: Allow users to define and apply specific system prompts to guide the translation style and improve quality.
Extended Parameter Options: Expose more llama.cpp generation parameters (e.g., temperature, top_p, etc.) so users can fine-tune the model's behavior.

Note: English is not my native language, so this issue was written using a translation tool. Please let me know if anything is unclear!
Thank you so much for your time and for maintaining this awesome project!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions