SLM Translation Hub
Quantized multilingual translation library designed for offline local document conversion across 20+ language profiles.
🚀 Overview & Capabilities
Quantized multilingual translation library designed for offline local document conversion across 20+ language profiles.
Key Features
- Quantized translation weights optimized for CPU RAM footprint
- Preserves original formatting (HTML, Markdown, DOCX markup)
- Sentence-alignment validation for precise paragraph mappings
- Completely offline operation — ideal for restricted documents
💻 Installation
Install the local CPU-optimized package using pip:
# Install local CPU-optimized package
pip install slm-translation
🐙 Checkout from GitHub
Clone only this agent's folder from the monorepo using Git sparse-checkout — no need to download the full repository:
Option 1 — Sparse Checkout (Recommended)
Option 2 — Full Repository Clone
💡 Tip: After checkout, install the package locally with pip install -e ./slm_translation to run in editable mode without publishing to PyPI.
⚙️ Configuration API
Constructor Parameters
Instantiate SLMTranslationHub with performance options:
| Parameter | Type / Default | Description |
|---|---|---|
| model_path | str | None | Explicit path to ONNX model weights. If omitted, downloads standard checkpoints. |
| cache_dir | str | None | Directory to store model weights offline. Defaults to ~/.cache/slm-translation/. Also settable via SLM_TRANSLATION_HUB_CACHE_DIR. |
| n_threads | int | 4 | CPU thread count for ONNX inference. Optimize for CPU core count. Also settable via SLM_TRANSLATION_HUB_N_THREADS. |
Methods
| Method Signature | Return Type | Description |
|---|---|---|
translate(text, source_lang='en', target_lang='hi', system_prompt=None, user_input=None) | str | Translates characters locally to target languages, ensuring syntax integrity is preserved. |
Method Parameters (Execution Customization)
All main execution methods accept optional system routing parameters:
| Parameter | Type / Default | Description |
|---|---|---|
| system_prompt | str | None | Optional custom system prompt instruction to override the default system template response parameters. |
| user_input | str | None | Optional additional user-supplied target text variables or contextual keys. |
Quick Start
from slm_translation import SLMTranslationHub
hub = SLMTranslationHub()
translated = hub.translate(
"hello world",
source_lang="en",
target_lang="hi",
system_prompt="Strict dialect formatting",
user_input="Formal script conversion"
)
print(translated)
Environment Variables
Configure agent parameters globally using environment values:
| Environment Variable | Default | Purpose |
|---|---|---|
| SLM_TRANSLATION_HUB_N_THREADS | 4 | Sets CPU inference execution threads. |
| SLM_TRANSLATION_HUB_CACHE_DIR | ~/.cache/slm-translation/ | Default directory to store downloaded ONNX weights. |
CPU Performance Tuning
To run the SLMTranslationHub engine efficiently on CPU under 1.5 GB memory footprint:
- Match Threads to Core Count: Set
n_threadsorSLM_TRANSLATION_HUB_N_THREADSto match the physical CPU core count. - Sequential Processing: Avoid concurrent processing when batch files are large.
- Garbage Collection: Clear variables and run
gc.collect()to release model RAM blocks after execution.
Verified Input & Output Logs
Diagnostic execution console response running locally on CPU:
→ INPUT (En -> Hi):
"hello world"
← OUTPUT:
"नमस्ते दुनिया"