RunanywhereAI/trnrt Python

The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.

⭐ 1,565Stars
🍴 15Forks
🐛 11Issues
🕐 2026-11-11Updated
awsglminferencellmllm-servingmegakernelsneuronnkiopenai-apitrainium
Project Insight

Why It Is Worth Watching

RunanywhereAI/trnrt is worth watching as a Python project with 1,565 stars and 15 forks. Its main tags include aws, glm, inference, llm. The project description says: "The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.". It was last updated on 2026-11-11. Compared with the previous snapshot, it gained about 248 stars. It is a useful candidate for developers who are comparing tools, tracking open-source trends, or looking for practical examples in this area. Before adopting it, review the README examples, integration cost, license, issue activity, and release cadence.

📈 Trend History (2 points)