Skip to content
  • Yunus Kalkan's avatar
    ONNX RT-GenAI integration into LLM · c4a4624e
    Yunus Kalkan authored
    
    
    * Add ONNX RT-GenAI backend (v0.8.2) support to LLM
    * Build ONNX Runtime (v1.22.0) as part of ONNX Runtime-GenAI Integration
    * Introduce general KleidiAI flag (-DUSE_KLEIDIAI) and configure framework-specific KleidiAI flags
    * Update README with ONNX Runtime-GenAI backend usage and build instructions
    * Disable -DLLAMA_CURL by default
    
    Change-Id: I6812a3fafb78f55043a7653c7dce267a20670cf3
    Signed-off-by: Yunus Kalkan's avatarYunus Kalkan <yunus.kalkan@arm.com>
    c4a4624e
Loading