chore: sync main to dev by vansangpfiev · Pull Request #2147 · janhq/cortex.cpp

and others added 30 commits

February 3, 2025 09:28
* feat: add amd gpu windows

* chore: remove unused code

* feat: get amd gpus

* fix: clean

* chore: cleanup

* fix: set activate

* fix: build windows

* feat: linux

* fix: add patches

* fix: map cuda gpus

* fix: build

* chore: docs

* fix: build

* chore: clean up

* fix: build

* fix: build

* chore: pack vulkan windows

* chore: vulkan linux

---------

Co-authored-by: vansangpfiev <sang@jan.ai>
Co-authored-by: vansangpfiev <sang@jan.ai>
chore: cherry pick AMD hardware API support
Co-authored-by: vansangpfiev <sang@jan.ai>
* fix: ignore compute_cap if not present

* fix: correct gpu info

* fix: remove check for toolkit version

---------

Co-authored-by: vansangpfiev <sang@jan.ai>
chore: cherry pick bugfix from dev
…le (#1918)

Co-authored-by: vansangpfiev <vansangpfiev@gmail.com>
chore: cherry-pick: symlinked model deletion shouldn't remove original file
* fix: correct gpu info list

* chore: cleanup

---------

Co-authored-by: vansangpfiev <sang@jan.ai>
Co-authored-by: vansangpfiev <sang@jan.ai>
Co-authored-by: vansangpfiev <sang@jan.ai>
Co-authored-by: vansangpfiev <sang@jan.ai>
Co-authored-by: vansangpfiev <sang@jan.ai>
chore: cherry-pick: permission issue for default drogon uploads folder (#1870)
Co-authored-by: vansangpfiev <sang@jan.ai>
* fix: wrap vulkan gpu function

* fix: init

* fix: cpu usage

* fix: build windows

* fix: buld macos

---------

Co-authored-by: vansangpfiev <sang@jan.ai>
Co-authored-by: sangjanai <sang@jan.ai>
Co-authored-by: sangjanai <sang@jan.ai>
Co-authored-by: sangjanai <sang@jan.ai>
Co-authored-by: sangjanai <sang@jan.ai>
Co-authored-by: sangjanai <sang@jan.ai>
Co-authored-by: sangjanai <sang@jan.ai>

@sangjanai

@vansangpfiev

@sangjanai

@vansangpfiev

* chore: remove unused fields for remote model config

* fix: model path

---------

Co-authored-by: sangjanai <sang@jan.ai>
…2042)

Co-authored-by: sangjanai <sang@jan.ai>
Co-authored-by: sangjanai <sang@jan.ai>
* fix: filter out imported model for model sources

* fix: improve error handling for remote engine

---------

Co-authored-by: sangjanai <sang@jan.ai>
Co-authored-by: sangjanai <sang@jan.ai>
* feat: support pull and load vision model

* fix: discard metadata for vision models

---------

Co-authored-by: sangjanai <sang@jan.ai>
* fix: add simple authentication

* fix: exclude v1/configs

---------

Co-authored-by: sangjanai <sang@jan.ai>
Co-authored-by: sangjanai <sang@jan.ai>
* fix: use copy instead of reference

* fix: exclude swagger

---------

Co-authored-by: sangjanai <sang@jan.ai>
chore: cherry-pick dev commits to main
Co-authored-by: sangjanai <sang@jan.ai>
* fix: get models for anthropic

* fix: model list for cohere

---------

Co-authored-by: sangjanai <sang@jan.ai>
Co-authored-by: sangjanai <sang@jan.ai>
chore: cherry-pick from dev
* chore: reduce local installer size

@Minh141120

@sangjanai

hiento09