(Optional) If you are running decoding with gemma-2 models, you will also need to install flashinfer. python -m pip install flashinfer -i https://flashinfer.ai/whl ...
This repository contains an efficient implementation of Kolmogorov-Arnold Network (KAN). The original implementation of KAN is available here. The problem is in the sparsification which is claimed to ...