tree-of-thought-llm/quant_experiments
2024-12-05 02:27:28 -05:00
..
README.md Adding quantized models, quantization code and experiments, as well as composite benchmark data code 2024-12-05 02:27:28 -05:00
tot_torch_quant.ipynb Adding quantized models, quantization code and experiments, as well as composite benchmark data code 2024-12-05 02:27:28 -05:00

This subdirectory holds the code, experiments, and data used to create and finetune various quantized llama3.2-3b models.

The actual models that resulted from the above experiments can be found here.