UniqAI/tree-of-thought-llm
1
0
Fork 0
mirror of https://github.com/princeton-nlp/tree-of-thought-llm synced 2025-05-07 13:14:23 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Adding quantized models, quantization code and experiments, as well as composite benchmark data code

Browse Source
This commit is contained in:
emilyworks 2024-12-05 02:27:28 -05:00
parent 17c8f9b8dc
commit c8b043675a
2 changed files with 7050 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
quant_experiments/README.md Normal file
View File

@ -0,0 +1,3 @@
This subdirectory holds the code, experiments, and data used to create and finetune various quantized llama3.2-3b models.
The actual models that resulted from the above experiments can be found [here](https://drive.google.com/drive/folders/101iMawJ5dXQu2YehHPyviDDM_Q3i6Np0?usp=sharing).

7047
quant_experiments/tot_torch_quant.ipynb Normal file
View File

File diff suppressed because one or more lines are too long