UniqAI/tree-of-thought-llm
1
0
Fork 0
mirror of https://github.com/princeton-nlp/tree-of-thought-llm synced 2024-11-21 15:47:51 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge pull request #9 from yhyu13/dev

Browse Source 
Add openai api key & custom url env
This commit is contained in:
Shunyu Yao 2023-05-25 17:24:47 +02:00 committed by GitHub
commit ae67386a74
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 19 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

11
models.py
View File

@ -4,6 +4,17 @@ import backoff
completion_tokens = prompt_tokens = 0
api_key = os.getenv("OPENAI_API_KEY", "")
if api_key != "":
openai.api_key = api_key
else:
print("Warning: OPENAI_API_KEY is not set")
api_base = os.getenv("OPENAI_API_BASE", "")
if api_base != "":
print("Warning: OPENAI_API_BASE is set to {}".format(api_base))
openai.api_base = api_base
@backoff.on_exception(backoff.expo, openai.error.OpenAIError)
def completions_with_backoff(**kwargs):
return openai.ChatCompletion.create(**kwargs)

8
readme.md
View File

@ -7,8 +7,16 @@ Also check [its tweet thread](https://twitter.com/ShunyuYao12/status/16593575474
## Setup
You need to first have an OpenAI API key and store it in the environment variable ``OPENAI_API_KEY`` (see [here](https://help.openai.com/en/articles/5112595-best-practices-for-api-key-safety)).
If you use custom base url, set it by environment variable ``OPENAI_API_BASE`` (e.g. "https://api.openai.com/v1")
Note GPT-4 model is farily slow, please be patient
Package requirement: ``openai``, ``backoff``, ``sympy``, ``numpy``.
```
pip install openai backoff sympy numpy
```
## Experiments