Commit Graph

1760 Commits

Author SHA1 Message Date
Harsha d76cb6a6d2
fix space in the folder name 2024-09-17 12:56:05 -05:00
Nicolas a0189acbec Update fly.yml 2024-09-17 12:58:49 -04:00
Nicolas 31633317dd Update package.json 2024-09-17 12:33:07 -04:00
Nicolas 6b920aa87f
Merge pull request #677 from mendableai/fix/js-sdk-full-page-screenshot
[Bug] Fixed screenshot typo and added test for fullpage screenshot
2024-09-17 12:31:57 -04:00
rafaelsideguide fb8a2c7549 fixed screenshot typo and added test for fullpage screenshot 2024-09-17 11:03:33 -04:00
Nicolas 3c2bfe2da2
Update single_url.ts 2024-09-17 01:58:47 -04:00
Nicolas 18b024c238 Update single_url.ts 2024-09-17 01:41:46 -04:00
Nicolas a4039bd008 Revert "Update single_url.ts"
This reverts commit 0f8c0a570d.
2024-09-16 23:36:38 -04:00
Nicolas a6e1b17386
Update README.md 2024-09-16 21:53:51 -04:00
Nicolas 66577d1d03
Update fly.yml 2024-09-16 21:53:35 -04:00
Nicolas 358f8f9def
Update fly-direct.yml 2024-09-16 21:50:56 -04:00
Nicolas 4884439fd9
Update fly.yml 2024-09-16 21:48:12 -04:00
Nicolas 473e8491b5
Update README.md 2024-09-16 21:46:54 -04:00
Nicolas d21a797ef9
Update fly.yml 2024-09-16 21:46:40 -04:00
Nicolas 0f8c0a570d
Update single_url.ts 2024-09-16 21:44:56 -04:00
Eric Ciarla b7444acb4d
Merge pull request #676 from mendableai/o1-crawler
O1 crawler example
2024-09-16 16:07:07 -04:00
Eric Ciarla 2619522fe7
Merge branch 'main' into o1-crawler 2024-09-16 16:06:15 -04:00
Eric Ciarla e58144798f Update o1_web_crawler.py 2024-09-16 16:04:32 -04:00
Eric Ciarla 8c05aed6e9 Finishing o1 crawler example 2024-09-16 11:30:25 -04:00
Eric Ciarla 3900603a28 Almost done 2024-09-16 11:18:57 -04:00
Nicolas 98de36feb2
Merge pull request #664 from mendableai/nsc/manual-rate-limit
Manual Rate Limiter for select team ids
2024-09-13 18:12:41 -04:00
Nicolas 030ecab6ee Update rate-limiter.ts 2024-09-13 18:09:59 -04:00
Eric Ciarla 2ee7d1d0e4 init 2024-09-13 15:08:23 -04:00
Gergo Moricz 000a316cc3 fix(fire-engine): poll more frequently 2024-09-13 16:41:27 +02:00
Gergo Moricz f7c4cee404 fix(queue-worker): don't send LLM extract hallucination error to Sentry 2024-09-13 14:02:49 +02:00
Gergő Móricz 0d1b46d476 fix(js-sdk): improve error logging 2024-09-12 21:30:17 +02:00
Nicolas e6ac90c1a0 Update package.json 2024-09-12 14:01:47 -04:00
Gergő Móricz d30356a22c fix(js-sdk): infer keyword collision 2024-09-12 19:57:33 +02:00
Gergő Móricz d497284b40 feat(api/queue): auto-remove completed jobs after 25 hours 2024-09-12 19:47:22 +02:00
Nicolas 620b02f9ca Nick: 2024-09-12 12:51:14 -04:00
Gergő Móricz a2903e75cf feat(js-sdk): type-safe LLM extract 2024-09-12 18:48:19 +02:00
Nicolas eec22a56d3 Nick: self host issue template 2024-09-12 11:43:40 -04:00
Nicolas ee38273ff9
Merge pull request #653 from mendableai/mog/fix-status-job-get
fix(v0/crawl-status): don't crash on big crawls when requesting jobs from supa
2024-09-12 11:39:42 -04:00
Nicolas e1171ade1b Merge branch 'main' into mog/fix-status-job-get 2024-09-12 11:35:36 -04:00
Nicolas 503c8b3efa Update package-lock.json 2024-09-12 11:35:26 -04:00
Nicolas e19dc68718 Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-09-11 14:59:40 -04:00
Nicolas 99c1af0a9f Update package.json 2024-09-11 14:59:36 -04:00
Gergő Móricz 5adfd74cc5 feat(js-sdk/test): add API_URL env var 2024-09-11 20:32:34 +02:00
Gergő Móricz ad70c30be5 fix(js-sdk): check at bad if 2024-09-11 20:31:58 +02:00
Gergő Móricz 6e1cf2f40d feat(js-sdk): fixes, update tests 2024-09-11 20:15:43 +02:00
Nicolas 5791d3a0e5 Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-09-11 14:03:36 -04:00
Nicolas 4cd1065ae2 Update rate-limiter.ts 2024-09-11 14:03:34 -04:00
Gergő Móricz c92065ea24
Merge pull request #611 from MonsterDeveloper/fix-attw
build(js-sdk): simplify build process
2024-09-11 19:45:49 +02:00
Gergő Móricz 51da038405
Merge branch 'main' into fix-attw 2024-09-11 19:45:13 +02:00
Gergő Móricz 75f4bcd2ad
Merge pull request #614 from MonsterDeveloper/dependencies
perf(js-sdk): move `dotenv` and `uuid` to `devDependencies`, fix `zod` import
2024-09-11 19:34:50 +02:00
Andrei Bobkov f6fc71b46a
fix(js-sdk): bring back cjs exports 2024-09-11 17:53:17 +03:00
Gergő Móricz 97ffabff3a fix(v1): converting bad docs always gives null 2024-09-10 21:21:20 +02:00
Gergő Móricz 83a165db0f fix(v0/scrape): ensure url is string 2024-09-10 21:18:53 +02:00
Gergő Móricz ad1a6fbc74 fix(v1/map): handle invalid URLs gracefully 2024-09-10 19:41:01 +02:00
Gergő Móricz e19f7a102e feat(js-sdk): paginate next on checkCrawlStatus + better types for CSR 2024-09-10 19:29:38 +02:00