Commit Graph

1628 Commits

Author SHA1 Message Date
Andrei Bobkov 2b0e447bc2
perf(js-sdk): move `dotenv` and `uuid` to `devDependencies` 2024-09-03 11:13:48 +02:00
Andrei Bobkov 2a8f55e533
perf(js-sdk): remove whole `z` import and instead use type-only import 2024-09-03 11:12:28 +02:00
Nicolas c3d90d494c
Merge pull request #516 from kevinswiber/fix/use-db-auth-in-single-url-scraper
Ensuring USE_DB_AUTHENTICATION is true in single URL scraper.
2024-09-02 23:35:52 -03:00
Nicolas 08a9cb8db4 Merge branch 'main' into pr/516 2024-09-02 23:32:23 -03:00
Nicolas 3244454826 Nick: 2024-09-02 19:36:36 -03:00
Nicolas 2444f7c450 Update scrape.ts 2024-09-02 18:51:18 -03:00
Nicolas 00dacaf935 Nick: scrape id when origin is website for report system 2024-09-02 18:43:52 -03:00
Nicolas 11971da359
Merge pull request #607 from mendableai/fix/v1-maxDepth
fix(v1): maxDepth
2024-09-02 10:42:51 -03:00
rafaelsideguide 036eb925a2 fix(v1): maxDepth 2024-09-02 09:55:35 -03:00
Nicolas 86b0477708 Update map.ts 2024-09-01 19:54:15 -03:00
Nicolas 304b3e752e Update map.ts 2024-09-01 19:52:21 -03:00
Nicolas 4f3d421c70
Merge pull request #594 from mendableai/v1/webhooks
[v1] Webhooks
2024-09-01 15:13:10 -03:00
Nicolas cb2dfe29be Nick: 2024-09-01 15:06:36 -03:00
Gergő Móricz 980293652d fix(queue-worker): new getJobs, log on v0 2024-09-01 19:29:35 +02:00
Nicolas 44fe741c35 Update queue-worker.ts 2024-09-01 14:19:43 -03:00
Nicolas 758f729ae2 Update queue-worker.ts 2024-09-01 14:10:47 -03:00
Nicolas 5c05bb12a7 Update webhook.ts 2024-09-01 13:58:50 -03:00
Nicolas ae90370543 Update webhook.ts 2024-09-01 13:58:07 -03:00
Nicolas 0df2441d7f Nick: sdks good 2024-09-01 13:54:41 -03:00
Nicolas b68a50fea3 Nick: 2024-09-01 13:52:34 -03:00
Nicolas 979697df1c Update queue-worker.ts 2024-09-01 13:47:51 -03:00
Nicolas 95b9dc915d Nick: webhooks v1 working great 2024-09-01 13:44:36 -03:00
Nicolas faae98ecb8 Merge branch 'main' into v1/webhooks 2024-09-01 12:56:11 -03:00
Nicolas fe6abe8f7d Nick: 2024-09-01 12:55:02 -03:00
Nicolas 2ef43d5fc2 Update rate-limiter.ts 2024-08-31 14:26:16 -03:00
Nicolas 8431be5826 Nick: 2024-08-31 14:23:55 -03:00
Nicolas af5cc5f16b Nick: 1.2 - v1 llm extract 2024-08-31 13:25:48 -03:00
Nicolas 055177cf0b
Merge pull request #586 from mendableai/v1/llm-extract
[v1] LLM Extract
2024-08-31 12:44:41 -03:00
Nicolas 0c59564393 Merge branch 'main' into v1/llm-extract 2024-08-30 21:31:49 -03:00
Gergő Móricz 693dc14d9b remove invalid keys 2024-08-31 00:08:24 +02:00
Nicolas 6d1da2e22a Update index.ts 2024-08-30 18:45:02 -03:00
Nicolas d347160ff9 Nick: 2024-08-30 17:32:41 -03:00
Nicolas 522d256b11 Merge branch 'main' into v1/llm-extract 2024-08-30 17:16:21 -03:00
Nicolas ef5c8931eb Update scrape.ts 2024-08-30 17:09:44 -03:00
Nicolas 050cac51ec Update types.ts 2024-08-30 17:02:29 -03:00
Nicolas 012bc74e14 Revert "Update types.ts"
This reverts commit 77766cf00d.
2024-08-30 17:02:05 -03:00
Nicolas 77766cf00d Update types.ts 2024-08-30 17:01:54 -03:00
rafaelsideguide 87e61f2d51 v0 working 2024-08-30 16:38:55 -03:00
rafaelsideguide dc189e1e9d feat: webhooks config on v1 2024-08-30 16:22:59 -03:00
Nicolas 7f1ed6b489 Update README.md 2024-08-30 15:52:23 -03:00
Nicolas 23dfe90baa Nick: 2024-08-30 15:43:31 -03:00
Nicolas 0732997a13 Merge branch 'main' into v1/llm-extract 2024-08-30 15:42:45 -03:00
Gergo Moricz c8e0bb93ea fix(crawl-status): handle null data when purging rawHtml 2024-08-30 20:40:57 +02:00
Nicolas 4f92bb4bf4 Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-08-30 15:29:47 -03:00
Nicolas 282962e36f Nick: 2024-08-30 15:29:41 -03:00
Gergo Moricz 6a6b487474 fix(v1): don't fail on doc = null 2024-08-30 20:28:18 +02:00
Nicolas 71dab56e36 Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-08-30 15:21:29 -03:00
Nicolas d7dbc2536d Update crawl.ts 2024-08-30 15:21:22 -03:00
Nicolas 9de39cfa2c
Merge pull request #591 from mendableai/mog/websocket-sdk
[v1] Websockets SDKs
2024-08-30 15:06:06 -03:00
Nicolas 81bbab77bb
Merge pull request #593 from mendableai/nsc/rpc-cloudflare-issues
Fixed RPC cloudflare issues with job ids
2024-08-30 14:57:05 -03:00