Nicolas
|
eec22a56d3
|
Nick: self host issue template
|
2024-09-12 11:43:40 -04:00 |
|
Nicolas
|
ee38273ff9
|
Merge pull request #653 from mendableai/mog/fix-status-job-get
fix(v0/crawl-status): don't crash on big crawls when requesting jobs from supa
|
2024-09-12 11:39:42 -04:00 |
|
Nicolas
|
e1171ade1b
|
Merge branch 'main' into mog/fix-status-job-get
|
2024-09-12 11:35:36 -04:00 |
|
Nicolas
|
503c8b3efa
|
Update package-lock.json
|
2024-09-12 11:35:26 -04:00 |
|
Nicolas
|
e19dc68718
|
Merge branch 'main' of https://github.com/mendableai/firecrawl
|
2024-09-11 14:59:40 -04:00 |
|
Nicolas
|
99c1af0a9f
|
Update package.json
|
2024-09-11 14:59:36 -04:00 |
Gergő Móricz
|
5adfd74cc5
|
feat(js-sdk/test): add API_URL env var
|
2024-09-11 20:32:34 +02:00 |
|
Gergő Móricz
|
ad70c30be5
|
fix(js-sdk): check at bad if
|
2024-09-11 20:31:58 +02:00 |
|
Gergő Móricz
|
6e1cf2f40d
|
feat(js-sdk): fixes, update tests
|
2024-09-11 20:15:43 +02:00 |
|
Nicolas
|
5791d3a0e5
|
Merge branch 'main' of https://github.com/mendableai/firecrawl
|
2024-09-11 14:03:36 -04:00 |
|
Nicolas
|
4cd1065ae2
|
Update rate-limiter.ts
|
2024-09-11 14:03:34 -04:00 |
|
Gergő Móricz
|
c92065ea24
|
Merge pull request #611 from MonsterDeveloper/fix-attw
build(js-sdk): simplify build process
|
2024-09-11 19:45:49 +02:00 |
|
Gergő Móricz
|
51da038405
|
Merge branch 'main' into fix-attw
|
2024-09-11 19:45:13 +02:00 |
|
Gergő Móricz
|
75f4bcd2ad
|
Merge pull request #614 from MonsterDeveloper/dependencies
perf(js-sdk): move `dotenv` and `uuid` to `devDependencies`, fix `zod` import
|
2024-09-11 19:34:50 +02:00 |
Andrei Bobkov
|
f6fc71b46a
|
fix(js-sdk): bring back cjs exports
|
2024-09-11 17:53:17 +03:00 |
|
Gergő Móricz
|
97ffabff3a
|
fix(v1): converting bad docs always gives null
|
2024-09-10 21:21:20 +02:00 |
|
Gergő Móricz
|
83a165db0f
|
fix(v0/scrape): ensure url is string
|
2024-09-10 21:18:53 +02:00 |
|
Gergő Móricz
|
ad1a6fbc74
|
fix(v1/map): handle invalid URLs gracefully
|
2024-09-10 19:41:01 +02:00 |
|
Gergő Móricz
|
e19f7a102e
|
feat(js-sdk): paginate next on checkCrawlStatus + better types for CSR
|
2024-09-10 19:29:38 +02:00 |
|
Gergő Móricz
|
4ebc35c9dd
|
fix(crawl-status): add success: true
|
2024-09-10 18:59:09 +02:00 |
rafaelsideguide
|
f855ad3436
|
bumping py-sdk version
|
2024-09-10 10:29:44 -03:00 |
|
Nicolas
|
93b7b313d6
|
Merge pull request #654 from mendableai/fix/issue-644
fix(py-sdk): removed asyncio package
|
2024-09-10 10:27:24 -03:00 |
|
rafaelsideguide
|
ee8a54213c
|
fix(py-sdk): removed asyncio package
tested websocket with example.py without asyncio and it works with no problem.
|
2024-09-10 10:25:27 -03:00 |
|
rafaelsideguide
|
1074e976cd
|
Merge branch 'main' of https://github.com/mendableai/firecrawl
|
2024-09-10 09:09:43 -03:00 |
|
rafaelsideguide
|
45237a29dd
|
updated js-sdk examples
|
2024-09-10 09:09:39 -03:00 |
|
Nicolas
|
a7406031fa
|
Merge branch 'main' of https://github.com/mendableai/firecrawl
|
2024-09-10 06:53:30 -03:00 |
|
Nicolas
|
a17e1cac92
|
Rate bump
|
2024-09-10 06:53:24 -03:00 |
|
Gergo Moricz
|
b4dbf75537
|
fix(v1): check if url is string in blocklistMiddleware
Fixes FIRECRAWL-SCRAPER-JS-9Z
|
2024-09-10 10:25:14 +02:00 |
|
Gergo Moricz
|
26f2095de6
|
fix(v1): proper Invalid URL handling
|
2024-09-10 09:24:23 +02:00 |
|
Gergo Moricz
|
f8fbc71f91
|
fix(supabase-jobs): do not use RPCs
RPCs are more failure-prone for this use case than regular queries are.
|
2024-09-10 09:20:18 +02:00 |
|
Gergo Moricz
|
a6bcf7b438
|
fix(v0/crawl-status): don't crash on big crawls when requesting jobs from supabase
|
2024-09-10 08:53:40 +02:00 |
|
Nicolas
|
2cbc4c59ce
|
Merge pull request #649 from mendableai/nsc/chrome-cdp-for-params
Better engine for wait + other params
|
2024-09-09 21:12:46 -03:00 |
|
Nicolas
|
17e419a7fb
|
Nick:
|
2024-09-09 21:06:23 -03:00 |
|
Nicolas
|
31e973d915
|
Merge pull request #648 from mendableai/nsc/fix-json-error-handler
Fixed 500 errors when JSON is badly formatted
|
2024-09-09 12:28:18 -03:00 |
|
Nicolas
|
ca9a781eb7
|
Update index.ts
|
2024-09-09 12:27:55 -03:00 |
|
Nicolas
|
22a5e85899
|
Update index.ts
|
2024-09-09 12:26:55 -03:00 |
y5n
|
4278fae51e
|
Update README.md
|
2024-09-09 10:55:31 +08:00 |
|
Nicolas
|
60a15d00eb
|
Update types.ts
|
2024-09-08 16:39:12 -03:00 |
|
Nicolas
|
84fb00ec3f
|
Merge pull request #640 from mendableai/nsc/improved-billing-notifications
Improved team credits check and billing notifications
|
2024-09-08 13:07:45 -03:00 |
|
Nicolas
|
fbdfa1256b
|
Update credit_billing.ts
|
2024-09-08 13:07:10 -03:00 |
|
Nicolas
|
48c665519e
|
Update credit_billing.ts
|
2024-09-07 13:42:45 -03:00 |
|
Nicolas
|
32097fa29d
|
Merge branch 'main' of https://github.com/mendableai/firecrawl
|
2024-09-07 13:12:52 -03:00 |
|
Nicolas
|
5758af3291
|
Update website_params.ts
|
2024-09-07 13:12:46 -03:00 |
|
Nicolas
|
b3e2ca9a11
|
Merge pull request #638 from mendableai/nsc/removal-of-tags-in-include-main-content
Removal of generic classnames/ids from onlyMainContent cleaning
|
2024-09-07 13:06:43 -03:00 |
y5n
|
1ea9131e63
|
feat: Update redis deployment to run redis with password if REDIS_PASSWORD is configured
|
2024-09-07 16:00:32 +08:00 |
|
y5n
|
7685853d8a
|
[Fix] fix SELF_HOST.md kubernetes cluster-install link
|
2024-09-07 13:50:47 +08:00 |
|
Nicolas
|
79870e7305
|
Update excludeTags.ts
|
2024-09-06 20:15:26 -03:00 |
|
Nicolas
|
a0f9ab2be7
|
Update map.ts
|
2024-09-06 20:14:47 -03:00 |
|
Nicolas
|
0731b3127d
|
Merge pull request #635 from shige/doc/update-self-host-v1.0.0
[Docs] upgraded the path of the self-hosted documentation URL to `/v1`.
|
2024-09-06 18:24:44 -03:00 |
Eric Ciarla
|
e89e6d89a8
|
Merge pull request #637 from mendableai/ETL-unicorn-example-app
Add Docs to API Spec Example
|
2024-09-06 15:28:41 -04:00 |