Commit Graph

935 Commits

Author SHA1 Message Date
Nicolas 3746b6207a
Merge pull request #303 from Lakr233/patch-1
Fix Broken Link
2024-06-19 11:13:25 -04:00
Lakr 3d1766ba7b
Fix Broken Link 2024-06-19 20:38:42 +08:00
Nicolas c4252b6170
Merge pull request #302 from mendableai/cjp/email-to-posthog-logging
Cjp/email to posthog logging
2024-06-18 21:30:42 -04:00
Caleb Peffer e59ba758f5 Caleb: changed posthog logging so that It associates jobs with a group. No 2024-06-18 17:42:21 -07:00
Caleb Peffer 5a91d8425f Caleb: solve for typechecking on idempotencyKey on my machine 2024-06-18 17:07:38 -07:00
Nicolas 32dde257a5
Merge pull request #301 from mendableai/bugfix/issue-291
[Bug] Fixed includeHTML to use cleanedHtml as response
2024-06-18 16:26:55 -04:00
rafaelsideguide 9c539e9113 Fixed includeHTML to use cleanedHtml as response 2024-06-18 16:26:54 -03:00
Nicolas 1c5a1dd487
Merge pull request #297 from AndyMik90/feat/removeTags-regex
[Feat] Added support for RegEx in removeTags
2024-06-18 14:03:41 -04:00
Rafael Miller f5a9acc4c6
Merge branch 'main' into feat/removeTags-regex 2024-06-18 14:39:59 -03:00
rafaelsideguide 9f7afd1e88 fix for some complex cases 2024-06-18 14:36:51 -03:00
Nicolas 8db8997daf Nick: test suite + fly 2024-06-18 13:34:44 -04:00
Nicolas d0c05accf6 Nick: 2024-06-18 13:21:50 -04:00
Nicolas 818751a256
Merge pull request #294 from mendableai/tests/e2e-to-unit
[Test] Transcribed from e2e to unit tests for many cases
2024-06-18 13:09:22 -04:00
Nicolas a3115004af
Merge pull request #296 from NeevJewalkar/sdk-update
Added local host support for the javascript SDK
2024-06-18 13:03:37 -04:00
Nicolas 754c9fa08d Update package.json 2024-06-18 12:58:57 -04:00
Nicolas 90a807c547 Update index.ts 2024-06-18 12:56:13 -04:00
Nicolas 26e8bfc23a Merge branch 'main' into pr/296 2024-06-18 12:55:45 -04:00
Nicolas b53ba58bc0
Merge pull request #282 from mendableai/nsc/rate-limiter-tests
test: Rate Limit Unit Tests
2024-06-18 11:01:28 -04:00
Nicolas 3b6c9a8557
Merge pull request #298 from mendableai/feat/type-improvements
[Feat] Improvements on response document types
2024-06-18 11:00:02 -04:00
rafaelsideguide 727e5de8c5 Update index.test.ts 2024-06-18 11:54:10 -03:00
rafaelsideguide c54e797eb1 (╯°□°)╯︵ ┻━┻ 2024-06-18 11:51:28 -03:00
rafaelsideguide 6e32522fa2 Improvements on response document types 2024-06-18 11:43:06 -03:00
rafaelsideguide 3c1af0aa33 Update ci.yml 2024-06-18 11:03:57 -03:00
rafaelsideguide 20f14bcf7f Added some types 2024-06-18 10:55:07 -03:00
rafaelsideguide c2fc69af1c removed some e2e tests that are making the ci get stuck 2024-06-18 09:57:05 -03:00
rafaelsideguide 6c726a02eb Moved to utils/removeUnwantedElements, added unit tests 2024-06-18 09:46:42 -03:00
AndyMik90 8b3c3aae91 Added support for RegEx in removeTags 2024-06-18 07:31:46 +02:00
neev jewalkar e5ffda1eec Added local host support for the javascript SDK 2024-06-18 05:42:25 +05:30
rafaelsideguide b2bd562bb2 transcribed from e2e to unit tests for many cases 2024-06-17 17:09:44 -03:00
Nicolas ab038051e9 Merge branch 'main' into nsc/rate-limiter-tests 2024-06-17 15:06:12 -04:00
rafaelsideguide a20d002a6b Delete test-run-report.json 2024-06-17 09:25:29 -03:00
Eric Ciarla d236fe9a1e
Merge pull request #285 from mendableai/feat/maxDepthRelative
Feat/max depth relative
2024-06-15 17:23:20 -04:00
Eric Ciarla 519ab1aecb Update unit tests 2024-06-15 17:14:09 -04:00
Eric Ciarla f0d4146b42 Merge branch 'feat/maxDepthRelative' of https://github.com/mendableai/firecrawl into feat/maxDepthRelative 2024-06-15 16:52:00 -04:00
Eric Ciarla ff7b52cab1 Delete one more e2e test 2024-06-15 16:51:50 -04:00
Eric Ciarla b1eb608295
Merge branch 'main' into feat/maxDepthRelative 2024-06-15 16:50:27 -04:00
Eric Ciarla 34e37c5671 Add unit tests to replace e2e 2024-06-15 16:43:37 -04:00
Eric Ciarla 2b40729cc2 Update index.test.ts 2024-06-15 08:56:32 -04:00
Eric Ciarla f22759b2e7 Update index.test.ts 2024-06-14 19:42:11 -04:00
Eric Ciarla a6b7197737 Fix for maxDepth 2024-06-14 19:40:37 -04:00
Nicolas 4ec863718b
Merge pull request #283 from mendableai/nsc/crawler-fixes
Fixes crawler getting confused with base paths that contain www.
2024-06-14 13:50:32 -07:00
Nicolas 43767360d8 Merge branch 'main' into nsc/rate-limiter-tests 2024-06-14 13:50:21 -07:00
Nicolas e88cb314c8 Update crawler.ts 2024-06-14 13:44:54 -07:00
Rafael Miller 361cba4119
Merge pull request #175 from mendableai/test/load-testing
Test/load testing
2024-06-14 17:39:01 -03:00
Nicolas 7b11ace87d Create rate-limiter.test.ts 2024-06-14 12:31:42 -07:00
rafaelsideguide e369d1dd0e Update index.test.ts 2024-06-14 16:17:54 -03:00
Nicolas e37aa3db57 Nick: fixed rate limit on status 2024-06-14 12:13:02 -07:00
rafaelsideguide a6ed2e693f Update index.test.ts 2024-06-14 15:22:52 -03:00
rafaelsideguide ad7795f973 Merge remote-tracking branch 'origin/main' into test/load-testing 2024-06-14 15:14:01 -03:00
Rafael Miller 0ec26576d6
Merge pull request #277 from mendableai/feat/maxDepthRelative
Make maxDepth relative to the entered url
2024-06-14 13:07:23 -03:00