Commit Graph

1858 Commits

Author SHA1 Message Date
Nicolas 84cebf618b Nick: 2024-04-19 15:36:00 -07:00
Nicolas 005ac8f839 Merge branch 'main' into detect-pdfs 2024-04-19 15:13:32 -07:00
Nicolas 5b93799149 Nick: a bit faster 2024-04-19 15:13:17 -07:00
rafaelsideguide 890bde686f added type declarations 2024-04-19 19:10:05 -03:00
Nicolas de1e13d79d
Merge pull request #30 from mendableai/bugfix/scrape-test-failing
[Bugfix] Fixed scrape preview test
2024-04-19 15:03:50 -07:00
rafaelsideguide 37ef8a015c fixing scrape preview test 2024-04-19 17:55:35 -03:00
Nicolas c5cb268b61 Update pdfProcessor.ts 2024-04-19 13:13:42 -07:00
Nicolas 43cfcec326 Nick: disabling in crawl and sitemap for now 2024-04-19 13:12:08 -07:00
Nicolas 140529c609 Nick: fixes pdfs not found 2024-04-19 13:05:21 -07:00
Nicolas 15cfc01f5d Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-04-19 12:23:14 -07:00
Nicolas a144e13e30 Update rate-limiter.ts 2024-04-19 12:23:13 -07:00
rafaelsideguide 384fb1db18 updating version 2024-04-19 15:27:54 -03:00
Rafael Miller 3c14b02f8b
Merge pull request #25 from mendableai/feat/replace-all-paths-to-absolute-paths
Added option to replace all relative paths with absolute paths
2024-04-19 15:18:50 -03:00
Rafael Miller be258ea1c5
Merge pull request #28 from mendableai/feat/better-types-for-jssdk
[Feat] Added TSDocs and types for js-sdk
2024-04-19 15:14:17 -03:00
rafaelsideguide 3ddff62a56 adding better doc and types for js-sdk 2024-04-19 14:49:35 -03:00
Ikko Eltociear Ashimine 9e9d66f7a3
refactor: fix typo in WebScraper/index.ts
breakign -> breaking
2024-04-20 02:27:53 +09:00
rafaelsideguide 72e1dadccd adding option to replace all relative paths with absolute paths 2024-04-19 11:47:20 -03:00
Nicolas 2c0660653d Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-04-18 13:56:25 -07:00
Nicolas be35b32306 Nick: preview token tests 2024-04-18 13:55:55 -07:00
Rafael Miller e19874bbe1
Merge pull request #22 from mendableai/feat/ci-cd-env-secrets
adding env secrets
2024-04-18 17:50:00 -03:00
rafaelsideguide 7049780426 adding all tests 2024-04-18 17:47:15 -03:00
rafaelsideguide 1c8ffc9faa fixing deploy workflow 2024-04-18 17:44:33 -03:00
rafaelsideguide c627d22179 all working now 2024-04-18 17:41:23 -03:00
rafaelsideguide dab0568c43 testing tests 2024-04-18 17:38:12 -03:00
rafaelsideguide 4018d7ca17 fixing workflow 2024-04-18 17:35:00 -03:00
rafaelsideguide 4f1179db99 fixing workflow 2024-04-18 17:32:28 -03:00
rafaelsideguide ca8c8b87dc fixing workflow 2024-04-18 17:29:06 -03:00
rafaelsideguide 3f833737f3 fixing test 2024-04-18 17:25:25 -03:00
rafaelsideguide efbb4e8905 fixing jest parameters 2024-04-18 17:18:15 -03:00
rafaelsideguide dae024adc1 fixing env position 2024-04-18 17:08:48 -03:00
rafaelsideguide 2ca00d8186 adding openHandlesTimeout 2024-04-18 17:03:52 -03:00
rafaelsideguide dcccfab4cd adding other env secrets 2024-04-18 16:55:49 -03:00
rafaelsideguide d7c797d0f3 adding env secrets 2024-04-18 16:49:31 -03:00
Rafael Miller 44057cc7d6
Merge pull request #21 from mendableai/feat/ci-cd-workflow
adding workflow
2024-04-18 16:41:54 -03:00
rafaelsideguide 42de846013 adding workflow 2024-04-18 16:41:15 -03:00
Rafael Miller a2cc0cbfda
Merge pull request #20 from mendableai/feat/ci-cd
adding ci-cd workflow
2024-04-18 16:31:18 -03:00
rafaelsideguide ddb3b25171 adding ci-cd workflow 2024-04-18 16:28:01 -03:00
Nicolas 3e9e24aaf1 Update index.ts 2024-04-18 11:01:24 -07:00
Nicolas 0f7ab4107f Update index.ts 2024-04-18 10:41:06 -07:00
Nicolas 0f6fdd7f63
Merge pull request #17 from mendableai/feat/pdf-parser
[Feat] Adding pdf parser
2024-04-18 10:34:56 -07:00
Nicolas 6112cc1c2c Update index.ts 2024-04-18 10:34:41 -07:00
rafaelsideguide c4cc4b9262 fixing document response 2024-04-18 14:12:39 -03:00
Rafael Miller 704a059448
Update index.ts 2024-04-18 13:53:11 -03:00
rafaelsideguide 57e5b36014 [Feat] Adding pdf parser 2024-04-18 11:43:57 -03:00
Nicolas 50cf97c709 Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-04-17 22:23:11 -07:00
Nicolas e3a6bc4de7 Create openapi.json 2024-04-17 22:23:10 -07:00
Nicolas d55c23ec07
Update README.md 2024-04-17 21:50:41 -07:00
Nicolas 2bed55a3b4 Nick: 2024-04-17 19:05:28 -07:00
Nicolas 7ce2dd976f
Merge pull request #14 from mendableai/nsc/clean-content
Option to extract only the main content, excluding headers, navs, footers etc.
2024-04-17 21:40:47 -04:00
Nicolas ca2bf9cc12 Update single_url.ts 2024-04-17 18:27:08 -07:00